-- Logs begin at Mon 2022-08-29 19:24:47 UTC, end at Mon 2022-08-29 20:57:20 UTC. -- Aug 29 20:05:51.983715 dv-cinder-852009-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 20:05:51.995734 dv-cinder-852009-5-smb devstack@keystone.service[81943]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 20:05:51.998879 dv-cinder-852009-5-smb devstack@keystone.service[81943]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 20:05:51 2022] *** Aug 29 20:05:51.998879 dv-cinder-852009-5-smb devstack@keystone.service[81943]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 20:05:51.998879 dv-cinder-852009-5-smb devstack@keystone.service[81943]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 20:05:51.998879 dv-cinder-852009-5-smb devstack@keystone.service[81943]: nodename: dv-cinder-852009-5-smb Aug 29 20:05:51.998879 dv-cinder-852009-5-smb devstack@keystone.service[81943]: machine: x86_64 Aug 29 20:05:51.998879 dv-cinder-852009-5-smb devstack@keystone.service[81943]: clock source: unix Aug 29 20:05:51.998879 dv-cinder-852009-5-smb devstack@keystone.service[81943]: pcre jit disabled Aug 29 20:05:51.999331 dv-cinder-852009-5-smb devstack@keystone.service[81943]: detected number of CPU cores: 4 Aug 29 20:05:51.999331 dv-cinder-852009-5-smb devstack@keystone.service[81943]: current working directory: / Aug 29 20:05:51.999331 dv-cinder-852009-5-smb devstack@keystone.service[81943]: detected binary path: /usr/bin/uwsgi-core Aug 29 20:05:51.999331 dv-cinder-852009-5-smb devstack@keystone.service[81943]: your processes number limit is 47680 Aug 29 20:05:51.999331 dv-cinder-852009-5-smb devstack@keystone.service[81943]: your memory page size is 4096 bytes Aug 29 20:05:51.999331 dv-cinder-852009-5-smb devstack@keystone.service[81943]: detected max file descriptor number: 2048 Aug 29 20:05:51.999331 dv-cinder-852009-5-smb devstack@keystone.service[81943]: lock engine: pthread robust mutexes Aug 29 20:05:51.999331 dv-cinder-852009-5-smb devstack@keystone.service[81943]: thunder lock: enabled Aug 29 20:05:51.999697 dv-cinder-852009-5-smb devstack@keystone.service[81943]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 20:05:51.999697 dv-cinder-852009-5-smb devstack@keystone.service[81943]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 20:05:52.050089 dv-cinder-852009-5-smb devstack@keystone.service[81943]: Python main interpreter initialized at 0x562859c919c0 Aug 29 20:05:52.050089 dv-cinder-852009-5-smb devstack@keystone.service[81943]: python threads support enabled Aug 29 20:05:52.050089 dv-cinder-852009-5-smb devstack@keystone.service[81943]: your server socket listen backlog is limited to 100 connections Aug 29 20:05:52.050089 dv-cinder-852009-5-smb devstack@keystone.service[81943]: your mercy for graceful operations on workers is 90 seconds Aug 29 20:05:52.050501 dv-cinder-852009-5-smb devstack@keystone.service[81943]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 20:05:52.050578 dv-cinder-852009-5-smb devstack@keystone.service[81943]: *** Operational MODE: preforking *** Aug 29 20:05:52.050882 dv-cinder-852009-5-smb devstack@keystone.service[81943]: *** uWSGI is running in multiple interpreter mode *** Aug 29 20:05:52.050882 dv-cinder-852009-5-smb devstack@keystone.service[81943]: spawned uWSGI master process (pid: 81943) Aug 29 20:05:52.051152 dv-cinder-852009-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 20:05:52.052674 dv-cinder-852009-5-smb devstack@keystone.service[81943]: spawned uWSGI worker 1 (pid: 81954, cores: 1) Aug 29 20:05:52.052674 dv-cinder-852009-5-smb devstack@keystone.service[81943]: spawned uWSGI worker 2 (pid: 81955, cores: 1) Aug 29 20:05:52.052674 dv-cinder-852009-5-smb devstack@keystone.service[81943]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 20:05:57.038387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:05:57.038387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: from cryptography.utils import int_from_bytes Aug 29 20:05:57.039488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:05:57.039488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: from cryptography.utils import int_from_bytes Aug 29 20:05:57.039741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:05:57.039741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: from cryptography.utils import int_from_bytes Aug 29 20:05:57.040375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:05:57.040375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: from cryptography.utils import int_from_bytes Aug 29 20:05:57.103550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:05:57.103835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:05:57.104128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] command line args: [] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:05:57.104529 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:05:57.104803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ================================================================================ {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:05:57.105152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] admin_token = **** {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.105499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] config_dir = [] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.105775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.106052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] config_source = [] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.106387 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] debug = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.106686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.107388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.107585 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.107946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.108318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.108663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] list_limit = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.108954 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] log_config_append = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.109155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:05:57.109342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:05:57.109521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.109711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] command line args: [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:05:57.109891 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] log_dir = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.110083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:05:57.110083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ================================================================================ {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:05:57.110423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] log_file = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.110567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] admin_token = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.110859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.111007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] config_dir = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.111007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.111007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] config_source = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.111507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.111643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] debug = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.111643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.112003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.112201 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.112201 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.112201 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.112634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.112838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.113185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.113325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.113459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.113609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_config_append = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.113609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.113609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_dir = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.114031 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.114174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_file = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.114174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.114519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.114724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.114724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.115022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.115157 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.115157 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.115475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.115670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.115670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.115970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.116100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.116100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.116414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.116551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.116551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.116800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.116929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.116929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.117184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.117313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.117313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.117570 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.117701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.81/identity {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.117701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] publish_errors = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.117701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.118133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.81/identity {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.118309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.118439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] publish_errors = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.118578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.118578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.118877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.119020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.119149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.119307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] standard_threads = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.119439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.119585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.119585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.119585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.119930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.120551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] use_journal = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.120551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] use_json = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.120809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.120984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] use_stderr = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.120984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] use_syslog = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.121310 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] standard_threads = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.121479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.121657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.121944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.121944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.122277 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.122394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.122508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.122655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.122805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] use_journal = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.122937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.123077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] use_json = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.123228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.123359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] use_stderr = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.123487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.123635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] use_syslog = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.123776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.123776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.124021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:57.124152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.124152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.124405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.124536 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.124536 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.124787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.124978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.124978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.125231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.125374 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.125507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.125638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.125638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.125875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.126016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.126147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.126457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.126604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.126741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.126882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.126882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.127229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.127375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.127375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.127614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.127746 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.127949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.128077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.128266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.128400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.128527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.128658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.128906 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.129036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.129168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.129306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.129436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.129576 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.129721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.129848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.129986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.130152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.130319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.130471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.130660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.130809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.130952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.131081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.131222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.131365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.131544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.131693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.131825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.132001 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.132140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.132285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.132445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.132583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.132713 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.132873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.133008 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.133148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.133328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.133465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.133661 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.133842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.133982 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.134110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.134330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.134513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.134686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.134877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.135059 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.135254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.135423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.135711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.136402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.136586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.136586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.136928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.137117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.137117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.137447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.137730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.137914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.138086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.138086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.138086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.138546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.138682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.138865 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.139008 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.139008 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.139392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.139528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.139528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.139874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.140009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.140009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.140323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.140504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.140504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.140792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.140929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.140929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.141250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.141393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.141536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.141733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.141733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.142043 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.142178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.142178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.142496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.142686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.142686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.143009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.143143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.143273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.143416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.143416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.143657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.143802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.143802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.144042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.144229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.144363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.144495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.144495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.144753 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.144883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.144883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.145381 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.145513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.145513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.145870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.146006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.146006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.146278 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.146433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.146433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.146686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.146843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.146976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.147108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.147108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.147347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.147493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.147624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.147756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.147888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.148055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.external = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.148234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.148383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.148565 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.148710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.148842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.148996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.149136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.password = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.149363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.token = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.149501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.149630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.150345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.150500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.150696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.150696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.150963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.151108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.151108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.151393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.151513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.151513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.151738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.151922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.152093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.152209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.152323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.152558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.152757 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.152896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.153149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.153294 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.153428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.153580 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.153726 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.153870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.154009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.154140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.154398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.154556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.154690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.154883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.155026 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.155192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.155326 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.155471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.155731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.155876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.156010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.156207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.156440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.156602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.156736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.156868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.157042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.157188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.157323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.157468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.157608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.157755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.157888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.158019 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.158151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.158415 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.163702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.163702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.164114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.164257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.164397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.164550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.164688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.164849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.165102 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.165245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.165384 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.165522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.165661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.165661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.165934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.166149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.166388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.166526 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.166680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.166828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.167027 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.167155 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.167285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.167405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.167523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.167523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.167767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.167920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.168040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.168159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.168278 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.168518 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.168651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.168785 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.168920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.168920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.169161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.169312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.169448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.169579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.169579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.169823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.169823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.170089 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.170254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.170254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.170503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.170637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.170637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.170906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.171043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.171178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.171313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.171313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.171559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.171706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.171706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.171951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.172085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.172085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.172329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.172475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.172475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.172475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.172475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.172961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.173111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.173247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.173381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.173381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.173626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] auth.external = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.173755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.173755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.174090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.174209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.174209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.174495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.174630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.174630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.174898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.175032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.175032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.175274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] auth.password = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.175408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.175408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.175678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] auth.token = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.175824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.175958 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.176090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.176090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.176347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.176481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.176481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.176725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.176860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.176860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.177118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.177252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.177387 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.177522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.177522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.177764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.177912 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.177912 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.178208 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.178450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.178450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.178584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] credential.caching = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.178660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.178660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.178784 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.178843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.178843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.178946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179012 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179012 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.179899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180073 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180073 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180836 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180903 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.180903 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] federation.caching = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.181965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.182178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.182380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.182462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.183354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] role.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.183437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.183717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] role.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.183891 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.183962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.184201 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.184368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.184440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.184697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.184834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.184962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.185443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.185562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.185628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.185740 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.185820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.185986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.186279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.186392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.186652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.186733 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.186914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.187136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.187225 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.187412 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.187575 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.caching = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.187857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.188035 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.188116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.188342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.188500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.188599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.188851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.188931 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.189109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.189349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.189429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.189611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.189803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.189883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.190109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.190310 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.190394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.190629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.190874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.190953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.191133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.195313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.195454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.195454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.195627 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.195695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.195695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.195815 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.195890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.195890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.195997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196315 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196315 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.196955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197134 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.connection = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.197946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.198013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.198013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.198201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.198495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.198604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.198754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.198834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.199066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.199218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.199441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.199800 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.199899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.200053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.200291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.200382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.200544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.200740 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.200822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.201021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.201205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.201295 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.201504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.201677 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.201759 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.201917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:05:57.202133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.202649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.203126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.203558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.204000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.204447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.204900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.205342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.205806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.206292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.206758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.207236 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.207700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.208187 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.208637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.209090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.209570 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.210007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.210492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.210959 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.211355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.211821 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.212320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.212768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.213227 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.214880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.215625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.215625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.216073 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.216533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.216969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.217429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.217851 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.218345 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.218941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.219418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.226914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.226914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.226914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.226914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.226914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.226914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.226914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.226914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.226914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.227517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.227517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.227517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.227517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.227517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.227517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.227517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.227517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.227894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.228194 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.228617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.229048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.230059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] resource.caching = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.230809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.231009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.231449 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.231919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.232353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.232769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.233230 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.233680 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.234139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.234615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] role.caching = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.235075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] role.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.235511 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.235976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.236592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.237018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.237480 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.237944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.238037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.238206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.238434 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.238533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.238952 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.239394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.239831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.240287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.240739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.241215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.241688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.242491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.242948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.243416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.243880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.244342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.244803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.245287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.245781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.246313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.246713 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.247145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.247581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.248223 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.248360 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.248641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.249143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.249624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.250086 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.250585 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.251036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.251491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] token.caching = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.251895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.252359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.252814 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.253299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.253746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.254175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.259863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.259863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.259863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.259863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.259863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.259863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.259863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.259863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.259863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.260750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.260750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.260750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.connection = **** {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.260750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.260750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.261330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.261479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.262170 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.262641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.263075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.263536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.264006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.264453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.264933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.265369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.265843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.266325 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.266789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.267225 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.267676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.268120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:57.268436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:05:57.283694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.283911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.320139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.320448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.320833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.338078 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.372205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.372477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.380053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.434353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.476216 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.476482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.497430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.497817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.606383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.606641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.606766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.606965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.607186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.607407 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.637114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.637368 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.637560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.637806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.638028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.638269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.638486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.644882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.645441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.645762 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.646062 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.646389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.646682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.651177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.684762 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.685144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.685438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.685807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.686142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.686448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.686693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.701819 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.724071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.724470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.724846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.725221 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.725616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.726001 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.726413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.753986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.754351 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.754680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.755001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.755317 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.755630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.755950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:05:57.758885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.759080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 20:05:57.759442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.759640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 20:05:57.760036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.760467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.761512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.762562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.772734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.773020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.773150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.773346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 20:05:57.773521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.773782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.773936 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.774132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 20:05:57.779208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.779208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.779208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.779208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.782278 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.785385 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.785676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.785966 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.786279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.786567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.786893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.787100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.787379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.787648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.787920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.788185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.792135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.792565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.792984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.793489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.807135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.811222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.811513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.811813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.812107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.812403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.812676 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.812955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.813237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.813520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.813870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.814329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.815743 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.817481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.817881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.822970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.823626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.824371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.831808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.832243 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.836541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.836960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.837353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.837798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.838172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.839984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.841591 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.841884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.842487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.842908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.843289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.848584 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.849279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.849685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.857880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.858253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.862487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.862820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.862981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.865177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.865177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.865177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.865177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.865177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.865177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.866190 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.867422 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.871465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.871843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.876323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.879657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.882348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.882731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.883112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.883535 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.883932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.884334 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.884730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.885275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.886892 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.890211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.890675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.895358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.898591 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.902538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.905258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.905258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.905258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.905258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.905258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.905907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.905907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.905907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.905907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.912986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.914847 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.916560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.916999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.920812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.921119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.921293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.921458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.921598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.921750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.922018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.922437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.922949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.928779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.931949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.933579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.933865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.936105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.936416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.936594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.936732 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.936892 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.937012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.937183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.937304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.937488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.937758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.937758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.938013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.949708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.953381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.953381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.953381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.953381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.953381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.953381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.954145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.957026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.959809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.961251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.962773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.963051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.963333 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.968122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.971228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.971670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.973282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.974139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.975628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.976442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.976787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.977131 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.977280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.977410 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.977552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.977695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.985143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.986708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.987353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.987728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.988088 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.989618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.989915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.990217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.999227 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.999420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:57.999420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.999420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.999420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.999420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.999420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:57.999420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.000192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.000192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.000192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.000534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:58.000649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.000778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.000903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.001028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.001144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.001144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.006185 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:05:58.006512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.006806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.007089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.007371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.007667 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.007985 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.008343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.008663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.008940 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.009231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.009502 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.009782 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.010057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:05:58.038253 dv-cinder-852009-5-smb devstack@keystone.service[81955]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562859c919c0 pid: 81955 (default app) Aug 29 20:05:58.043299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27834f12-cd71-46a0-ab1a-a712e2bd71f3 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:58.044248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27834f12-cd71-46a0-ab1a-a712e2bd71f3 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:58.044248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27834f12-cd71-46a0-ab1a-a712e2bd71f3 None None] PATH_INFO: `/v3` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:58.045383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562859c919c0 pid: 81954 (default app) Aug 29 20:05:58.048516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 791 bytes} [Mon Aug 29 20:05:58 2022] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:06.597179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3d9c1-e0e8-4f75-a0cc-eb9e41fcd3d2 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:06.597730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3d9c1-e0e8-4f75-a0cc-eb9e41fcd3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:06.597730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3d9c1-e0e8-4f75-a0cc-eb9e41fcd3d2 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:06.602367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1/2] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:06.609508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2c941-f757-4269-8d3d-a256991d3d37 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:06.610105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2c941-f757-4269-8d3d-a256991d3d37 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:06.610480 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2c941-f757-4269-8d3d-a256991d3d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:06.708484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: INFO dbcounter [None req-d4b2c941-f757-4269-8d3d-a256991d3d37 None None] Registered counter for database keystone Aug 29 20:06:06.732629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG oslo_db.sqlalchemy.engines [None req-d4b2c941-f757-4269-8d3d-a256991d3d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:06:06.739476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writer thread running {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:06:06.971496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG passlib.handlers.bcrypt [None req-d4b2c941-f757-4269-8d3d-a256991d3d37 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81955) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 20:06:06.971888 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG passlib.handlers.bcrypt [None req-d4b2c941-f757-4269-8d3d-a256991d3d37 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81955) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 20:06:07.035895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d4b2c941-f757-4269-8d3d-a256991d3d37 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:07.037528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d4b2c941-f757-4269-8d3d-a256991d3d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:07.189790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 2/3] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 582 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 20:06:07.705768 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3d9c1-e0e8-4f75-a0cc-eb9e41fcd3d2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:07.781294 dv-cinder-852009-5-smb devstack@keystone.service[81954]: INFO dbcounter [None req-5bf3d9c1-e0e8-4f75-a0cc-eb9e41fcd3d2 None None] Registered counter for database keystone Aug 29 20:06:07.803756 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG oslo_db.sqlalchemy.engines [None req-5bf3d9c1-e0e8-4f75-a0cc-eb9e41fcd3d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:06:07.811638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writer thread running {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:06:07.953502 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3d9c1-e0e8-4f75-a0cc-eb9e41fcd3d2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:07.958442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ce400-66a2-47aa-bea4-436b0d1335a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:07.959022 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce400-66a2-47aa-bea4-436b0d1335a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:07.959298 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce400-66a2-47aa-bea4-436b0d1335a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:07.959564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce400-66a2-47aa-bea4-436b0d1335a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:07.969587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ce400-66a2-47aa-bea4-436b0d1335a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:08.023956 dv-cinder-852009-5-smb devstack@keystone.service[81954]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8e1ce400-66a2-47aa-bea4-436b0d1335a9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 20:06:08.024383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ce400-66a2-47aa-bea4-436b0d1335a9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:08.036428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 2/4] 10.222.0.81 () {58 vars in 1324 bytes} [Mon Aug 29 20:06:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 20:06:08.043876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2c941-f757-4269-8d3d-a256991d3d37 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:08.059990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2c941-f757-4269-8d3d-a256991d3d37 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:08.064892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1ba7f-7bbe-45f5-8192-c3068c74d7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:08.066076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ba7f-7bbe-45f5-8192-c3068c74d7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:08.066412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ba7f-7bbe-45f5-8192-c3068c74d7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:08.066690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ba7f-7bbe-45f5-8192-c3068c74d7d1 admin admin] PATH_INFO: `/v3/projects/9f67ec719bc34531ae1e710c78054427` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:08.068447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1ba7f-7bbe-45f5-8192-c3068c74d7d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=9f67ec719bc34531ae1e710c78054427)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:08.123969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: WARNING keystone.common.rbac_enforcer.enforcer [None req-42e1ba7f-7bbe-45f5-8192-c3068c74d7d1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 20:06:08.124314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1ba7f-7bbe-45f5-8192-c3068c74d7d1 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:08.129334 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 3/5] 10.222.0.81 () {56 vars in 1207 bytes} [Mon Aug 29 20:06:08 2022] GET /identity/v3/projects/9f67ec719bc34531ae1e710c78054427 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:10.164037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66346-6443-448f-a048-af51764323da None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:10.164601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66346-6443-448f-a048-af51764323da None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:10.164601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66346-6443-448f-a048-af51764323da None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:10.170175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 3/6] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:10.176356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66415da6-9672-4bad-bb9b-18c101512798 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:10.176911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66415da6-9672-4bad-bb9b-18c101512798 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:10.176911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66415da6-9672-4bad-bb9b-18c101512798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:10.200694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-66415da6-9672-4bad-bb9b-18c101512798 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:10.202486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-66415da6-9672-4bad-bb9b-18c101512798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:10.211057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 4/7] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 20:06:10.579955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f66346-6443-448f-a048-af51764323da None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:10.594091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f66346-6443-448f-a048-af51764323da None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:10.599059 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d65a99-3f65-44bf-a9fc-f6e320827e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:10.599748 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d65a99-3f65-44bf-a9fc-f6e320827e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:10.600073 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d65a99-3f65-44bf-a9fc-f6e320827e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:10.600386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d65a99-3f65-44bf-a9fc-f6e320827e64 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:10.610596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d65a99-3f65-44bf-a9fc-f6e320827e64 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:10.612454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d65a99-3f65-44bf-a9fc-f6e320827e64 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:10.624339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 4/8] 10.222.0.81 () {58 vars in 1324 bytes} [Mon Aug 29 20:06:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:06:10.630871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66415da6-9672-4bad-bb9b-18c101512798 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:10.641406 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66415da6-9672-4bad-bb9b-18c101512798 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:10.646898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c383b74-f380-42a4-8f5a-6b8068716375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:10.647625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c383b74-f380-42a4-8f5a-6b8068716375 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:10.647949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c383b74-f380-42a4-8f5a-6b8068716375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:10.648267 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c383b74-f380-42a4-8f5a-6b8068716375 admin admin] PATH_INFO: `/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:10.649840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c383b74-f380-42a4-8f5a-6b8068716375 admin admin] RBAC: Authorizing `identity:get_user(user_id=5f7e3f63661a405ba93a9ec8bf8d6603)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:10.652610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c383b74-f380-42a4-8f5a-6b8068716375 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:10.654741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 5/9] 10.222.0.81 () {56 vars in 1198 bytes} [Mon Aug 29 20:06:10 2022] GET /identity/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:12.837714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded3687-5fdc-476f-9a67-05766352af3c None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:12.838271 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded3687-5fdc-476f-9a67-05766352af3c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:12.838271 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded3687-5fdc-476f-9a67-05766352af3c None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:12.840315 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 5/10] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:12.846253 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d716d-9654-4bb1-b171-15205f2ef9fd None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:12.846801 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d716d-9654-4bb1-b171-15205f2ef9fd None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:12.846951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d716d-9654-4bb1-b171-15205f2ef9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:12.866876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-098d716d-9654-4bb1-b171-15205f2ef9fd None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:12.868087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-098d716d-9654-4bb1-b171-15205f2ef9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:12.905911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a888641-4b0b-4761-aa39-7a465e485edb None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:12.906198 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a888641-4b0b-4761-aa39-7a465e485edb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:12.906885 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a888641-4b0b-4761-aa39-7a465e485edb None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:12.908278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 6/11] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:12.914381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198dc11-b9c2-44c9-9e75-1ff97624f097 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:12.914644 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198dc11-b9c2-44c9-9e75-1ff97624f097 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:12.914926 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198dc11-b9c2-44c9-9e75-1ff97624f097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:12.962243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG passlib.handlers.bcrypt [None req-9198dc11-b9c2-44c9-9e75-1ff97624f097 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81954) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 20:06:12.962649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG passlib.handlers.bcrypt [None req-9198dc11-b9c2-44c9-9e75-1ff97624f097 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81954) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 20:06:12.965996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 6/12] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:13.019222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9198dc11-b9c2-44c9-9e75-1ff97624f097 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:13.021139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9198dc11-b9c2-44c9-9e75-1ff97624f097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:13.150674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 7/13] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:13.251727 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d716d-9654-4bb1-b171-15205f2ef9fd None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:13.281328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:13.391050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d716d-9654-4bb1-b171-15205f2ef9fd None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:13.437466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a238a-735d-4650-870f-e098741ed9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:13.438179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a238a-735d-4650-870f-e098741ed9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:13.438565 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a238a-735d-4650-870f-e098741ed9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:13.438910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a238a-735d-4650-870f-e098741ed9c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:13.442437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198dc11-b9c2-44c9-9e75-1ff97624f097 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:13.455683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a238a-735d-4650-870f-e098741ed9c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-b00a238a-735d-4650-870f-e098741ed9c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:13.471621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:13.472789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:13.474006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 7/14] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:06:13.481257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a238a-735d-4650-870f-e098741ed9c4 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:13.587336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198dc11-b9c2-44c9-9e75-1ff97624f097 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:13.591371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:13.604391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:13.633168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd36ba-f563-478e-90d1-db690aa38966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:13.634133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd36ba-f563-478e-90d1-db690aa38966 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:13.634443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd36ba-f563-478e-90d1-db690aa38966 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:13.634715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd36ba-f563-478e-90d1-db690aa38966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:13.638548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a238a-735d-4650-870f-e098741ed9c4 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:13.703509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700e024-9d58-4fe6-a598-62fca4005b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:13.704452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700e024-9d58-4fe6-a598-62fca4005b0d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:13.705008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700e024-9d58-4fe6-a598-62fca4005b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:13.705495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700e024-9d58-4fe6-a598-62fca4005b0d None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:13.706813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700e024-9d58-4fe6-a598-62fca4005b0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:13.707316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700e024-9d58-4fe6-a598-62fca4005b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:13.709877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700e024-9d58-4fe6-a598-62fca4005b0d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:13.719306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd36ba-f563-478e-90d1-db690aa38966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:13.722028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd36ba-f563-478e-90d1-db690aa38966 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:13.731899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 8/15] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:13.738712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700e024-9d58-4fe6-a598-62fca4005b0d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:13.874707 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 8/16] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:06:13.883505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd36ba-f563-478e-90d1-db690aa38966 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:13.888097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:13.890648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700e024-9d58-4fe6-a598-62fca4005b0d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:13.933035 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b8f3d-a1f6-47ce-89c2-8dae5bc18037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:13.934445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b8f3d-a1f6-47ce-89c2-8dae5bc18037 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:13.934868 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b8f3d-a1f6-47ce-89c2-8dae5bc18037 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:13.935202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b8f3d-a1f6-47ce-89c2-8dae5bc18037 None admin] PATH_INFO: `/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:13.936471 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b8f3d-a1f6-47ce-89c2-8dae5bc18037 None admin] RBAC: Authorizing `identity:get_user(user_id=5f7e3f63661a405ba93a9ec8bf8d6603)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:13.937991 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b8f3d-a1f6-47ce-89c2-8dae5bc18037 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:13.939774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 9/17] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:13 2022] GET /identity/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603 => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:13.945903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b8f3d-a1f6-47ce-89c2-8dae5bc18037 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:13.963701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:14.042097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd36ba-f563-478e-90d1-db690aa38966 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:14.078048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b8f3d-a1f6-47ce-89c2-8dae5bc18037 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:14.106045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf7fc9-5203-4fc9-b921-73172c3ab75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:14.107203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf7fc9-5203-4fc9-b921-73172c3ab75c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:14.107625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf7fc9-5203-4fc9-b921-73172c3ab75c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:14.108055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf7fc9-5203-4fc9-b921-73172c3ab75c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:14.121096 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8beb7-7e1a-4b7c-bb67-fd7fdd9b4bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:14.121831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8beb7-7e1a-4b7c-bb67-fd7fdd9b4bce None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:14.122171 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8beb7-7e1a-4b7c-bb67-fd7fdd9b4bce None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:14.122548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8beb7-7e1a-4b7c-bb67-fd7fdd9b4bce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:14.124012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8beb7-7e1a-4b7c-bb67-fd7fdd9b4bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:14.125604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8beb7-7e1a-4b7c-bb67-fd7fdd9b4bce None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:14.127439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 10/18] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:14.134175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8beb7-7e1a-4b7c-bb67-fd7fdd9b4bce None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:14.143451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf7fc9-5203-4fc9-b921-73172c3ab75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:14.146671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf7fc9-5203-4fc9-b921-73172c3ab75c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-a0cf7fc9-5203-4fc9-b921-73172c3ab75c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:06:14.182461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:14.183477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:06:14.184504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:06:14.184504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:06:14.184504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:06:14.185018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 9/19] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:06:14.191474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf7fc9-5203-4fc9-b921-73172c3ab75c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:14.267051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:14.287879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:14.291960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8beb7-7e1a-4b7c-bb67-fd7fdd9b4bce None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:14.336239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0fe88-38d9-45e3-ac9a-7a1dc062d833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:14.337188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0fe88-38d9-45e3-ac9a-7a1dc062d833 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:14.337590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0fe88-38d9-45e3-ac9a-7a1dc062d833 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:14.338038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0fe88-38d9-45e3-ac9a-7a1dc062d833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:14.339828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0fe88-38d9-45e3-ac9a-7a1dc062d833 None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.domain.id=default, user.id=5f7e3f63661a405ba93a9ec8bf8d6603) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:14.340360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0fe88-38d9-45e3-ac9a-7a1dc062d833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:14.342788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0fe88-38d9-45e3-ac9a-7a1dc062d833 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:14.352767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 11/20] 10.222.0.81 () {56 vars in 1322 bytes} [Mon Aug 29 20:06:14 2022] GET /identity/v3/role_assignments?user.id=5f7e3f63661a405ba93a9ec8bf8d6603&scope.domain.id=default&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 233 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:14.362747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf7fc9-5203-4fc9-b921-73172c3ab75c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:14.406571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd06bb3-d36c-49b2-b6e2-948f561cceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:14.407209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd06bb3-d36c-49b2-b6e2-948f561cceaf None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:14.407486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd06bb3-d36c-49b2-b6e2-948f561cceaf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:14.407756 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd06bb3-d36c-49b2-b6e2-948f561cceaf None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:14.408424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd06bb3-d36c-49b2-b6e2-948f561cceaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:14.408729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd06bb3-d36c-49b2-b6e2-948f561cceaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:14.410207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd06bb3-d36c-49b2-b6e2-948f561cceaf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:14.431269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 10/21] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:17.423902 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2047e-14a0-4218-b2b2-e438203c2ff3 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:17.424719 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2047e-14a0-4218-b2b2-e438203c2ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:17.424851 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2047e-14a0-4218-b2b2-e438203c2ff3 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:17.427468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 12/22] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:17.436164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003c94c-8313-411c-9299-79f9d0066c2b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:17.436970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003c94c-8313-411c-9299-79f9d0066c2b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:17.437121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003c94c-8313-411c-9299-79f9d0066c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:17.478610 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a003c94c-8313-411c-9299-79f9d0066c2b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:17.480813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a003c94c-8313-411c-9299-79f9d0066c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:17.522816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb700074-2629-4152-a5cc-c91c90e7c6b7 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:17.523265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb700074-2629-4152-a5cc-c91c90e7c6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:17.523746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb700074-2629-4152-a5cc-c91c90e7c6b7 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:17.526314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 13/23] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:17.536635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a57c9-e8b0-46a0-997e-9124b969d4b0 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:17.537750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a57c9-e8b0-46a0-997e-9124b969d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:17.538836 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a57c9-e8b0-46a0-997e-9124b969d4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:17.592778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-237a57c9-e8b0-46a0-997e-9124b969d4b0 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:17.603506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-237a57c9-e8b0-46a0-997e-9124b969d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:17.639906 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 11/24] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:17.790308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 14/25] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:18.302826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003c94c-8313-411c-9299-79f9d0066c2b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:18.376424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:18.440907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a57c9-e8b0-46a0-997e-9124b969d4b0 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:18.518968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003c94c-8313-411c-9299-79f9d0066c2b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:18.628230 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dd899-207e-49be-a62c-a5c7c65a6890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:18.629247 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dd899-207e-49be-a62c-a5c7c65a6890 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:18.629733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dd899-207e-49be-a62c-a5c7c65a6890 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:18.630210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dd899-207e-49be-a62c-a5c7c65a6890 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:18.631490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072dd899-207e-49be-a62c-a5c7c65a6890 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:18.634150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072dd899-207e-49be-a62c-a5c7c65a6890 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:18.696064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:18.731706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a57c9-e8b0-46a0-997e-9124b969d4b0 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:18.775932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5aa2a-4ebd-46b4-876a-b8407fbf7efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:18.777166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5aa2a-4ebd-46b4-876a-b8407fbf7efd None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:18.777446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5aa2a-4ebd-46b4-876a-b8407fbf7efd None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:18.777876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5aa2a-4ebd-46b4-876a-b8407fbf7efd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:18.797794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5aa2a-4ebd-46b4-876a-b8407fbf7efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-6ef5aa2a-4ebd-46b4-876a-b8407fbf7efd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:18.803510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:18.805323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 15/26] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:18.806908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1160c16-a177-4c7e-b4ad-d9deea0e38fb None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:18.808760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1160c16-a177-4c7e-b4ad-d9deea0e38fb None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:18.808760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1160c16-a177-4c7e-b4ad-d9deea0e38fb None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:18.810101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 16/27] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:18.811602 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3356ad-2ef4-4303-a5b8-a447817e15b4 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:18.812591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3356ad-2ef4-4303-a5b8-a447817e15b4 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:18.813065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3356ad-2ef4-4303-a5b8-a447817e15b4 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:18.814742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 17/28] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:18.820730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dd9e9-6b2a-4986-b66e-dabcb2cde268 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:18.821447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dd9e9-6b2a-4986-b66e-dabcb2cde268 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:18.821864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dd9e9-6b2a-4986-b66e-dabcb2cde268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:18.845039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-5e9dd9e9-6b2a-4986-b66e-dabcb2cde268 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:18.846569 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5e9dd9e9-6b2a-4986-b66e-dabcb2cde268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:18.951639 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 12/29] 10.222.0.81 () {60 vars in 1131 bytes} [Mon Aug 29 20:06:18 2022] POST /identity/v3/roles => generated 219 bytes in 650 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:18.953542 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061844-41f4-423b-985a-69b36231a35b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:18.953994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061844-41f4-423b-985a-69b36231a35b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:18.954469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061844-41f4-423b-985a-69b36231a35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:18.977815 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-50061844-41f4-423b-985a-69b36231a35b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:18.979822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-50061844-41f4-423b-985a-69b36231a35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:19.019916 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 18/30] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:19.023198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dd9e9-6b2a-4986-b66e-dabcb2cde268 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:19.133253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 13/31] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:19.187192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:19.252516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dd9e9-6b2a-4986-b66e-dabcb2cde268 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:19.310092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48bc01-2559-42ff-a9ff-1606a8d29a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:19.311073 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48bc01-2559-42ff-a9ff-1606a8d29a6f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:19.311571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48bc01-2559-42ff-a9ff-1606a8d29a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:19.312034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48bc01-2559-42ff-a9ff-1606a8d29a6f None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:19.312882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48bc01-2559-42ff-a9ff-1606a8d29a6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:19.313412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48bc01-2559-42ff-a9ff-1606a8d29a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:19.315112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48bc01-2559-42ff-a9ff-1606a8d29a6f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:19.326038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 19/32] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:19.332089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50061844-41f4-423b-985a-69b36231a35b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:19.374776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:19.461554 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50061844-41f4-423b-985a-69b36231a35b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:19.510294 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9114d-ebff-4eaf-be20-3700ef045982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:19.510873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9114d-ebff-4eaf-be20-3700ef045982 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:19.511237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9114d-ebff-4eaf-be20-3700ef045982 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:19.511725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9114d-ebff-4eaf-be20-3700ef045982 None admin] PATH_INFO: `/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:19.513614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9114d-ebff-4eaf-be20-3700ef045982 None admin] RBAC: Authorizing `identity:get_user(user_id=5f7e3f63661a405ba93a9ec8bf8d6603)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:19.515499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9114d-ebff-4eaf-be20-3700ef045982 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:19.517383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 14/33] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:19 2022] GET /identity/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:19.523951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48bc01-2559-42ff-a9ff-1606a8d29a6f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:19.581833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d24c-370e-488e-b812-19e4ff33aa0b None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:19.582409 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d24c-370e-488e-b812-19e4ff33aa0b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:19.582480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d24c-370e-488e-b812-19e4ff33aa0b None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:19.584059 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 15/34] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:19.590622 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abb4dc-27a8-47d4-bfe5-29c7d405ed4a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:19.591067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abb4dc-27a8-47d4-bfe5-29c7d405ed4a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:19.591351 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abb4dc-27a8-47d4-bfe5-29c7d405ed4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:19.623586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f0abb4dc-27a8-47d4-bfe5-29c7d405ed4a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:19.625969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f0abb4dc-27a8-47d4-bfe5-29c7d405ed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:19.714771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48bc01-2559-42ff-a9ff-1606a8d29a6f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:19.766369 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 16/35] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:19.767513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abb4dc-27a8-47d4-bfe5-29c7d405ed4a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:19.774904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:19.793498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db874d-77f5-4bd9-88af-da39b89ad9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:19.795921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db874d-77f5-4bd9-88af-da39b89ad9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:19.796672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db874d-77f5-4bd9-88af-da39b89ad9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:19.797385 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db874d-77f5-4bd9-88af-da39b89ad9a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:19.801184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db874d-77f5-4bd9-88af-da39b89ad9a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:19.804672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db874d-77f5-4bd9-88af-da39b89ad9a6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:19.809803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 20/36] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:19.811682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db874d-77f5-4bd9-88af-da39b89ad9a6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:19.855636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:20.003561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abb4dc-27a8-47d4-bfe5-29c7d405ed4a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:20.016507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db874d-77f5-4bd9-88af-da39b89ad9a6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:20.062099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bbea5-29f9-4a6f-90e0-9f82c464181f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:20.062766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bbea5-29f9-4a6f-90e0-9f82c464181f None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:20.063053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bbea5-29f9-4a6f-90e0-9f82c464181f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:20.063327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bbea5-29f9-4a6f-90e0-9f82c464181f None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:20.064033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bbea5-29f9-4a6f-90e0-9f82c464181f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:20.065452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bbea5-29f9-4a6f-90e0-9f82c464181f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:20.078082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19272b-1ae2-4048-ab6b-068097f8f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:20.079187 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19272b-1ae2-4048-ab6b-068097f8f395 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:20.079692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19272b-1ae2-4048-ab6b-068097f8f395 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:20.080259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19272b-1ae2-4048-ab6b-068097f8f395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:20.100960 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19272b-1ae2-4048-ab6b-068097f8f395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:20.103881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19272b-1ae2-4048-ab6b-068097f8f395 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-7d19272b-1ae2-4048-ab6b-068097f8f395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:06:20.135165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:20.136807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:06:20.137791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:06:20.137791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:06:20.137791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:06:20.138454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 17/37] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:20.139994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19272b-1ae2-4048-ab6b-068097f8f395 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:20.247454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:20.265927 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19272b-1ae2-4048-ab6b-068097f8f395 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:20.306461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5bc5f-2eb6-4764-b1ea-fc6259dc68c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:20.307261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5bc5f-2eb6-4764-b1ea-fc6259dc68c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:20.307545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5bc5f-2eb6-4764-b1ea-fc6259dc68c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:20.308342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5bc5f-2eb6-4764-b1ea-fc6259dc68c7 None admin] PATH_INFO: `/v3/domains/default/users/5f7e3f63661a405ba93a9ec8bf8d6603/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:20.310572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5bc5f-2eb6-4764-b1ea-fc6259dc68c7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5f7e3f63661a405ba93a9ec8bf8d6603, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:20.312063 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5bc5f-2eb6-4764-b1ea-fc6259dc68c7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:20.377087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 21/38] 10.222.0.81 () {60 vars in 1131 bytes} [Mon Aug 29 20:06:19 2022] POST /identity/v3/roles => generated 225 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:20.379790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea89e2d-c352-4b0c-b918-9ac32d2e0a7c None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:20.380323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea89e2d-c352-4b0c-b918-9ac32d2e0a7c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:20.380793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea89e2d-c352-4b0c-b918-9ac32d2e0a7c None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:20.383495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 22/39] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:20.385080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea89e2d-c352-4b0c-b918-9ac32d2e0a7c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:20.420032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 18/40] 10.222.0.81 () {58 vars in 1361 bytes} [Mon Aug 29 20:06:20 2022] PUT /identity/v3/domains/default/users/5f7e3f63661a405ba93a9ec8bf8d6603/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:06:20.421282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5bc5f-2eb6-4764-b1ea-fc6259dc68c7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:20.518314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:20.585807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea89e2d-c352-4b0c-b918-9ac32d2e0a7c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:20.625795 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5bc5f-2eb6-4764-b1ea-fc6259dc68c7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:20.638425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453b131-7fc1-4dd6-8adc-87f95454c192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:20.639457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453b131-7fc1-4dd6-8adc-87f95454c192 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:20.639920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453b131-7fc1-4dd6-8adc-87f95454c192 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:20.640394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453b131-7fc1-4dd6-8adc-87f95454c192 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:20.641338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453b131-7fc1-4dd6-8adc-87f95454c192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:20.641831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453b131-7fc1-4dd6-8adc-87f95454c192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:20.643663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453b131-7fc1-4dd6-8adc-87f95454c192 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:20.665138 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 23/41] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:20.667118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692b9a3-a3c3-4cab-8d79-7391493b1f71 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:20.668465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692b9a3-a3c3-4cab-8d79-7391493b1f71 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:20.668993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692b9a3-a3c3-4cab-8d79-7391493b1f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:20.674907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaf16e-8e51-4ff9-9e89-47b6775f9e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:20.675261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaf16e-8e51-4ff9-9e89-47b6775f9e56 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:20.675623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaf16e-8e51-4ff9-9e89-47b6775f9e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:20.675975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaf16e-8e51-4ff9-9e89-47b6775f9e56 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:20.676768 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eaf16e-8e51-4ff9-9e89-47b6775f9e56 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:20.678256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eaf16e-8e51-4ff9-9e89-47b6775f9e56 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:20.696057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-5692b9a3-a3c3-4cab-8d79-7391493b1f71 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:20.704884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5692b9a3-a3c3-4cab-8d79-7391493b1f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:20.769812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 19/42] 10.222.0.81 () {60 vars in 1131 bytes} [Mon Aug 29 20:06:20 2022] POST /identity/v3/roles => generated 223 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:20.771614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaf16e-8e51-4ff9-9e89-47b6775f9e56 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:20.789402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:20.836892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 24/43] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:20.999929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaf16e-8e51-4ff9-9e89-47b6775f9e56 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:21.044170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012f7e3-152d-4311-9af6-bd246c799569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:21.044828 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012f7e3-152d-4311-9af6-bd246c799569 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:21.045112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012f7e3-152d-4311-9af6-bd246c799569 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:21.045391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012f7e3-152d-4311-9af6-bd246c799569 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:21.046086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012f7e3-152d-4311-9af6-bd246c799569 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:21.047667 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012f7e3-152d-4311-9af6-bd246c799569 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:21.139058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 20/44] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:06:20 2022] POST /identity/v3/projects => generated 301 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:21.348835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692b9a3-a3c3-4cab-8d79-7391493b1f71 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:21.588608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:21.693953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692b9a3-a3c3-4cab-8d79-7391493b1f71 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:21.741869 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd1dd-9464-4602-8176-282994782068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:21.742566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd1dd-9464-4602-8176-282994782068 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:21.742846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd1dd-9464-4602-8176-282994782068 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:21.743118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd1dd-9464-4602-8176-282994782068 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:21.744357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd1dd-9464-4602-8176-282994782068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:21.746651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd1dd-9464-4602-8176-282994782068 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:21.748469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 25/45] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:21.757679 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012f7e3-152d-4311-9af6-bd246c799569 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:21.855628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:21.910761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012f7e3-152d-4311-9af6-bd246c799569 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:21.956830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05603c2-3ee8-48bb-8b56-e22e8468d777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:21.957790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05603c2-3ee8-48bb-8b56-e22e8468d777 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:21.957960 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05603c2-3ee8-48bb-8b56-e22e8468d777 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:21.958452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05603c2-3ee8-48bb-8b56-e22e8468d777 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:21.959270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05603c2-3ee8-48bb-8b56-e22e8468d777 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:21.960948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05603c2-3ee8-48bb-8b56-e22e8468d777 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:22.087573 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 21/46] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:06:21 2022] POST /identity/v3/projects => generated 312 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:22.851111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae874dbc-244d-43b0-9364-b31956e6302e None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:22.851929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae874dbc-244d-43b0-9364-b31956e6302e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:22.851929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae874dbc-244d-43b0-9364-b31956e6302e None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:22.853081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 26/47] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:22.861759 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72488a78-3803-42cd-9244-1f0de9b18e70 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:22.862352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72488a78-3803-42cd-9244-1f0de9b18e70 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:22.862863 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72488a78-3803-42cd-9244-1f0de9b18e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:22.892850 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-72488a78-3803-42cd-9244-1f0de9b18e70 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:22.894098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-72488a78-3803-42cd-9244-1f0de9b18e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:22.974758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 22/48] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:23.256780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae874dbc-244d-43b0-9364-b31956e6302e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:23.445055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae874dbc-244d-43b0-9364-b31956e6302e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:23.472574 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:23.512360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eb223-4ff9-4d2f-a4e8-7fe11f9cefb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:23.513415 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eb223-4ff9-4d2f-a4e8-7fe11f9cefb8 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:23.514209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eb223-4ff9-4d2f-a4e8-7fe11f9cefb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:23.514754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eb223-4ff9-4d2f-a4e8-7fe11f9cefb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:23.536061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613eb223-4ff9-4d2f-a4e8-7fe11f9cefb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-613eb223-4ff9-4d2f-a4e8-7fe11f9cefb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:23.541983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:23.545027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:23.546508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 27/49] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:23.552663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72488a78-3803-42cd-9244-1f0de9b18e70 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:23.607272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:23.684124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72488a78-3803-42cd-9244-1f0de9b18e70 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:23.735370 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03d301-5200-4159-8a60-28b16a6a06d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:23.736455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03d301-5200-4159-8a60-28b16a6a06d7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:23.736935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03d301-5200-4159-8a60-28b16a6a06d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:23.737423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03d301-5200-4159-8a60-28b16a6a06d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:23.738813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03d301-5200-4159-8a60-28b16a6a06d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:23.739373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03d301-5200-4159-8a60-28b16a6a06d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:23.742007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03d301-5200-4159-8a60-28b16a6a06d7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:23.767893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 23/50] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:23.777336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eb223-4ff9-4d2f-a4e8-7fe11f9cefb8 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:23.905238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eb223-4ff9-4d2f-a4e8-7fe11f9cefb8 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:23.949080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae68224-e439-49c7-a2f4-8909ef3aa028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:23.949820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae68224-e439-49c7-a2f4-8909ef3aa028 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:23.950180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae68224-e439-49c7-a2f4-8909ef3aa028 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:23.950647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae68224-e439-49c7-a2f4-8909ef3aa028 None admin] PATH_INFO: `/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:23.952080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae68224-e439-49c7-a2f4-8909ef3aa028 None admin] RBAC: Authorizing `identity:get_user(user_id=5f7e3f63661a405ba93a9ec8bf8d6603)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:23.953664 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae68224-e439-49c7-a2f4-8909ef3aa028 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:23.955484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 28/51] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:23 2022] GET /identity/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:23.964170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03d301-5200-4159-8a60-28b16a6a06d7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:24.113791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03d301-5200-4159-8a60-28b16a6a06d7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:24.115717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:24.153853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adac32-00dc-4b74-9e8b-98717bc0e9e5 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:24.154408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adac32-00dc-4b74-9e8b-98717bc0e9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:24.154896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adac32-00dc-4b74-9e8b-98717bc0e9e5 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:24.157247 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d230069-b2b3-4da3-b89c-d33afdeb7950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:24.157710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 29/52] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:24.158201 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d230069-b2b3-4da3-b89c-d33afdeb7950 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:24.158551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d230069-b2b3-4da3-b89c-d33afdeb7950 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:24.158894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d230069-b2b3-4da3-b89c-d33afdeb7950 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:24.160188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d230069-b2b3-4da3-b89c-d33afdeb7950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:24.161688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d230069-b2b3-4da3-b89c-d33afdeb7950 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:24.163292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b4716-c03d-466a-a9a3-20d7f38fbd53 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:24.163555 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 24/53] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:24.163706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b4716-c03d-466a-a9a3-20d7f38fbd53 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:24.163869 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b4716-c03d-466a-a9a3-20d7f38fbd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:24.170656 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d230069-b2b3-4da3-b89c-d33afdeb7950 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:24.184932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-0c9b4716-c03d-466a-a9a3-20d7f38fbd53 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:24.186342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-0c9b4716-c03d-466a-a9a3-20d7f38fbd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:24.234650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:24.275889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 30/54] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:24.310188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d230069-b2b3-4da3-b89c-d33afdeb7950 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:24.363419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cdd50-f2ec-4828-b3ed-864a822b7c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:24.364188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cdd50-f2ec-4828-b3ed-864a822b7c0d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:24.364520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cdd50-f2ec-4828-b3ed-864a822b7c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:24.364853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cdd50-f2ec-4828-b3ed-864a822b7c0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:24.365674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cdd50-f2ec-4828-b3ed-864a822b7c0d None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.domain.id=default, user.id=5f7e3f63661a405ba93a9ec8bf8d6603) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:24.366038 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cdd50-f2ec-4828-b3ed-864a822b7c0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:24.367685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cdd50-f2ec-4828-b3ed-864a822b7c0d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:24.377630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 25/55] 10.222.0.81 () {56 vars in 1322 bytes} [Mon Aug 29 20:06:24 2022] GET /identity/v3/role_assignments?user.id=5f7e3f63661a405ba93a9ec8bf8d6603&scope.domain.id=default&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 530 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:24.559726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b4716-c03d-466a-a9a3-20d7f38fbd53 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:24.683129 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b4716-c03d-466a-a9a3-20d7f38fbd53 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:24.722785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219738b-772f-4ec8-a23f-e9d98123c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:24.723450 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219738b-772f-4ec8-a23f-e9d98123c131 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:24.723733 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219738b-772f-4ec8-a23f-e9d98123c131 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:24.724009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219738b-772f-4ec8-a23f-e9d98123c131 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:24.725206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219738b-772f-4ec8-a23f-e9d98123c131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:24.726841 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219738b-772f-4ec8-a23f-e9d98123c131 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:24.728539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 31/56] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:24.734882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cdd50-f2ec-4828-b3ed-864a822b7c0d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:24.775443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:24.854455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cdd50-f2ec-4828-b3ed-864a822b7c0d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:24.896237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc827ed-0a64-47b7-8c90-9032bf5cb4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:24.897120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc827ed-0a64-47b7-8c90-9032bf5cb4f6 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:24.897401 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc827ed-0a64-47b7-8c90-9032bf5cb4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:24.897672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc827ed-0a64-47b7-8c90-9032bf5cb4f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:24.898380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc827ed-0a64-47b7-8c90-9032bf5cb4f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:24.899860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc827ed-0a64-47b7-8c90-9032bf5cb4f6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:25.013041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 26/57] 10.222.0.81 () {60 vars in 1140 bytes} [Mon Aug 29 20:06:24 2022] POST /identity/v3/projects => generated 298 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:06:27.062727 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2791f-cdca-4d1f-9b9c-f2aab2044330 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:27.063321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2791f-cdca-4d1f-9b9c-f2aab2044330 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:27.063321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2791f-cdca-4d1f-9b9c-f2aab2044330 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:27.064839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 32/58] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:27.070921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf32cf6-91cb-4e54-b18b-4f528e2d8ac9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:27.071729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf32cf6-91cb-4e54-b18b-4f528e2d8ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:27.071729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf32cf6-91cb-4e54-b18b-4f528e2d8ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:27.199733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7bf32cf6-91cb-4e54-b18b-4f528e2d8ac9 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:27.201007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7bf32cf6-91cb-4e54-b18b-4f528e2d8ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:27.281353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 27/59] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:27.556937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2791f-cdca-4d1f-9b9c-f2aab2044330 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:27.605056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:27.673395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2791f-cdca-4d1f-9b9c-f2aab2044330 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:27.712965 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbd065-9bc4-4f11-bc72-1b60fd62cb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:27.713678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbd065-9bc4-4f11-bc72-1b60fd62cb4a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:27.714007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbd065-9bc4-4f11-bc72-1b60fd62cb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:27.715085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbd065-9bc4-4f11-bc72-1b60fd62cb4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:27.716234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbd065-9bc4-4f11-bc72-1b60fd62cb4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:27.717759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbd065-9bc4-4f11-bc72-1b60fd62cb4a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:27.719588 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 33/60] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:27.725646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf32cf6-91cb-4e54-b18b-4f528e2d8ac9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:27.745282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:27.842691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf32cf6-91cb-4e54-b18b-4f528e2d8ac9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:27.881957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc73d77-6e90-4cd4-bfc0-79069da17869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:27.882618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73d77-6e90-4cd4-bfc0-79069da17869 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:27.882916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73d77-6e90-4cd4-bfc0-79069da17869 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:27.883187 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73d77-6e90-4cd4-bfc0-79069da17869 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:27.883875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc73d77-6e90-4cd4-bfc0-79069da17869 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:27.885340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc73d77-6e90-4cd4-bfc0-79069da17869 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:28.017752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 28/61] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:06:27 2022] POST /identity/v3/users => generated 275 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:31.731912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425defe7-0e7d-4a70-a865-9fbdc0e90b71 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:31.733455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425defe7-0e7d-4a70-a865-9fbdc0e90b71 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:31.734161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425defe7-0e7d-4a70-a865-9fbdc0e90b71 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:31.736848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 34/62] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:31.743521 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3bd89-b677-4099-856e-ad56054241fc None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:31.744868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3bd89-b677-4099-856e-ad56054241fc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:31.746842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3bd89-b677-4099-856e-ad56054241fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:31.788276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-68f3bd89-b677-4099-856e-ad56054241fc None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:31.790824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-68f3bd89-b677-4099-856e-ad56054241fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:31.904890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 29/63] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:32.051729 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191564a-16a8-47d1-9696-82ade598f0e6 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.052401 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191564a-16a8-47d1-9696-82ade598f0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.052917 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191564a-16a8-47d1-9696-82ade598f0e6 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.054604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 35/64] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:32.073397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3755c-8ba2-4fab-9229-1f4ad25be883 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.074402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3755c-8ba2-4fab-9229-1f4ad25be883 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.074688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3755c-8ba2-4fab-9229-1f4ad25be883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.086556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:32.103558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-45d3755c-8ba2-4fab-9229-1f4ad25be883 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:32.105798 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-45d3755c-8ba2-4fab-9229-1f4ad25be883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:32.211790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 30/65] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:32.278504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e7e5d-c08a-464c-96d1-e2a73ed5895c None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.279485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e7e5d-c08a-464c-96d1-e2a73ed5895c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.280285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e7e5d-c08a-464c-96d1-e2a73ed5895c None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.287506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 36/66] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:32.294064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74d058-adbf-4204-98e9-3cf6067674ef None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.294380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74d058-adbf-4204-98e9-3cf6067674ef None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.294691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74d058-adbf-4204-98e9-3cf6067674ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.325734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-fd74d058-adbf-4204-98e9-3cf6067674ef None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:32.326925 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fd74d058-adbf-4204-98e9-3cf6067674ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:32.359204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446eb97-6f53-4740-913e-17e73fb77785 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.360143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446eb97-6f53-4740-913e-17e73fb77785 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.360942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446eb97-6f53-4740-913e-17e73fb77785 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.363905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 37/67] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:32.371782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac213a7-bc65-4134-a65f-6025b2cb5596 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.372709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac213a7-bc65-4134-a65f-6025b2cb5596 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.373465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac213a7-bc65-4134-a65f-6025b2cb5596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.405544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-4ac213a7-bc65-4134-a65f-6025b2cb5596 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:32.407525 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4ac213a7-bc65-4134-a65f-6025b2cb5596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:32.421331 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 31/68] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:32.422339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74d058-adbf-4204-98e9-3cf6067674ef None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:32.510399 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:32.546389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 38/69] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:32.549212 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15023af-28c2-4a0b-a674-98b732965007 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.550071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15023af-28c2-4a0b-a674-98b732965007 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.550849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15023af-28c2-4a0b-a674-98b732965007 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.553915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 39/70] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:32.565190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9cc73-a464-44b4-9e36-6c3f57c258f1 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.565828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9cc73-a464-44b4-9e36-6c3f57c258f1 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.566343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9cc73-a464-44b4-9e36-6c3f57c258f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.573111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74d058-adbf-4204-98e9-3cf6067674ef None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:32.599822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-14d9cc73-a464-44b4-9e36-6c3f57c258f1 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:32.600992 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-14d9cc73-a464-44b4-9e36-6c3f57c258f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:32.619107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee448f-d3ba-449c-9d1e-7fde1d7e445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:32.620663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee448f-d3ba-449c-9d1e-7fde1d7e445b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.621488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee448f-d3ba-449c-9d1e-7fde1d7e445b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.621951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee448f-d3ba-449c-9d1e-7fde1d7e445b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.640380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee448f-d3ba-449c-9d1e-7fde1d7e445b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-48ee448f-d3ba-449c-9d1e-7fde1d7e445b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:32.649635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:32.650801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:32.651826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:32.651826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:32.651826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:32.651826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:32.651826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:32.651826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:32.651826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:32.651826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:32.651826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:32.651826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:32.651826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:32.651826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:06:32.654607 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:32.655655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 32/71] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:32.657030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee448f-d3ba-449c-9d1e-7fde1d7e445b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:32.706362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 40/72] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:32.707515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9cc73-a464-44b4-9e36-6c3f57c258f1 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:32.797953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee448f-d3ba-449c-9d1e-7fde1d7e445b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:32.827386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:32.831199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9cc73-a464-44b4-9e36-6c3f57c258f1 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:32.841948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72ba41-1e74-4990-9d1c-18f951a317e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:32.842652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72ba41-1e74-4990-9d1c-18f951a317e4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.842938 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72ba41-1e74-4990-9d1c-18f951a317e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.843217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72ba41-1e74-4990-9d1c-18f951a317e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.857568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72ba41-1e74-4990-9d1c-18f951a317e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-5e72ba41-1e74-4990-9d1c-18f951a317e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:32.863258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:32.864168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:32.864920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:32.864920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:32.864920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:32.864920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:32.864920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:32.864920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:32.864920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:32.864920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:32.864920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:32.864920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:32.864920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:32.864920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:06:32.871037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 33/73] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:32.872036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72ba41-1e74-4990-9d1c-18f951a317e4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:32.880003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e8377-7620-4cb9-89dc-4c15e6ef9296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:32.881027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e8377-7620-4cb9-89dc-4c15e6ef9296 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.881516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e8377-7620-4cb9-89dc-4c15e6ef9296 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.881981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e8377-7620-4cb9-89dc-4c15e6ef9296 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.882955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e8377-7620-4cb9-89dc-4c15e6ef9296 None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:32.883472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e8377-7620-4cb9-89dc-4c15e6ef9296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:32.885088 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e8377-7620-4cb9-89dc-4c15e6ef9296 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:32.902608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 41/74] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:32.904824 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e8377-7620-4cb9-89dc-4c15e6ef9296 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:32.965219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:33.002512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72ba41-1e74-4990-9d1c-18f951a317e4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:33.045663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1c8fe-2707-45ad-a6cc-618792a58c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:33.046345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1c8fe-2707-45ad-a6cc-618792a58c32 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:33.046626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1c8fe-2707-45ad-a6cc-618792a58c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:33.046899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1c8fe-2707-45ad-a6cc-618792a58c32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:33.048176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1c8fe-2707-45ad-a6cc-618792a58c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:33.049702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1c8fe-2707-45ad-a6cc-618792a58c32 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:33.051484 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 34/75] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:33.055737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1c8fe-2707-45ad-a6cc-618792a58c32 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:33.070514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e8377-7620-4cb9-89dc-4c15e6ef9296 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:33.117586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e7fe5-4748-48be-8cef-101589258538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:33.118128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e7fe5-4748-48be-8cef-101589258538 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:33.118458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e7fe5-4748-48be-8cef-101589258538 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:33.118781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e7fe5-4748-48be-8cef-101589258538 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:33.119531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e7fe5-4748-48be-8cef-101589258538 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:33.119837 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e7fe5-4748-48be-8cef-101589258538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:33.122257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e7fe5-4748-48be-8cef-101589258538 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:33.123730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:33.131851 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 42/76] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:33.131851 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e7fe5-4748-48be-8cef-101589258538 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:33.182024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1c8fe-2707-45ad-a6cc-618792a58c32 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:33.244033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f31db9-0bd0-4c90-b306-315cf559065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:33.244689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f31db9-0bd0-4c90-b306-315cf559065b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:33.244973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f31db9-0bd0-4c90-b306-315cf559065b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:33.245244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f31db9-0bd0-4c90-b306-315cf559065b None admin] PATH_INFO: `/v3/users/0ffa4f559dec498ab5306648d2a6ecd3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:33.256910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:33.265073 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f31db9-0bd0-4c90-b306-315cf559065b None admin] RBAC: Authorizing `identity:get_user(user_id=0ffa4f559dec498ab5306648d2a6ecd3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:33.275240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f31db9-0bd0-4c90-b306-315cf559065b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:33.275240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 35/77] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:33 2022] GET /identity/v3/users/0ffa4f559dec498ab5306648d2a6ecd3 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:33.275472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e7fe5-4748-48be-8cef-101589258538 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:33.275764 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f31db9-0bd0-4c90-b306-315cf559065b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:33.320579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d788555-45f2-46f1-be94-5043d0e20de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:33.321234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d788555-45f2-46f1-be94-5043d0e20de4 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:33.321541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d788555-45f2-46f1-be94-5043d0e20de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:33.321793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d788555-45f2-46f1-be94-5043d0e20de4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:33.334013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d788555-45f2-46f1-be94-5043d0e20de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-0d788555-45f2-46f1-be94-5043d0e20de4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:33.341053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:33.342022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:33.342813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 43/78] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:06:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:33.343460 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d788555-45f2-46f1-be94-5043d0e20de4 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:33.406648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f31db9-0bd0-4c90-b306-315cf559065b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:33.417550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:33.444841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aed47-ff03-4b01-ba69-43b8e7dcbb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:33.445515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aed47-ff03-4b01-ba69-43b8e7dcbb3d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:33.445792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aed47-ff03-4b01-ba69-43b8e7dcbb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:33.446069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aed47-ff03-4b01-ba69-43b8e7dcbb3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:33.459973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aed47-ff03-4b01-ba69-43b8e7dcbb3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-3d9aed47-ff03-4b01-ba69-43b8e7dcbb3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:33.466177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:33.467387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:06:33.468325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 36/79] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:33.470569 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aed47-ff03-4b01-ba69-43b8e7dcbb3d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:33.501836 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d788555-45f2-46f1-be94-5043d0e20de4 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:33.543838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c2298-524a-4caa-b277-e32b8c2ac8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:33.544493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c2298-524a-4caa-b277-e32b8c2ac8f6 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:33.544752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c2298-524a-4caa-b277-e32b8c2ac8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:33.545157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c2298-524a-4caa-b277-e32b8c2ac8f6 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:33.545900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c2298-524a-4caa-b277-e32b8c2ac8f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:33.547660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c2298-524a-4caa-b277-e32b8c2ac8f6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:33.618928 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aed47-ff03-4b01-ba69-43b8e7dcbb3d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:33.658927 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6bf93-5840-46f7-8a73-7ec19bf73a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:33.659514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6bf93-5840-46f7-8a73-7ec19bf73a63 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:33.659802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6bf93-5840-46f7-8a73-7ec19bf73a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:33.660079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6bf93-5840-46f7-8a73-7ec19bf73a63 None admin] PATH_INFO: `/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:33.661510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6bf93-5840-46f7-8a73-7ec19bf73a63 None admin] RBAC: Authorizing `identity:get_user(user_id=5f7e3f63661a405ba93a9ec8bf8d6603)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:33.663080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6bf93-5840-46f7-8a73-7ec19bf73a63 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:33.664796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 37/80] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:33 2022] GET /identity/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:33.666570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6bf93-5840-46f7-8a73-7ec19bf73a63 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:33.708560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:33.738549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 44/81] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:06:33 2022] POST /identity/v3/users => generated 289 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:33.738549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c2298-524a-4caa-b277-e32b8c2ac8f6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:33.750326 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:33.834132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6bf93-5840-46f7-8a73-7ec19bf73a63 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:33.908362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d15007-b58f-4fbe-b0db-2f04c70b78d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:33.908842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c2298-524a-4caa-b277-e32b8c2ac8f6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:33.909484 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d15007-b58f-4fbe-b0db-2f04c70b78d1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:33.909915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d15007-b58f-4fbe-b0db-2f04c70b78d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:33.910800 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d15007-b58f-4fbe-b0db-2f04c70b78d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:33.973045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c645b-be3d-4f34-a48b-51de9eb3c0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:33.974161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c645b-be3d-4f34-a48b-51de9eb3c0cd None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:33.979579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c645b-be3d-4f34-a48b-51de9eb3c0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:33.979579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c645b-be3d-4f34-a48b-51de9eb3c0cd None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:33.979579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c645b-be3d-4f34-a48b-51de9eb3c0cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:33.979579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c645b-be3d-4f34-a48b-51de9eb3c0cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:33.983056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c645b-be3d-4f34-a48b-51de9eb3c0cd None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:34.001694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 45/82] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:06:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:34.001694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c645b-be3d-4f34-a48b-51de9eb3c0cd None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:34.057470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d15007-b58f-4fbe-b0db-2f04c70b78d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:34.062175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d15007-b58f-4fbe-b0db-2f04c70b78d1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:34.135104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:34.145340 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:34.223835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c645b-be3d-4f34-a48b-51de9eb3c0cd None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:34.272028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f679eb1-3e32-4b56-a7f9-f72ad3b5ec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:34.273071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f679eb1-3e32-4b56-a7f9-f72ad3b5ec6d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:34.273587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f679eb1-3e32-4b56-a7f9-f72ad3b5ec6d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:34.274351 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f679eb1-3e32-4b56-a7f9-f72ad3b5ec6d None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:34.282073 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f679eb1-3e32-4b56-a7f9-f72ad3b5ec6d None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:34.282783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f679eb1-3e32-4b56-a7f9-f72ad3b5ec6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:34.285103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f679eb1-3e32-4b56-a7f9-f72ad3b5ec6d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:34.311793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 46/83] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:34.313234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f679eb1-3e32-4b56-a7f9-f72ad3b5ec6d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:34.348389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 38/84] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:34.353447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d15007-b58f-4fbe-b0db-2f04c70b78d1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:34.498376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f679eb1-3e32-4b56-a7f9-f72ad3b5ec6d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:34.538912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:34.548301 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8012ae-db56-41da-bad0-f104e7bddca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:34.549309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8012ae-db56-41da-bad0-f104e7bddca9 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:34.549799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8012ae-db56-41da-bad0-f104e7bddca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:34.550380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8012ae-db56-41da-bad0-f104e7bddca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:34.626831 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d15007-b58f-4fbe-b0db-2f04c70b78d1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:34.672912 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6b6ac-d96d-453c-802d-c469be07908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:34.673569 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6b6ac-d96d-453c-802d-c469be07908f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:34.673929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6b6ac-d96d-453c-802d-c469be07908f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:34.674207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6b6ac-d96d-453c-802d-c469be07908f None admin] PATH_INFO: `/v3/users/0ffa4f559dec498ab5306648d2a6ecd3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:34.675528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6b6ac-d96d-453c-802d-c469be07908f None admin] RBAC: Authorizing `identity:get_user(user_id=0ffa4f559dec498ab5306648d2a6ecd3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:34.677042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6b6ac-d96d-453c-802d-c469be07908f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:34.679033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 39/85] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:34 2022] GET /identity/v3/users/0ffa4f559dec498ab5306648d2a6ecd3 => generated 275 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:34.679709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6b6ac-d96d-453c-802d-c469be07908f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:34.686833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:34.711974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8012ae-db56-41da-bad0-f104e7bddca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:34.717517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8012ae-db56-41da-bad0-f104e7bddca9 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:34.824767 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6b6ac-d96d-453c-802d-c469be07908f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:34.871215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc1208-6e23-46aa-b11a-8953a09c1355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:34.871892 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc1208-6e23-46aa-b11a-8953a09c1355 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:34.872232 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc1208-6e23-46aa-b11a-8953a09c1355 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:34.872465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc1208-6e23-46aa-b11a-8953a09c1355 None admin] PATH_INFO: `/v3/users/0ffa4f559dec498ab5306648d2a6ecd3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:34.873875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc1208-6e23-46aa-b11a-8953a09c1355 None admin] RBAC: Authorizing `identity:get_user(user_id=0ffa4f559dec498ab5306648d2a6ecd3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:34.876191 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc1208-6e23-46aa-b11a-8953a09c1355 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:34.882764 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 40/86] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:34 2022] GET /identity/v3/users/0ffa4f559dec498ab5306648d2a6ecd3 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:34.883910 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc1208-6e23-46aa-b11a-8953a09c1355 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:34.993838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:35.025613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 47/87] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:35.026493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8012ae-db56-41da-bad0-f104e7bddca9 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:35.045081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc1208-6e23-46aa-b11a-8953a09c1355 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:35.064623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:35.103001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31e172-9fcd-48aa-bdf6-28f4259ed143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:35.104241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31e172-9fcd-48aa-bdf6-28f4259ed143 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:35.105584 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31e172-9fcd-48aa-bdf6-28f4259ed143 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:35.106249 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31e172-9fcd-48aa-bdf6-28f4259ed143 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:35.108039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31e172-9fcd-48aa-bdf6-28f4259ed143 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:35.110739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31e172-9fcd-48aa-bdf6-28f4259ed143 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:35.118482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 41/88] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:34 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:35.118482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31e172-9fcd-48aa-bdf6-28f4259ed143 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:35.157550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8012ae-db56-41da-bad0-f104e7bddca9 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:35.201782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fca479-3526-4120-b19c-726daa7ca75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:35.202446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca479-3526-4120-b19c-726daa7ca75b None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:35.202729 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca479-3526-4120-b19c-726daa7ca75b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:35.202998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca479-3526-4120-b19c-726daa7ca75b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:35.278570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31e172-9fcd-48aa-bdf6-28f4259ed143 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:35.294363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fca479-3526-4120-b19c-726daa7ca75b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:35.297082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fca479-3526-4120-b19c-726daa7ca75b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:35.321005 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c160c2-fdfc-48d8-a6a1-9df78df1d91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:35.321352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c160c2-fdfc-48d8-a6a1-9df78df1d91d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:35.321591 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c160c2-fdfc-48d8-a6a1-9df78df1d91d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:35.321914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c160c2-fdfc-48d8-a6a1-9df78df1d91d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:35.335160 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:35.360060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:35.438915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c160c2-fdfc-48d8-a6a1-9df78df1d91d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:35.440943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c160c2-fdfc-48d8-a6a1-9df78df1d91d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:35.458571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 48/89] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:35.459782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fca479-3526-4120-b19c-726daa7ca75b None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:35.584339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 42/90] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:35.585955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c160c2-fdfc-48d8-a6a1-9df78df1d91d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:35.601290 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fca479-3526-4120-b19c-726daa7ca75b None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:35.645330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:35.649766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40b643-3422-42a9-9930-2acfb0c9b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:35.650992 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40b643-3422-42a9-9930-2acfb0c9b287 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:35.657975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40b643-3422-42a9-9930-2acfb0c9b287 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:35.657975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40b643-3422-42a9-9930-2acfb0c9b287 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:35.657975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40b643-3422-42a9-9930-2acfb0c9b287 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:35.657975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40b643-3422-42a9-9930-2acfb0c9b287 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:35.657975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 49/91] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:35 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:35.659411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40b643-3422-42a9-9930-2acfb0c9b287 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:35.669045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:35.777174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c160c2-fdfc-48d8-a6a1-9df78df1d91d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:35.825911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40b643-3422-42a9-9930-2acfb0c9b287 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:35.829705 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595749d0-3043-45ca-88cf-519476e0bed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:35.830617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595749d0-3043-45ca-88cf-519476e0bed2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:35.832296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595749d0-3043-45ca-88cf-519476e0bed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:35.832740 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595749d0-3043-45ca-88cf-519476e0bed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:35.833678 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595749d0-3043-45ca-88cf-519476e0bed2 None admin] RBAC: Adding query filter params (role.id=6721d4c1040945dd8817af24236acb65, scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60, user.id=0ffa4f559dec498ab5306648d2a6ecd3) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:35.834137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595749d0-3043-45ca-88cf-519476e0bed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:35.835852 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595749d0-3043-45ca-88cf-519476e0bed2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:35.850847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 43/92] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:35 2022] GET /identity/v3/role_assignments?user.id=0ffa4f559dec498ab5306648d2a6ecd3&scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60&role.id=6721d4c1040945dd8817af24236acb65 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:35.854451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595749d0-3043-45ca-88cf-519476e0bed2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:35.969492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744dc91-11cd-413d-b089-58f61cf46d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:35.970774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744dc91-11cd-413d-b089-58f61cf46d61 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:35.971444 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744dc91-11cd-413d-b089-58f61cf46d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:35.971878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744dc91-11cd-413d-b089-58f61cf46d61 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:35.979770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744dc91-11cd-413d-b089-58f61cf46d61 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:35.983015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744dc91-11cd-413d-b089-58f61cf46d61 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:35.987126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 50/93] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:35 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:35.992842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744dc91-11cd-413d-b089-58f61cf46d61 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:36.041043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595749d0-3043-45ca-88cf-519476e0bed2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:36.045509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:36.086920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385879ee-3fe0-462f-ac5a-3b5d388a2faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:36.087784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385879ee-3fe0-462f-ac5a-3b5d388a2faa None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.094259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385879ee-3fe0-462f-ac5a-3b5d388a2faa None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.094259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385879ee-3fe0-462f-ac5a-3b5d388a2faa None admin] PATH_INFO: `/v3/projects/9272c68e3cc94aaaa2bae7d0fb646229` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.094259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385879ee-3fe0-462f-ac5a-3b5d388a2faa None admin] RBAC: Authorizing `identity:get_project(project_id=9272c68e3cc94aaaa2bae7d0fb646229)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:36.094259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385879ee-3fe0-462f-ac5a-3b5d388a2faa None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:36.095296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 44/94] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:35 2022] GET /identity/v3/projects/9272c68e3cc94aaaa2bae7d0fb646229 => generated 312 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:36.096950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385879ee-3fe0-462f-ac5a-3b5d388a2faa None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:36.199870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:36.265572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385879ee-3fe0-462f-ac5a-3b5d388a2faa None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:36.292629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744dc91-11cd-413d-b089-58f61cf46d61 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:36.369382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb9958-3072-4884-9e79-86eb41bb2f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:36.370485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9958-3072-4884-9e79-86eb41bb2f28 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.371020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9958-3072-4884-9e79-86eb41bb2f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.371516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9958-3072-4884-9e79-86eb41bb2f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.371620 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aef0ba-d828-4d68-ac02-90d138d2a137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:36.372619 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb9958-3072-4884-9e79-86eb41bb2f28 None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60, user.id=5f7e3f63661a405ba93a9ec8bf8d6603) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:36.372736 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aef0ba-d828-4d68-ac02-90d138d2a137 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.373176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aef0ba-d828-4d68-ac02-90d138d2a137 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.373487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb9958-3072-4884-9e79-86eb41bb2f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:36.373672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aef0ba-d828-4d68-ac02-90d138d2a137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.375276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aef0ba-d828-4d68-ac02-90d138d2a137 None admin] RBAC: Adding query filter params (role.id=3b2b994bb5314391bf684502bd09e733, scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60, user.id=0ffa4f559dec498ab5306648d2a6ecd3) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:36.375770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb9958-3072-4884-9e79-86eb41bb2f28 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:36.376003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aef0ba-d828-4d68-ac02-90d138d2a137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:36.379325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aef0ba-d828-4d68-ac02-90d138d2a137 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:36.384064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 51/95] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:35 2022] GET /identity/v3/role_assignments?user.id=5f7e3f63661a405ba93a9ec8bf8d6603&scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 259 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:36.385386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb9958-3072-4884-9e79-86eb41bb2f28 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:36.399458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 45/96] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:36 2022] GET /identity/v3/role_assignments?user.id=0ffa4f559dec498ab5306648d2a6ecd3&scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60&role.id=3b2b994bb5314391bf684502bd09e733 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:36.525445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb9958-3072-4884-9e79-86eb41bb2f28 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:36.566573 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:36.575611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be589dac-32a1-4a2d-94e6-c3eb2b2b4901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:36.576599 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be589dac-32a1-4a2d-94e6-c3eb2b2b4901 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.577078 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be589dac-32a1-4a2d-94e6-c3eb2b2b4901 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.577843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be589dac-32a1-4a2d-94e6-c3eb2b2b4901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.578659 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be589dac-32a1-4a2d-94e6-c3eb2b2b4901 None admin] RBAC: Adding query filter params (role.id=6721d4c1040945dd8817af24236acb65, scope.project.id=9272c68e3cc94aaaa2bae7d0fb646229, user.id=0ffa4f559dec498ab5306648d2a6ecd3) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:36.579229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be589dac-32a1-4a2d-94e6-c3eb2b2b4901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:36.581128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be589dac-32a1-4a2d-94e6-c3eb2b2b4901 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:36.588425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 52/97] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:36 2022] GET /identity/v3/role_assignments?user.id=0ffa4f559dec498ab5306648d2a6ecd3&scope.project.id=9272c68e3cc94aaaa2bae7d0fb646229&role.id=6721d4c1040945dd8817af24236acb65 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:36.663219 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4d09f-6b9e-478b-9ad6-8665d4b5642f None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.663645 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4d09f-6b9e-478b-9ad6-8665d4b5642f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.664064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4d09f-6b9e-478b-9ad6-8665d4b5642f None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.666785 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 46/98] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:36.673933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d000d-82db-48fd-826d-9da907d0f2eb None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.674647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d000d-82db-48fd-826d-9da907d0f2eb None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.675180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d000d-82db-48fd-826d-9da907d0f2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.703715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-024d000d-82db-48fd-826d-9da907d0f2eb None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:36.705433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-024d000d-82db-48fd-826d-9da907d0f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:36.820381 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 53/99] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:37.241917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4d09f-6b9e-478b-9ad6-8665d4b5642f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:37.349119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:37.479119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4d09f-6b9e-478b-9ad6-8665d4b5642f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:37.525925 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedddb8-3a58-41f6-b491-6d08d7fb843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:37.526535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedddb8-3a58-41f6-b491-6d08d7fb843c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.527353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedddb8-3a58-41f6-b491-6d08d7fb843c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.527629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedddb8-3a58-41f6-b491-6d08d7fb843c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.528952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedddb8-3a58-41f6-b491-6d08d7fb843c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:37.530804 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedddb8-3a58-41f6-b491-6d08d7fb843c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:37.532544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 47/100] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:37.539220 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d000d-82db-48fd-826d-9da907d0f2eb None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:37.555133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86858f-32a4-43f3-a1ec-2ed3161c5174 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.555479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86858f-32a4-43f3-a1ec-2ed3161c5174 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.555695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86858f-32a4-43f3-a1ec-2ed3161c5174 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.557417 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 48/101] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:37.564045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78911882-f99d-4c51-97cd-95fbfc251aee None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.564410 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78911882-f99d-4c51-97cd-95fbfc251aee None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.564691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78911882-f99d-4c51-97cd-95fbfc251aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.585784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-78911882-f99d-4c51-97cd-95fbfc251aee None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:37.587135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-78911882-f99d-4c51-97cd-95fbfc251aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:37.834254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 49/102] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:37.881128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d000d-82db-48fd-826d-9da907d0f2eb None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:37.944807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:37.973886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2644-cf4a-4517-9197-1b2cee8fa930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:37.975012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2644-cf4a-4517-9197-1b2cee8fa930 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.975492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2644-cf4a-4517-9197-1b2cee8fa930 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.975996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2644-cf4a-4517-9197-1b2cee8fa930 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.977238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2644-cf4a-4517-9197-1b2cee8fa930 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:37.980757 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2644-cf4a-4517-9197-1b2cee8fa930 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:38.102346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 54/103] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:06:37 2022] POST /identity/v3/projects => generated 302 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:38.845585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78911882-f99d-4c51-97cd-95fbfc251aee None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:38.934295 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:39.119547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78911882-f99d-4c51-97cd-95fbfc251aee None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:39.209280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ff871-b6f8-459f-ad7e-ee60c0f1ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:39.212505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff871-b6f8-459f-ad7e-ee60c0f1ac92 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:39.212505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff871-b6f8-459f-ad7e-ee60c0f1ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:39.212505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff871-b6f8-459f-ad7e-ee60c0f1ac92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:39.243230 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ff871-b6f8-459f-ad7e-ee60c0f1ac92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-6d6ff871-b6f8-459f-ad7e-ee60c0f1ac92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:39.254256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:39.264662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:06:39.267363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 50/104] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:39.279136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2644-cf4a-4517-9197-1b2cee8fa930 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:39.490201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2644-cf4a-4517-9197-1b2cee8fa930 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:39.503796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471a90-ec2c-4c5e-9e78-57839e03fc83 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:39.503796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471a90-ec2c-4c5e-9e78-57839e03fc83 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:39.503796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471a90-ec2c-4c5e-9e78-57839e03fc83 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:39.507757 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 51/105] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:39.514859 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52d23d-1f2d-4aad-9285-944b9c14c520 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:39.515348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52d23d-1f2d-4aad-9285-944b9c14c520 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:39.515794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52d23d-1f2d-4aad-9285-944b9c14c520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:39.556753 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7893f-34ab-4203-a1d3-4f03293d0ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:39.557409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7893f-34ab-4203-a1d3-4f03293d0ade None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:39.557687 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7893f-34ab-4203-a1d3-4f03293d0ade None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:39.558167 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7893f-34ab-4203-a1d3-4f03293d0ade None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:39.559014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7893f-34ab-4203-a1d3-4f03293d0ade None admin] RBAC: Adding query filter params (name=reader) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:39.559328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7893f-34ab-4203-a1d3-4f03293d0ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:39.561052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7893f-34ab-4203-a1d3-4f03293d0ade None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:39.578836 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 55/106] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:39.580274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2e52d23d-1f2d-4aad-9285-944b9c14c520 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:39.582461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2e52d23d-1f2d-4aad-9285-944b9c14c520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:39.588913 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7893f-34ab-4203-a1d3-4f03293d0ade None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:39.674909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:39.773547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7893f-34ab-4203-a1d3-4f03293d0ade None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:39.817300 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34598270-2ddc-45cb-bcab-f96a7911c42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:39.818558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34598270-2ddc-45cb-bcab-f96a7911c42d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:39.818988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34598270-2ddc-45cb-bcab-f96a7911c42d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:39.819278 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34598270-2ddc-45cb-bcab-f96a7911c42d None admin] PATH_INFO: `/v3/users/4ce6bddbca024ceaa74ef6234dcf6abf` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:39.836952 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34598270-2ddc-45cb-bcab-f96a7911c42d None admin] RBAC: Authorizing `identity:get_user(user_id=4ce6bddbca024ceaa74ef6234dcf6abf)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:39.839777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34598270-2ddc-45cb-bcab-f96a7911c42d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:39.843203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 56/107] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:39 2022] GET /identity/v3/users/4ce6bddbca024ceaa74ef6234dcf6abf => generated 289 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:39.845211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff528ec7-23e2-4ec8-86dd-17a8bac7a1d4 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:39.845541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff528ec7-23e2-4ec8-86dd-17a8bac7a1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:39.845779 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff528ec7-23e2-4ec8-86dd-17a8bac7a1d4 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:39.848169 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 57/108] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:39.855771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff528ec7-23e2-4ec8-86dd-17a8bac7a1d4 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:39.872958 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 52/109] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:39.882378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d7eb2-12df-49d6-be86-ab08e19fe170 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:39.883064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d7eb2-12df-49d6-be86-ab08e19fe170 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:39.883848 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d7eb2-12df-49d6-be86-ab08e19fe170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:39.951638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9c6d7eb2-12df-49d6-be86-ab08e19fe170 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:39.962456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9c6d7eb2-12df-49d6-be86-ab08e19fe170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:40.024373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:40.067847 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff528ec7-23e2-4ec8-86dd-17a8bac7a1d4 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:40.106827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:40.117450 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc68eb-ec8e-4d81-a638-2cd782de0f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:40.119731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc68eb-ec8e-4d81-a638-2cd782de0f91 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:40.120205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc68eb-ec8e-4d81-a638-2cd782de0f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:40.121411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc68eb-ec8e-4d81-a638-2cd782de0f91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:40.192361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 53/110] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:40.264668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc68eb-ec8e-4d81-a638-2cd782de0f91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:40.270116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc68eb-ec8e-4d81-a638-2cd782de0f91 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:40.396930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:40.405026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 58/111] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:40.406993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d7eb2-12df-49d6-be86-ab08e19fe170 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:40.554854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d7eb2-12df-49d6-be86-ab08e19fe170 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:40.568336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc68eb-ec8e-4d81-a638-2cd782de0f91 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:40.655535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7d272-bc07-451c-8420-62169920120b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:40.656528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7d272-bc07-451c-8420-62169920120b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:40.657019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7d272-bc07-451c-8420-62169920120b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:40.657510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7d272-bc07-451c-8420-62169920120b None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:40.663738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7d272-bc07-451c-8420-62169920120b None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:40.666528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7d272-bc07-451c-8420-62169920120b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:40.670836 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 54/112] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:40 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:40.688787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7d272-bc07-451c-8420-62169920120b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:40.741704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc68eb-ec8e-4d81-a638-2cd782de0f91 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:40.749345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:40.823833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bf628-cdc1-43f9-8ef5-48492397c573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:40.824989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bf628-cdc1-43f9-8ef5-48492397c573 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:40.825452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bf628-cdc1-43f9-8ef5-48492397c573 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:40.825913 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bf628-cdc1-43f9-8ef5-48492397c573 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:40.869535 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bf628-cdc1-43f9-8ef5-48492397c573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-da2bf628-cdc1-43f9-8ef5-48492397c573 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:40.883391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:40.884329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:40.885085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:40.885085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:40.885085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:40.885085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:40.885085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:40.885085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:40.885085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:40.885085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:40.885085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:40.885085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:40.885085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:40.885085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:40.886507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 59/113] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:06:40.888002 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bf628-cdc1-43f9-8ef5-48492397c573 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:40.967764 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7d272-bc07-451c-8420-62169920120b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.040476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:41.058706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec3be2-ac66-43c4-b764-c158519dd260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:41.059754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec3be2-ac66-43c4-b764-c158519dd260 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.060225 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec3be2-ac66-43c4-b764-c158519dd260 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.060681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec3be2-ac66-43c4-b764-c158519dd260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.061700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec3be2-ac66-43c4-b764-c158519dd260 None admin] RBAC: Adding query filter params (role.id=a4aee179070047af9cda6fea5ed98558, scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60, user.id=4ce6bddbca024ceaa74ef6234dcf6abf) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:41.062211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec3be2-ac66-43c4-b764-c158519dd260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:41.063944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec3be2-ac66-43c4-b764-c158519dd260 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:41.079575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 55/114] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:40 2022] GET /identity/v3/role_assignments?user.id=4ce6bddbca024ceaa74ef6234dcf6abf&scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60&role.id=a4aee179070047af9cda6fea5ed98558 => generated 259 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:41.080771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec3be2-ac66-43c4-b764-c158519dd260 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:41.144142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bf628-cdc1-43f9-8ef5-48492397c573 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.227200 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca5710-b52b-4cd0-939b-2aede4e813bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:41.228246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca5710-b52b-4cd0-939b-2aede4e813bc None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.228735 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca5710-b52b-4cd0-939b-2aede4e813bc None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.229212 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca5710-b52b-4cd0-939b-2aede4e813bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.255185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca5710-b52b-4cd0-939b-2aede4e813bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-3eca5710-b52b-4cd0-939b-2aede4e813bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:41.264469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:41.265375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:41.266202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:41.266202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:41.266202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:41.266202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:41.266202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:41.266202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:41.266202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:41.266202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:41.266202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:41.266202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:41.266202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:41.266202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:41.270016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 60/115] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:41.283428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca5710-b52b-4cd0-939b-2aede4e813bc None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:41.336059 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:41.394179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec3be2-ac66-43c4-b764-c158519dd260 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.491612 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757172c-e677-46c5-9af0-b3f5518ac2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:41.493805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757172c-e677-46c5-9af0-b3f5518ac2ce None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.494807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757172c-e677-46c5-9af0-b3f5518ac2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.496277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757172c-e677-46c5-9af0-b3f5518ac2ce None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.499010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757172c-e677-46c5-9af0-b3f5518ac2ce None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:41.500270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757172c-e677-46c5-9af0-b3f5518ac2ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:41.503640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757172c-e677-46c5-9af0-b3f5518ac2ce None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:41.531866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 56/116] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:41.546893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15393-5408-481e-8113-78346bc43545 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.550972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15393-5408-481e-8113-78346bc43545 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.551821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15393-5408-481e-8113-78346bc43545 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.554989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 57/117] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:41.562799 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db15393-5408-481e-8113-78346bc43545 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:41.649565 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca5710-b52b-4cd0-939b-2aede4e813bc None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.730777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:41.766834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db148a-2843-489a-9ae0-63b9c5d53508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:41.767381 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db148a-2843-489a-9ae0-63b9c5d53508 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.767761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db148a-2843-489a-9ae0-63b9c5d53508 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.767997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db148a-2843-489a-9ae0-63b9c5d53508 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.768628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db148a-2843-489a-9ae0-63b9c5d53508 None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:41.768940 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db148a-2843-489a-9ae0-63b9c5d53508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:41.770403 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db148a-2843-489a-9ae0-63b9c5d53508 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:41.792648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 61/118] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:41.794209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca64f3a-9ebf-4fae-be5a-43988ec0e7b7 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.794515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca64f3a-9ebf-4fae-be5a-43988ec0e7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.794793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca64f3a-9ebf-4fae-be5a-43988ec0e7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.830262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db15393-5408-481e-8113-78346bc43545 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.837512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6ca64f3a-9ebf-4fae-be5a-43988ec0e7b7 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:41.843186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6ca64f3a-9ebf-4fae-be5a-43988ec0e7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:41.908741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77084286-8e63-42ea-b24d-205473f5efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:41.909652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77084286-8e63-42ea-b24d-205473f5efc2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.910082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77084286-8e63-42ea-b24d-205473f5efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.910771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77084286-8e63-42ea-b24d-205473f5efc2 None admin] PATH_INFO: `/v3/users/0ffa4f559dec498ab5306648d2a6ecd3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.912800 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77084286-8e63-42ea-b24d-205473f5efc2 None admin] RBAC: Authorizing `identity:get_user(user_id=0ffa4f559dec498ab5306648d2a6ecd3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:41.915207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77084286-8e63-42ea-b24d-205473f5efc2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:41.918501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 58/119] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:41 2022] GET /identity/v3/users/0ffa4f559dec498ab5306648d2a6ecd3 => generated 275 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:41.919720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77084286-8e63-42ea-b24d-205473f5efc2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:41.945905 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:41.989418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 62/120] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:41.992196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c37077-fb2d-4d0e-94b4-257d2e72c60a None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.993044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c37077-fb2d-4d0e-94b4-257d2e72c60a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.993920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c37077-fb2d-4d0e-94b4-257d2e72c60a None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.997476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 63/121] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:41.999514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c37077-fb2d-4d0e-94b4-257d2e72c60a None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:42.071550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77084286-8e63-42ea-b24d-205473f5efc2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:42.127804 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed54b78-4197-4bba-83a2-6fa79547739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:42.128743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed54b78-4197-4bba-83a2-6fa79547739b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:42.129486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed54b78-4197-4bba-83a2-6fa79547739b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:42.129915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed54b78-4197-4bba-83a2-6fa79547739b None admin] PATH_INFO: `/v3/users/0ffa4f559dec498ab5306648d2a6ecd3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:42.131788 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed54b78-4197-4bba-83a2-6fa79547739b None admin] RBAC: Authorizing `identity:get_user(user_id=0ffa4f559dec498ab5306648d2a6ecd3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:42.133460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed54b78-4197-4bba-83a2-6fa79547739b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:42.137096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 59/122] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:41 2022] GET /identity/v3/users/0ffa4f559dec498ab5306648d2a6ecd3 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:42.138921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e060-8a40-4567-8a87-7e90b23d3932 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:42.139506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e060-8a40-4567-8a87-7e90b23d3932 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:42.140038 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e060-8a40-4567-8a87-7e90b23d3932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:42.165414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ef49e060-8a40-4567-8a87-7e90b23d3932 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:42.168121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ef49e060-8a40-4567-8a87-7e90b23d3932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:42.257525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 60/123] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:42.263685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e060-8a40-4567-8a87-7e90b23d3932 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:42.266987 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c37077-fb2d-4d0e-94b4-257d2e72c60a None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:42.289119 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:42.292214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:42.406997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b863d8e-777b-48dd-ad9a-a5a03a52bbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:42.408410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b863d8e-777b-48dd-ad9a-a5a03a52bbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:42.409203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b863d8e-777b-48dd-ad9a-a5a03a52bbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:42.409853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b863d8e-777b-48dd-ad9a-a5a03a52bbf6 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:42.412053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b863d8e-777b-48dd-ad9a-a5a03a52bbf6 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:42.414786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b863d8e-777b-48dd-ad9a-a5a03a52bbf6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:42.419038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 64/124] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:41 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:42.427818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bbc29-73bf-4165-a118-c85bb7d968cc None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:42.428729 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bbc29-73bf-4165-a118-c85bb7d968cc None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:42.429502 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bbc29-73bf-4165-a118-c85bb7d968cc None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:42.432682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 65/125] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:42 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:42.441115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bbc29-73bf-4165-a118-c85bb7d968cc None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:42.443037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e060-8a40-4567-8a87-7e90b23d3932 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:42.498653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e26db-bd2d-49cd-af7e-bcfa59b8b8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:42.499713 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e26db-bd2d-49cd-af7e-bcfa59b8b8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:42.499935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e26db-bd2d-49cd-af7e-bcfa59b8b8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:42.500382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e26db-bd2d-49cd-af7e-bcfa59b8b8d0 None admin] PATH_INFO: `/v3/projects/9272c68e3cc94aaaa2bae7d0fb646229` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:42.501900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e26db-bd2d-49cd-af7e-bcfa59b8b8d0 None admin] RBAC: Authorizing `identity:get_project(project_id=9272c68e3cc94aaaa2bae7d0fb646229)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:42.505383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e26db-bd2d-49cd-af7e-bcfa59b8b8d0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:42.507913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 61/126] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:42 2022] GET /identity/v3/projects/9272c68e3cc94aaaa2bae7d0fb646229 => generated 312 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:42.509450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d53bc1-f955-404c-9727-bd3db6d8199f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:42.509890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d53bc1-f955-404c-9727-bd3db6d8199f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:42.510358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d53bc1-f955-404c-9727-bd3db6d8199f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:42.537305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-62d53bc1-f955-404c-9727-bd3db6d8199f None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:42.539678 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-62d53bc1-f955-404c-9727-bd3db6d8199f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:42.601616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bbc29-73bf-4165-a118-c85bb7d968cc None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:42.649971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 62/127] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:42.651107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40177f4-73c7-406b-8142-7a205970e95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:42.652043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d53bc1-f955-404c-9727-bd3db6d8199f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:42.652304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40177f4-73c7-406b-8142-7a205970e95a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:42.652596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40177f4-73c7-406b-8142-7a205970e95a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:42.652870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40177f4-73c7-406b-8142-7a205970e95a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:42.669830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40177f4-73c7-406b-8142-7a205970e95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-d40177f4-73c7-406b-8142-7a205970e95a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:42.675397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:42.676305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:42.677064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 66/128] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:42.677686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40177f4-73c7-406b-8142-7a205970e95a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:42.679057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:42.743295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:42.795111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d53bc1-f955-404c-9727-bd3db6d8199f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:42.833750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40177f4-73c7-406b-8142-7a205970e95a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:42.844582 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c852a3-be1f-490c-a2ca-e9e1258509e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:42.845580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c852a3-be1f-490c-a2ca-e9e1258509e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:42.846879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c852a3-be1f-490c-a2ca-e9e1258509e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:42.847363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c852a3-be1f-490c-a2ca-e9e1258509e2 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60/users/0ffa4f559dec498ab5306648d2a6ecd3/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:42.850685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c852a3-be1f-490c-a2ca-e9e1258509e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1e1d8f38ffd428f91d8d2285d020c60, user_id=0ffa4f559dec498ab5306648d2a6ecd3, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:42.853644 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c852a3-be1f-490c-a2ca-e9e1258509e2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:42.876741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa8aaf-966e-4372-a732-840208ec532d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:42.877559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa8aaf-966e-4372-a732-840208ec532d None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:42.877908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa8aaf-966e-4372-a732-840208ec532d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:42.878281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa8aaf-966e-4372-a732-840208ec532d None admin] PATH_INFO: `/v3/projects/9272c68e3cc94aaaa2bae7d0fb646229/users/0ffa4f559dec498ab5306648d2a6ecd3/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:42.880374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa8aaf-966e-4372-a732-840208ec532d None admin] RBAC: Authorizing `identity:create_grant(project_id=9272c68e3cc94aaaa2bae7d0fb646229, user_id=0ffa4f559dec498ab5306648d2a6ecd3, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:42.881963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa8aaf-966e-4372-a732-840208ec532d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:42.951747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 63/129] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:06:42 2022] PUT /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60/users/0ffa4f559dec498ab5306648d2a6ecd3/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:06:42.959771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c852a3-be1f-490c-a2ca-e9e1258509e2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:43.001438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 67/130] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:06:42 2022] PUT /identity/v3/projects/9272c68e3cc94aaaa2bae7d0fb646229/users/0ffa4f559dec498ab5306648d2a6ecd3/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:06:43.008402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa8aaf-966e-4372-a732-840208ec532d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:43.120632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:43.171534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c852a3-be1f-490c-a2ca-e9e1258509e2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:43.238633 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590be7a5-b147-4269-b12f-157d1c72c0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:43.239664 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590be7a5-b147-4269-b12f-157d1c72c0aa None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.239961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590be7a5-b147-4269-b12f-157d1c72c0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.240233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590be7a5-b147-4269-b12f-157d1c72c0aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.250694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:43.262952 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa8aaf-966e-4372-a732-840208ec532d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:43.268875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590be7a5-b147-4269-b12f-157d1c72c0aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-590be7a5-b147-4269-b12f-157d1c72c0aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:43.277643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:43.279388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 64/131] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:06:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:43.281568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590be7a5-b147-4269-b12f-157d1c72c0aa None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:43.322289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08e9eb-4d43-48d8-8c0a-cd52e2c17b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:43.322943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08e9eb-4d43-48d8-8c0a-cd52e2c17b92 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.323288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08e9eb-4d43-48d8-8c0a-cd52e2c17b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.324225 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08e9eb-4d43-48d8-8c0a-cd52e2c17b92 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.325079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08e9eb-4d43-48d8-8c0a-cd52e2c17b92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:43.325400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08e9eb-4d43-48d8-8c0a-cd52e2c17b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:43.327782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08e9eb-4d43-48d8-8c0a-cd52e2c17b92 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:43.339806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 68/132] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:43.340783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08e9eb-4d43-48d8-8c0a-cd52e2c17b92 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:43.421941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590be7a5-b147-4269-b12f-157d1c72c0aa None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:43.462553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:43.468171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d59a16-54a1-4983-b115-29ab2f49ea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:43.468888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d59a16-54a1-4983-b115-29ab2f49ea4e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.469183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d59a16-54a1-4983-b115-29ab2f49ea4e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.469470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d59a16-54a1-4983-b115-29ab2f49ea4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.471090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d59a16-54a1-4983-b115-29ab2f49ea4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:43.472626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d59a16-54a1-4983-b115-29ab2f49ea4e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:43.475035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 65/133] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:43.475985 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d59a16-54a1-4983-b115-29ab2f49ea4e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:43.482770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08e9eb-4d43-48d8-8c0a-cd52e2c17b92 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:43.527743 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b7bf9-3b8f-4594-b78f-90b90d69edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:43.528367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7bf9-3b8f-4594-b78f-90b90d69edfd None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.528676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7bf9-3b8f-4594-b78f-90b90d69edfd None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.528960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7bf9-3b8f-4594-b78f-90b90d69edfd None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.529676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b7bf9-3b8f-4594-b78f-90b90d69edfd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:43.529987 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b7bf9-3b8f-4594-b78f-90b90d69edfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:43.531704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b7bf9-3b8f-4594-b78f-90b90d69edfd None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:43.542467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 69/134] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:06:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:43.543512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b7bf9-3b8f-4594-b78f-90b90d69edfd None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:43.571738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:43.675679 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b7bf9-3b8f-4594-b78f-90b90d69edfd None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:43.709540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d59a16-54a1-4983-b115-29ab2f49ea4e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:43.726733 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cbb10-cf72-4904-8e69-1e57a8ffd9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:43.727390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cbb10-cf72-4904-8e69-1e57a8ffd9ee None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.727684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cbb10-cf72-4904-8e69-1e57a8ffd9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.727972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cbb10-cf72-4904-8e69-1e57a8ffd9ee None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.728677 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cbb10-cf72-4904-8e69-1e57a8ffd9ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:43.730633 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cbb10-cf72-4904-8e69-1e57a8ffd9ee None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:43.784796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244faf00-cc2c-4384-b799-1a0e037fc590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:43.785806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244faf00-cc2c-4384-b799-1a0e037fc590 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.786385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244faf00-cc2c-4384-b799-1a0e037fc590 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.786883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244faf00-cc2c-4384-b799-1a0e037fc590 None admin] PATH_INFO: `/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.789213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244faf00-cc2c-4384-b799-1a0e037fc590 None admin] RBAC: Authorizing `identity:get_user(user_id=5f7e3f63661a405ba93a9ec8bf8d6603)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:43.791758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244faf00-cc2c-4384-b799-1a0e037fc590 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:43.795820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 66/135] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:43 2022] GET /identity/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603 => generated 247 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:43.797165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244faf00-cc2c-4384-b799-1a0e037fc590 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:43.861285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 70/136] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:06:43 2022] POST /identity/v3/users => generated 283 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:43.862319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cbb10-cf72-4904-8e69-1e57a8ffd9ee None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:43.978677 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:43.991898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:44.021045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cbb10-cf72-4904-8e69-1e57a8ffd9ee None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:44.083004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e18a7-8fc1-4369-a6bf-7b7988a00def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:44.083904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e18a7-8fc1-4369-a6bf-7b7988a00def None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:44.084452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e18a7-8fc1-4369-a6bf-7b7988a00def None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:44.084908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e18a7-8fc1-4369-a6bf-7b7988a00def None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:44.091234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e18a7-8fc1-4369-a6bf-7b7988a00def None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:44.093168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e18a7-8fc1-4369-a6bf-7b7988a00def None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:44.095261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 71/137] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:43 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:44.113689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e18a7-8fc1-4369-a6bf-7b7988a00def None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:44.115898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244faf00-cc2c-4384-b799-1a0e037fc590 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:44.249584 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9481db2-a44c-43f7-b1bf-bd7fbb9b8eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:44.251170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9481db2-a44c-43f7-b1bf-bd7fbb9b8eec None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:44.251571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9481db2-a44c-43f7-b1bf-bd7fbb9b8eec None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:44.251949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9481db2-a44c-43f7-b1bf-bd7fbb9b8eec None admin] PATH_INFO: `/v3/users/0ffa4f559dec498ab5306648d2a6ecd3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:44.254028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9481db2-a44c-43f7-b1bf-bd7fbb9b8eec None admin] RBAC: Authorizing `identity:get_user(user_id=0ffa4f559dec498ab5306648d2a6ecd3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:44.256751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9481db2-a44c-43f7-b1bf-bd7fbb9b8eec None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:44.259840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 67/138] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:43 2022] GET /identity/v3/users/0ffa4f559dec498ab5306648d2a6ecd3 => generated 275 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:44.270563 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9481db2-a44c-43f7-b1bf-bd7fbb9b8eec None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:44.399175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e18a7-8fc1-4369-a6bf-7b7988a00def None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:44.516350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9481db2-a44c-43f7-b1bf-bd7fbb9b8eec None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:44.559718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfff82-4543-450f-9edc-64b771de18d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:44.560904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfff82-4543-450f-9edc-64b771de18d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:44.561409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfff82-4543-450f-9edc-64b771de18d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:44.561834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfff82-4543-450f-9edc-64b771de18d1 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60/users/5f7e3f63661a405ba93a9ec8bf8d6603/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:44.566049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfff82-4543-450f-9edc-64b771de18d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1e1d8f38ffd428f91d8d2285d020c60, user_id=5f7e3f63661a405ba93a9ec8bf8d6603, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:44.569393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfff82-4543-450f-9edc-64b771de18d1 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:44.602596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf99f3-0947-4750-8cfa-65ff4a669e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:44.604104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf99f3-0947-4750-8cfa-65ff4a669e3e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:44.604605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf99f3-0947-4750-8cfa-65ff4a669e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:44.606134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf99f3-0947-4750-8cfa-65ff4a669e3e None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:44.608737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf99f3-0947-4750-8cfa-65ff4a669e3e None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:44.611746 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf99f3-0947-4750-8cfa-65ff4a669e3e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:44.615273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 68/139] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:44 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:44.617206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cd472-db1e-4a4f-92a2-6f7b5c086254 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:44.626078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cd472-db1e-4a4f-92a2-6f7b5c086254 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:44.626078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cd472-db1e-4a4f-92a2-6f7b5c086254 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:44.626078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 69/140] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:44.628389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cd472-db1e-4a4f-92a2-6f7b5c086254 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:44.636540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:44.667967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 72/141] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:06:44 2022] PUT /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60/users/5f7e3f63661a405ba93a9ec8bf8d6603/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:06:44.677215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16888f63-5204-4535-be64-17ecb2c07792 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:44.678510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16888f63-5204-4535-be64-17ecb2c07792 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:44.678510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16888f63-5204-4535-be64-17ecb2c07792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:44.704773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:44.734716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-16888f63-5204-4535-be64-17ecb2c07792 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:44.744349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-16888f63-5204-4535-be64-17ecb2c07792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:44.959271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 73/142] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:44.960539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cd472-db1e-4a4f-92a2-6f7b5c086254 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:45.041489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12088b38-b329-4c47-92ec-bba532208118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:45.042745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12088b38-b329-4c47-92ec-bba532208118 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:45.043278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12088b38-b329-4c47-92ec-bba532208118 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:45.043751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12088b38-b329-4c47-92ec-bba532208118 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60/users/0ffa4f559dec498ab5306648d2a6ecd3/roles/3b2b994bb5314391bf684502bd09e733` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:45.047843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12088b38-b329-4c47-92ec-bba532208118 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1e1d8f38ffd428f91d8d2285d020c60, user_id=0ffa4f559dec498ab5306648d2a6ecd3, role_id=3b2b994bb5314391bf684502bd09e733)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:45.050702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12088b38-b329-4c47-92ec-bba532208118 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:45.164574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 70/143] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:06:44 2022] PUT /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60/users/0ffa4f559dec498ab5306648d2a6ecd3/roles/3b2b994bb5314391bf684502bd09e733 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:06:45.430901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16888f63-5204-4535-be64-17ecb2c07792 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:45.644760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16888f63-5204-4535-be64-17ecb2c07792 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:45.719271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae38bdf-4cf5-45c3-a404-83743e008836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:45.720392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae38bdf-4cf5-45c3-a404-83743e008836 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:45.720866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae38bdf-4cf5-45c3-a404-83743e008836 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:45.721338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae38bdf-4cf5-45c3-a404-83743e008836 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:45.726614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:45.743597 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae38bdf-4cf5-45c3-a404-83743e008836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-cae38bdf-4cf5-45c3-a404-83743e008836 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:45.754013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:45.754993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:45.755738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:45.755738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:45.755738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:45.755738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:45.755738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:45.755738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:45.755738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:45.755738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:45.755738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:45.755738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:45.755738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:06:45.755738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:45.756297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 74/144] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:45.768285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12088b38-b329-4c47-92ec-bba532208118 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:45.909702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:45.999128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12088b38-b329-4c47-92ec-bba532208118 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:46.064969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71e825-462a-4eac-be77-d094234d6816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:46.065604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e825-462a-4eac-be77-d094234d6816 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:46.065888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e825-462a-4eac-be77-d094234d6816 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:46.066168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e825-462a-4eac-be77-d094234d6816 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:46.066951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71e825-462a-4eac-be77-d094234d6816 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:46.067263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71e825-462a-4eac-be77-d094234d6816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:46.068949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71e825-462a-4eac-be77-d094234d6816 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:46.079016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 71/145] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:46.087322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae38bdf-4cf5-45c3-a404-83743e008836 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:46.340235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae38bdf-4cf5-45c3-a404-83743e008836 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:46.377637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2a2f6-8029-4780-af28-bfe897dd0689 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:46.378305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2a2f6-8029-4780-af28-bfe897dd0689 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:46.378812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2a2f6-8029-4780-af28-bfe897dd0689 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:46.380428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 72/146] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:46.391752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba8b26-1502-430f-8a2d-7a63accfb8ed None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:46.392532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba8b26-1502-430f-8a2d-7a63accfb8ed None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:46.393021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba8b26-1502-430f-8a2d-7a63accfb8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:46.421553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84195a6b-515c-412d-a51b-3f3b7034424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:46.422720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84195a6b-515c-412d-a51b-3f3b7034424f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:46.423209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84195a6b-515c-412d-a51b-3f3b7034424f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:46.423700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84195a6b-515c-412d-a51b-3f3b7034424f None admin] PATH_INFO: `/v3/users/4ce6bddbca024ceaa74ef6234dcf6abf` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:46.431491 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a9ba8b26-1502-430f-8a2d-7a63accfb8ed None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:46.431678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84195a6b-515c-412d-a51b-3f3b7034424f None admin] RBAC: Authorizing `identity:get_user(user_id=4ce6bddbca024ceaa74ef6234dcf6abf)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:46.433890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a9ba8b26-1502-430f-8a2d-7a63accfb8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:46.435602 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84195a6b-515c-412d-a51b-3f3b7034424f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:46.438951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 75/147] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:46 2022] GET /identity/v3/users/4ce6bddbca024ceaa74ef6234dcf6abf => generated 289 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:46.453848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84195a6b-515c-412d-a51b-3f3b7034424f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:46.588916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 73/148] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:46.605255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:46.687082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84195a6b-515c-412d-a51b-3f3b7034424f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:46.757353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a338a56-ec60-47e6-b5d0-6a363a68801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:46.759621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a338a56-ec60-47e6-b5d0-6a363a68801f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:46.760356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a338a56-ec60-47e6-b5d0-6a363a68801f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:46.761568 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a338a56-ec60-47e6-b5d0-6a363a68801f None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:46.764640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a338a56-ec60-47e6-b5d0-6a363a68801f None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:46.767879 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a338a56-ec60-47e6-b5d0-6a363a68801f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:46.771583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 76/149] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:46 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:46.778799 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba8b26-1502-430f-8a2d-7a63accfb8ed None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:46.891778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:46.958840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba8b26-1502-430f-8a2d-7a63accfb8ed None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:47.006841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240c670-a430-4084-92cf-c0e9a203a30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:47.007551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240c670-a430-4084-92cf-c0e9a203a30e None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:47.007832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240c670-a430-4084-92cf-c0e9a203a30e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:47.008109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240c670-a430-4084-92cf-c0e9a203a30e None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60/users/4ce6bddbca024ceaa74ef6234dcf6abf/roles/a4aee179070047af9cda6fea5ed98558` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:47.014864 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240c670-a430-4084-92cf-c0e9a203a30e None admin] RBAC: Authorizing `identity:create_grant(project_id=a1e1d8f38ffd428f91d8d2285d020c60, user_id=4ce6bddbca024ceaa74ef6234dcf6abf, role_id=a4aee179070047af9cda6fea5ed98558)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:47.016367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240c670-a430-4084-92cf-c0e9a203a30e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:47.092170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 74/150] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:06:46 2022] PUT /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60/users/4ce6bddbca024ceaa74ef6234dcf6abf/roles/a4aee179070047af9cda6fea5ed98558 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:06:47.103024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392169f-7941-4c29-9459-e23d56c39d95 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:47.103875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392169f-7941-4c29-9459-e23d56c39d95 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:47.105429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392169f-7941-4c29-9459-e23d56c39d95 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:47.108414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 77/151] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:47.120990 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5968659-5bdc-4b20-acd3-f111ccd7eb0e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:47.121375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5968659-5bdc-4b20-acd3-f111ccd7eb0e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:47.121541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5968659-5bdc-4b20-acd3-f111ccd7eb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:47.155841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e5968659-5bdc-4b20-acd3-f111ccd7eb0e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:47.156995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e5968659-5bdc-4b20-acd3-f111ccd7eb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:47.271309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 75/152] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:47.534931 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392169f-7941-4c29-9459-e23d56c39d95 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:47.762848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392169f-7941-4c29-9459-e23d56c39d95 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:47.824661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:47.834983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e893ecc-a5da-4f92-b88f-ceafbee0869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:47.836046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e893ecc-a5da-4f92-b88f-ceafbee0869d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:47.836607 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e893ecc-a5da-4f92-b88f-ceafbee0869d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:47.837131 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e893ecc-a5da-4f92-b88f-ceafbee0869d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:47.859714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e893ecc-a5da-4f92-b88f-ceafbee0869d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-8e893ecc-a5da-4f92-b88f-ceafbee0869d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:47.870146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:47.871682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:47.872421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:47.872421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:47.872421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:47.872421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:47.872421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:47.872421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:47.872421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:47.872421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:47.872421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:47.872421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:47.872421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:47.872421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:47.874366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 78/153] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:47.877006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5968659-5bdc-4b20-acd3-f111ccd7eb0e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:47.882848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e893ecc-a5da-4f92-b88f-ceafbee0869d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:47.988472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:48.127394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e893ecc-a5da-4f92-b88f-ceafbee0869d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:48.132486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5968659-5bdc-4b20-acd3-f111ccd7eb0e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:48.215939 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c4bea-40c8-4846-b373-71065e5e0f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:48.218000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c4bea-40c8-4846-b373-71065e5e0f5b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:48.219750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c4bea-40c8-4846-b373-71065e5e0f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:48.220191 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c4bea-40c8-4846-b373-71065e5e0f5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:48.221186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9696c0-4447-49b5-8197-f9d19348c677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:48.222926 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9696c0-4447-49b5-8197-f9d19348c677 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:48.225065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9696c0-4447-49b5-8197-f9d19348c677 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:48.225530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9696c0-4447-49b5-8197-f9d19348c677 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:48.226441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9696c0-4447-49b5-8197-f9d19348c677 None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:48.228477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9696c0-4447-49b5-8197-f9d19348c677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:48.230378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9696c0-4447-49b5-8197-f9d19348c677 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:48.260449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c4bea-40c8-4846-b373-71065e5e0f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-df7c4bea-40c8-4846-b373-71065e5e0f5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:48.266728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:48.267710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:06:48.268510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 76/154] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:48.270867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 79/155] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:48.278601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9696c0-4447-49b5-8197-f9d19348c677 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:48.279104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c4bea-40c8-4846-b373-71065e5e0f5b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:48.399555 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:48.469596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9696c0-4447-49b5-8197-f9d19348c677 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:48.544140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45d6ab-85ce-4fe3-80b7-e325dc3dd5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:48.545031 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45d6ab-85ce-4fe3-80b7-e325dc3dd5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:48.545464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45d6ab-85ce-4fe3-80b7-e325dc3dd5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:48.545911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45d6ab-85ce-4fe3-80b7-e325dc3dd5d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:48.546816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45d6ab-85ce-4fe3-80b7-e325dc3dd5d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:48.547271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45d6ab-85ce-4fe3-80b7-e325dc3dd5d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:48.548907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45d6ab-85ce-4fe3-80b7-e325dc3dd5d2 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:48.565378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 80/156] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:48.570858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45d6ab-85ce-4fe3-80b7-e325dc3dd5d2 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:48.606522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c4bea-40c8-4846-b373-71065e5e0f5b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:48.626661 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:48.703136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b70b1d-00df-4af7-996e-af7db08df394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:48.703724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b70b1d-00df-4af7-996e-af7db08df394 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:48.704005 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b70b1d-00df-4af7-996e-af7db08df394 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:48.704279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b70b1d-00df-4af7-996e-af7db08df394 None admin] PATH_INFO: `/v3/users/0ffa4f559dec498ab5306648d2a6ecd3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:48.707083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b70b1d-00df-4af7-996e-af7db08df394 None admin] RBAC: Authorizing `identity:get_user(user_id=0ffa4f559dec498ab5306648d2a6ecd3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:48.708979 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b70b1d-00df-4af7-996e-af7db08df394 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:48.711423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 77/157] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:48 2022] GET /identity/v3/users/0ffa4f559dec498ab5306648d2a6ecd3 => generated 275 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:48.720640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b70b1d-00df-4af7-996e-af7db08df394 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:48.844404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45d6ab-85ce-4fe3-80b7-e325dc3dd5d2 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:48.878818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:48.948394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b70b1d-00df-4af7-996e-af7db08df394 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:48.964961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a274a02-7954-42b3-8b7a-356e529b9a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:48.965976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a274a02-7954-42b3-8b7a-356e529b9a26 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:48.966525 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a274a02-7954-42b3-8b7a-356e529b9a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:48.967018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a274a02-7954-42b3-8b7a-356e529b9a26 None admin] PATH_INFO: `/v3/users/0ffa4f559dec498ab5306648d2a6ecd3` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:48.975699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a274a02-7954-42b3-8b7a-356e529b9a26 None admin] RBAC: Authorizing `identity:get_user(user_id=0ffa4f559dec498ab5306648d2a6ecd3)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:48.978633 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a274a02-7954-42b3-8b7a-356e529b9a26 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:48.982059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 81/158] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:48 2022] GET /identity/v3/users/0ffa4f559dec498ab5306648d2a6ecd3 => generated 275 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:48.989016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a274a02-7954-42b3-8b7a-356e529b9a26 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:49.057015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206b98c-7f8c-42d2-bead-4737d6b04fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:49.059021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206b98c-7f8c-42d2-bead-4737d6b04fcb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.059732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206b98c-7f8c-42d2-bead-4737d6b04fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.060488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206b98c-7f8c-42d2-bead-4737d6b04fcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.181925 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:49.243171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206b98c-7f8c-42d2-bead-4737d6b04fcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:49.245077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206b98c-7f8c-42d2-bead-4737d6b04fcb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:49.449771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a274a02-7954-42b3-8b7a-356e529b9a26 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:49.536955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 78/159] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 817 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:06:49.543758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206b98c-7f8c-42d2-bead-4737d6b04fcb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:49.557160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77764e-24ba-4adf-9f27-3063f2b92e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:49.563071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77764e-24ba-4adf-9f27-3063f2b92e0c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.563591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77764e-24ba-4adf-9f27-3063f2b92e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.563995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77764e-24ba-4adf-9f27-3063f2b92e0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.670386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:49.726494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77764e-24ba-4adf-9f27-3063f2b92e0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:49.728012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77764e-24ba-4adf-9f27-3063f2b92e0c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:49.756676 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:49.825573 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206b98c-7f8c-42d2-bead-4737d6b04fcb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:49.912509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc504d7-b153-4e87-a50a-bc8471009cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:49.913183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc504d7-b153-4e87-a50a-bc8471009cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.913457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc504d7-b153-4e87-a50a-bc8471009cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.913725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc504d7-b153-4e87-a50a-bc8471009cc0 None admin] PATH_INFO: `/v3/projects/9272c68e3cc94aaaa2bae7d0fb646229` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.919203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc504d7-b153-4e87-a50a-bc8471009cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=9272c68e3cc94aaaa2bae7d0fb646229)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:49.920772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc504d7-b153-4e87-a50a-bc8471009cc0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:49.922653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 79/160] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:49 2022] GET /identity/v3/projects/9272c68e3cc94aaaa2bae7d0fb646229 => generated 312 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:49.928086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b8485-cdd1-4c73-8397-4c6d44513598 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.928429 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b8485-cdd1-4c73-8397-4c6d44513598 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.928672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b8485-cdd1-4c73-8397-4c6d44513598 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.930103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 80/161] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:49.936717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b8485-cdd1-4c73-8397-4c6d44513598 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:49.984093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 82/162] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 996 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:06:49.985548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ec886-6cbd-4183-8286-9c96092a1b97 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.985800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ec886-6cbd-4183-8286-9c96092a1b97 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.986077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ec886-6cbd-4183-8286-9c96092a1b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.031440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-018ec886-6cbd-4183-8286-9c96092a1b97 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:50.032828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-018ec886-6cbd-4183-8286-9c96092a1b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:50.178291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b8485-cdd1-4c73-8397-4c6d44513598 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:50.219193 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 83/163] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:50.220095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ec886-6cbd-4183-8286-9c96092a1b97 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:50.261071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:50.278703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8143b73-5350-4323-bf23-2def9213a50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:50.279344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8143b73-5350-4323-bf23-2def9213a50f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.279625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8143b73-5350-4323-bf23-2def9213a50f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.279894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8143b73-5350-4323-bf23-2def9213a50f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.280672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8143b73-5350-4323-bf23-2def9213a50f None admin] RBAC: Adding query filter params (role.id=6721d4c1040945dd8817af24236acb65, scope.project.id=9272c68e3cc94aaaa2bae7d0fb646229, user.id=0ffa4f559dec498ab5306648d2a6ecd3) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:50.280979 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8143b73-5350-4323-bf23-2def9213a50f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:50.282627 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8143b73-5350-4323-bf23-2def9213a50f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:50.300983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 81/164] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:49 2022] GET /identity/v3/role_assignments?user.id=0ffa4f559dec498ab5306648d2a6ecd3&scope.project.id=9272c68e3cc94aaaa2bae7d0fb646229&role.id=6721d4c1040945dd8817af24236acb65 => generated 608 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:50.302490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7bfe-c84e-40b7-a55a-a0c66514e59a None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.302779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7bfe-c84e-40b7-a55a-a0c66514e59a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.303049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7bfe-c84e-40b7-a55a-a0c66514e59a None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.304396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 82/165] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:50.312031 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8669f5-3af5-4443-a686-2e91ec1bda5e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.312341 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8669f5-3af5-4443-a686-2e91ec1bda5e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.312655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8669f5-3af5-4443-a686-2e91ec1bda5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.346173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:50.363567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9a8669f5-3af5-4443-a686-2e91ec1bda5e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:50.364934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9a8669f5-3af5-4443-a686-2e91ec1bda5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:50.565103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ec886-6cbd-4183-8286-9c96092a1b97 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:50.577110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 83/166] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:50.578501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26c345-dbdd-4ab6-81f4-fbf129e751dc None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.579068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26c345-dbdd-4ab6-81f4-fbf129e751dc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.579568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26c345-dbdd-4ab6-81f4-fbf129e751dc None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.581268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 84/167] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:50.592978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017005a-1327-4947-935e-b313b6bf0ae4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.593599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017005a-1327-4947-935e-b313b6bf0ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.594064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017005a-1327-4947-935e-b313b6bf0ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.627588 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1017005a-1327-4947-935e-b313b6bf0ae4 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:50.628887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1017005a-1327-4947-935e-b313b6bf0ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:50.646073 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a28932-0cb2-4c29-aeae-9bf0d8c8886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:50.646766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a28932-0cb2-4c29-aeae-9bf0d8c8886b None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.647047 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a28932-0cb2-4c29-aeae-9bf0d8c8886b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.647585 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a28932-0cb2-4c29-aeae-9bf0d8c8886b None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.650794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a28932-0cb2-4c29-aeae-9bf0d8c8886b None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:50.653081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a28932-0cb2-4c29-aeae-9bf0d8c8886b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:50.654917 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 84/168] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:50 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:50.662980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cb09c-c71b-43a4-87f1-fbfb312b32c2 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.664142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cb09c-c71b-43a4-87f1-fbfb312b32c2 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.664426 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cb09c-c71b-43a4-87f1-fbfb312b32c2 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.666009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 85/169] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:50.669114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cb09c-c71b-43a4-87f1-fbfb312b32c2 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:50.777266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 85/170] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:50.779056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b432262-a609-4dfd-8fa9-2b29bd207dbd None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.779343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b432262-a609-4dfd-8fa9-2b29bd207dbd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.779602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b432262-a609-4dfd-8fa9-2b29bd207dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.802063 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:50.824736 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5b432262-a609-4dfd-8fa9-2b29bd207dbd None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:50.825490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5b432262-a609-4dfd-8fa9-2b29bd207dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:50.830270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cb09c-c71b-43a4-87f1-fbfb312b32c2 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:50.877198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddff0f-d91c-4be0-a6ab-940c715b0a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:50.877963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddff0f-d91c-4be0-a6ab-940c715b0a7e None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.878330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddff0f-d91c-4be0-a6ab-940c715b0a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.878775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddff0f-d91c-4be0-a6ab-940c715b0a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.879718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddff0f-d91c-4be0-a6ab-940c715b0a7e None admin] RBAC: Adding query filter params (role.id=6721d4c1040945dd8817af24236acb65, scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60, user.id=0ffa4f559dec498ab5306648d2a6ecd3) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:50.880029 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddff0f-d91c-4be0-a6ab-940c715b0a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:50.881668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddff0f-d91c-4be0-a6ab-940c715b0a7e None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:50.890064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 86/171] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:50 2022] GET /identity/v3/role_assignments?user.id=0ffa4f559dec498ab5306648d2a6ecd3&scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60&role.id=6721d4c1040945dd8817af24236acb65 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:50.895367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddff0f-d91c-4be0-a6ab-940c715b0a7e None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:50.941502 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:50.959955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 86/172] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:50.971294 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b432262-a609-4dfd-8fa9-2b29bd207dbd None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.057532 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddff0f-d91c-4be0-a6ab-940c715b0a7e None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:51.126149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1515fe-8bd1-4395-a526-fcfabaf92b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:51.126842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1515fe-8bd1-4395-a526-fcfabaf92b7f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.127242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1515fe-8bd1-4395-a526-fcfabaf92b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.127523 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1515fe-8bd1-4395-a526-fcfabaf92b7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.137857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b432262-a609-4dfd-8fa9-2b29bd207dbd None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:51.155271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1515fe-8bd1-4395-a526-fcfabaf92b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-5d1515fe-8bd1-4395-a526-fcfabaf92b7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:51.161008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:51.162016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:51.162884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 87/173] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:51.171689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1515fe-8bd1-4395-a526-fcfabaf92b7f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.178940 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:51.196553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be83601-44d8-4038-976d-4bdeab3f3ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:51.197259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be83601-44d8-4038-976d-4bdeab3f3ccb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.197501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be83601-44d8-4038-976d-4bdeab3f3ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.198269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be83601-44d8-4038-976d-4bdeab3f3ccb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.226276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be83601-44d8-4038-976d-4bdeab3f3ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-6be83601-44d8-4038-976d-4bdeab3f3ccb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:51.227900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:51.228774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:06:51.229531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 87/174] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:51.231042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89f532-a549-443b-a270-ef091e0c366f None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.231617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89f532-a549-443b-a270-ef091e0c366f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.231617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89f532-a549-443b-a270-ef091e0c366f None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.232879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 88/175] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:51.242255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9ac56-8fa9-488d-8909-9de12aa0d0df None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.242255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9ac56-8fa9-488d-8909-9de12aa0d0df None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.242255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9ac56-8fa9-488d-8909-9de12aa0d0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.278898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f2c9ac56-8fa9-488d-8909-9de12aa0d0df None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:51.280638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f2c9ac56-8fa9-488d-8909-9de12aa0d0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:51.336493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1515fe-8bd1-4395-a526-fcfabaf92b7f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:51.389865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:51.395446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff956a7e-6d68-4d06-9892-779bad351c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:51.397025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff956a7e-6d68-4d06-9892-779bad351c4b None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.398041 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff956a7e-6d68-4d06-9892-779bad351c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.398918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff956a7e-6d68-4d06-9892-779bad351c4b None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.402350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff956a7e-6d68-4d06-9892-779bad351c4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:51.402350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff956a7e-6d68-4d06-9892-779bad351c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:51.404985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff956a7e-6d68-4d06-9892-779bad351c4b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:51.430257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 88/176] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:51.430500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 89/177] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:51.430500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9ac56-8fa9-488d-8909-9de12aa0d0df None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.432927 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff956a7e-6d68-4d06-9892-779bad351c4b None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.584809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:51.659894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff956a7e-6d68-4d06-9892-779bad351c4b None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:51.660893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9ac56-8fa9-488d-8909-9de12aa0d0df None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:51.712269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227e6be-0146-41e7-a3e1-8f873e4ab9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:51.712565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227e6be-0146-41e7-a3e1-8f873e4ab9eb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.712799 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227e6be-0146-41e7-a3e1-8f873e4ab9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.713231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227e6be-0146-41e7-a3e1-8f873e4ab9eb None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.714727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227e6be-0146-41e7-a3e1-8f873e4ab9eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:51.715142 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227e6be-0146-41e7-a3e1-8f873e4ab9eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:51.716666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227e6be-0146-41e7-a3e1-8f873e4ab9eb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:51.729058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 90/178] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:51.729963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227e6be-0146-41e7-a3e1-8f873e4ab9eb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.758787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3695769-a9db-4687-bded-0131d2a58c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:51.761278 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3695769-a9db-4687-bded-0131d2a58c99 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.762378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3695769-a9db-4687-bded-0131d2a58c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.763514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3695769-a9db-4687-bded-0131d2a58c99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.796939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3695769-a9db-4687-bded-0131d2a58c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:51.806672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-b3695769-a9db-4687-bded-0131d2a58c99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:51.814034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:51.815668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:51.817052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:51.817052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:51.817052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:51.817052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:51.817052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:51.817052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:51.817052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:51.817052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:51.817052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:51.817052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:51.817052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:51.817052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:51.821342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 89/179] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:51.823967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3695769-a9db-4687-bded-0131d2a58c99 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.895751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227e6be-0146-41e7-a3e1-8f873e4ab9eb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:51.950241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d386-b995-41e5-b78c-5272a95508d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:51.950904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d386-b995-41e5-b78c-5272a95508d1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.951297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d386-b995-41e5-b78c-5272a95508d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.956431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d386-b995-41e5-b78c-5272a95508d1 None admin] PATH_INFO: `/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.958574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d386-b995-41e5-b78c-5272a95508d1 None admin] RBAC: Authorizing `identity:get_user(user_id=5f7e3f63661a405ba93a9ec8bf8d6603)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:51.960815 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d386-b995-41e5-b78c-5272a95508d1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:51.962569 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 91/180] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/users/5f7e3f63661a405ba93a9ec8bf8d6603 => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:51.963512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d386-b995-41e5-b78c-5272a95508d1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:52.029582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3695769-a9db-4687-bded-0131d2a58c99 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:52.064928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:52.076179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68636f0-e5c6-4490-a5be-505d10ed6716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:52.082984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68636f0-e5c6-4490-a5be-505d10ed6716 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:52.082984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68636f0-e5c6-4490-a5be-505d10ed6716 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:52.082984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68636f0-e5c6-4490-a5be-505d10ed6716 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:52.091596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68636f0-e5c6-4490-a5be-505d10ed6716 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-d68636f0-e5c6-4490-a5be-505d10ed6716 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:52.096949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:52.098513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 90/181] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:52.100097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68636f0-e5c6-4490-a5be-505d10ed6716 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:52.130296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d386-b995-41e5-b78c-5272a95508d1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:52.154789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:52.184021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b467ee-f0ad-47db-895c-e46266306a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:52.185509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b467ee-f0ad-47db-895c-e46266306a03 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:52.187532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b467ee-f0ad-47db-895c-e46266306a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:52.188164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b467ee-f0ad-47db-895c-e46266306a03 None admin] PATH_INFO: `/v3/users/d77c1d5014ca41b29b6cb3e680821ec6` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:52.210294 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b467ee-f0ad-47db-895c-e46266306a03 None admin] RBAC: Authorizing `identity:get_user(user_id=d77c1d5014ca41b29b6cb3e680821ec6)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:52.212896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b467ee-f0ad-47db-895c-e46266306a03 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:52.218128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 92/182] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/users/d77c1d5014ca41b29b6cb3e680821ec6 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:52.218128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b467ee-f0ad-47db-895c-e46266306a03 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:52.251999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68636f0-e5c6-4490-a5be-505d10ed6716 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:52.300937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeada0-635f-41a2-8fff-8d836428609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:52.301632 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeada0-635f-41a2-8fff-8d836428609b None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:52.301945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeada0-635f-41a2-8fff-8d836428609b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:52.302375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeada0-635f-41a2-8fff-8d836428609b None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:52.303140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeada0-635f-41a2-8fff-8d836428609b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:52.303486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeada0-635f-41a2-8fff-8d836428609b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:52.305172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeada0-635f-41a2-8fff-8d836428609b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:52.322042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 91/183] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:06:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:52.322042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeada0-635f-41a2-8fff-8d836428609b None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:52.375495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b467ee-f0ad-47db-895c-e46266306a03 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:52.383608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:52.419651 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d43455-48d1-4ea7-bd3d-17c497a86d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:52.420277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d43455-48d1-4ea7-bd3d-17c497a86d27 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:52.420564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d43455-48d1-4ea7-bd3d-17c497a86d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:52.420837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d43455-48d1-4ea7-bd3d-17c497a86d27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:52.446046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeada0-635f-41a2-8fff-8d836428609b None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:52.470519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:52.488990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f2089-309d-4aa7-9f6e-23f730ab54e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:52.489919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f2089-309d-4aa7-9f6e-23f730ab54e8 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:52.490201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f2089-309d-4aa7-9f6e-23f730ab54e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:52.490521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f2089-309d-4aa7-9f6e-23f730ab54e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:52.491846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f2089-309d-4aa7-9f6e-23f730ab54e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:52.493345 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f2089-309d-4aa7-9f6e-23f730ab54e8 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:52.495688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 92/184] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:52.497794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f2089-309d-4aa7-9f6e-23f730ab54e8 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:52.502611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d43455-48d1-4ea7-bd3d-17c497a86d27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:52.504460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d43455-48d1-4ea7-bd3d-17c497a86d27 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:52.611427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f2089-309d-4aa7-9f6e-23f730ab54e8 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:52.631157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:52.651716 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 93/185] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:52.657526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d43455-48d1-4ea7-bd3d-17c497a86d27 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:52.657792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843a38f-ad09-4df3-a4d8-a93f04448e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:52.657792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843a38f-ad09-4df3-a4d8-a93f04448e7d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:52.657792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843a38f-ad09-4df3-a4d8-a93f04448e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:52.657792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843a38f-ad09-4df3-a4d8-a93f04448e7d None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:52.658298 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843a38f-ad09-4df3-a4d8-a93f04448e7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:52.658298 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843a38f-ad09-4df3-a4d8-a93f04448e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:52.659326 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843a38f-ad09-4df3-a4d8-a93f04448e7d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:52.671378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 93/186] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:06:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:52.672697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843a38f-ad09-4df3-a4d8-a93f04448e7d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:52.750797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:52.782675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d43455-48d1-4ea7-bd3d-17c497a86d27 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:52.812375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843a38f-ad09-4df3-a4d8-a93f04448e7d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:52.826160 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12512eaf-a34c-42e7-90e6-0faa5b86958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:52.826812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12512eaf-a34c-42e7-90e6-0faa5b86958d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:52.827103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12512eaf-a34c-42e7-90e6-0faa5b86958d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:52.827376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12512eaf-a34c-42e7-90e6-0faa5b86958d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:52.857484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5743c3-d442-405d-8e79-cf395493122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:52.858317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5743c3-d442-405d-8e79-cf395493122d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:52.858742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5743c3-d442-405d-8e79-cf395493122d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:52.859186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5743c3-d442-405d-8e79-cf395493122d None admin] PATH_INFO: `/v3/users/0ffa4f559dec498ab5306648d2a6ecd3` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:52.860620 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5743c3-d442-405d-8e79-cf395493122d None admin] RBAC: Authorizing `identity:get_user(user_id=0ffa4f559dec498ab5306648d2a6ecd3)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:52.862411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5743c3-d442-405d-8e79-cf395493122d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:52.864273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 94/187] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:52 2022] GET /identity/v3/users/0ffa4f559dec498ab5306648d2a6ecd3 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:52.866402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb48508-e1ae-4e81-8f31-cf8659ec883c None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:52.866880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb48508-e1ae-4e81-8f31-cf8659ec883c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:52.867357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb48508-e1ae-4e81-8f31-cf8659ec883c None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:52.871495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 95/188] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:52.872942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb48508-e1ae-4e81-8f31-cf8659ec883c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:52.918801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12512eaf-a34c-42e7-90e6-0faa5b86958d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:52.920389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12512eaf-a34c-42e7-90e6-0faa5b86958d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:52.934514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:53.017056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb48508-e1ae-4e81-8f31-cf8659ec883c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:53.050889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:53.059227 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218310e-7355-4825-ac80-33ea3dfc4474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:53.060225 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218310e-7355-4825-ac80-33ea3dfc4474 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:53.060627 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218310e-7355-4825-ac80-33ea3dfc4474 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:53.061119 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218310e-7355-4825-ac80-33ea3dfc4474 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:53.062336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218310e-7355-4825-ac80-33ea3dfc4474 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:53.064600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218310e-7355-4825-ac80-33ea3dfc4474 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:53.093757 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 94/189] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:53.094973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12512eaf-a34c-42e7-90e6-0faa5b86958d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:53.137979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 96/190] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:06:52 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:53.139410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218310e-7355-4825-ac80-33ea3dfc4474 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:53.238789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12512eaf-a34c-42e7-90e6-0faa5b86958d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:53.285761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa58e23-9718-4072-9a6a-3c18c07cc3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:53.286376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa58e23-9718-4072-9a6a-3c18c07cc3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:53.286660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa58e23-9718-4072-9a6a-3c18c07cc3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:53.286934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa58e23-9718-4072-9a6a-3c18c07cc3d6 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:53.288273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa58e23-9718-4072-9a6a-3c18c07cc3d6 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:53.289794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa58e23-9718-4072-9a6a-3c18c07cc3d6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:53.298675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 95/191] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:53 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:53.298675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa58e23-9718-4072-9a6a-3c18c07cc3d6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:53.342553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218310e-7355-4825-ac80-33ea3dfc4474 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:53.361838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:53.378855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:53.421218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e612f51-6f14-48ab-b0f0-333b2c2cc611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:53.422590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e612f51-6f14-48ab-b0f0-333b2c2cc611 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:53.423072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e612f51-6f14-48ab-b0f0-333b2c2cc611 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:53.423561 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e612f51-6f14-48ab-b0f0-333b2c2cc611 None admin] PATH_INFO: `/v3/users/d77c1d5014ca41b29b6cb3e680821ec6` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:53.425511 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e612f51-6f14-48ab-b0f0-333b2c2cc611 None admin] RBAC: Authorizing `identity:get_user(user_id=d77c1d5014ca41b29b6cb3e680821ec6)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:53.427417 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e612f51-6f14-48ab-b0f0-333b2c2cc611 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:53.430982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 97/192] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:53 2022] GET /identity/v3/users/d77c1d5014ca41b29b6cb3e680821ec6 => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:53.430982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0ed1-bf08-4da1-b5be-bb6703aaf167 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:53.433336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0ed1-bf08-4da1-b5be-bb6703aaf167 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:53.433336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0ed1-bf08-4da1-b5be-bb6703aaf167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:53.459667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f9ce0ed1-bf08-4da1-b5be-bb6703aaf167 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:53.461189 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f9ce0ed1-bf08-4da1-b5be-bb6703aaf167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:53.501045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa58e23-9718-4072-9a6a-3c18c07cc3d6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:53.549725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bae4b-08e4-494b-a874-b076dfb2ce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:53.550345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bae4b-08e4-494b-a874-b076dfb2ce78 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:53.550643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bae4b-08e4-494b-a874-b076dfb2ce78 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:53.550919 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bae4b-08e4-494b-a874-b076dfb2ce78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:53.596404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 98/193] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:53.597688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0ed1-bf08-4da1-b5be-bb6703aaf167 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:53.648216 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bae4b-08e4-494b-a874-b076dfb2ce78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:53.649656 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bae4b-08e4-494b-a874-b076dfb2ce78 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:53.724539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:53.758769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:53.767995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0ed1-bf08-4da1-b5be-bb6703aaf167 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:53.853580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 96/194] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:53.856112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bae4b-08e4-494b-a874-b076dfb2ce78 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:53.865314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b330a-f34b-4ace-9d3f-89e8cd93ba09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:53.865977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b330a-f34b-4ace-9d3f-89e8cd93ba09 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:53.866280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b330a-f34b-4ace-9d3f-89e8cd93ba09 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:53.866557 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b330a-f34b-4ace-9d3f-89e8cd93ba09 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:53.873112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b330a-f34b-4ace-9d3f-89e8cd93ba09 None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:53.874641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b330a-f34b-4ace-9d3f-89e8cd93ba09 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:53.876415 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 99/195] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:53 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:53.877213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b330a-f34b-4ace-9d3f-89e8cd93ba09 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:54.031437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bae4b-08e4-494b-a874-b076dfb2ce78 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:54.041668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b330a-f34b-4ace-9d3f-89e8cd93ba09 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:54.087378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c542d12-cf2a-4039-8b45-12ef613aa945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:54.088033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c542d12-cf2a-4039-8b45-12ef613aa945 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:54.088314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c542d12-cf2a-4039-8b45-12ef613aa945 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:54.088583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c542d12-cf2a-4039-8b45-12ef613aa945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:54.088843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507114-1b35-4671-984f-74032b7a75bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:54.089597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507114-1b35-4671-984f-74032b7a75bc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:54.089879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507114-1b35-4671-984f-74032b7a75bc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:54.090152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507114-1b35-4671-984f-74032b7a75bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:54.091055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae507114-1b35-4671-984f-74032b7a75bc None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60, user.id=5f7e3f63661a405ba93a9ec8bf8d6603) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:54.091362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae507114-1b35-4671-984f-74032b7a75bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:54.094346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae507114-1b35-4671-984f-74032b7a75bc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:54.102626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 97/196] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:53 2022] GET /identity/v3/role_assignments?user.id=5f7e3f63661a405ba93a9ec8bf8d6603&scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:54.104148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507114-1b35-4671-984f-74032b7a75bc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:54.119085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:54.133798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:54.174961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c542d12-cf2a-4039-8b45-12ef613aa945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:54.176720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c542d12-cf2a-4039-8b45-12ef613aa945 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:54.272274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507114-1b35-4671-984f-74032b7a75bc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:54.318801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087665-0598-4ab8-a457-c7bb59c8189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:54.319983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087665-0598-4ab8-a457-c7bb59c8189c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:54.320470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087665-0598-4ab8-a457-c7bb59c8189c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:54.321092 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087665-0598-4ab8-a457-c7bb59c8189c None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:54.322981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a087665-0598-4ab8-a457-c7bb59c8189c None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:54.325450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a087665-0598-4ab8-a457-c7bb59c8189c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:54.327855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 98/197] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:54 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:54.329272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087665-0598-4ab8-a457-c7bb59c8189c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:54.379161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 100/198] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:54.380871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c542d12-cf2a-4039-8b45-12ef613aa945 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:54.456269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:54.492654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087665-0598-4ab8-a457-c7bb59c8189c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:54.552412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:54.576580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f2b55-7446-4173-b62b-291a49919768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:54.577609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f2b55-7446-4173-b62b-291a49919768 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:54.578348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f2b55-7446-4173-b62b-291a49919768 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:54.578840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f2b55-7446-4173-b62b-291a49919768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:54.580226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f2b55-7446-4173-b62b-291a49919768 None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=9bcee52eea134a719563c19653e9371c, user.id=d77c1d5014ca41b29b6cb3e680821ec6) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:54.580774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f2b55-7446-4173-b62b-291a49919768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:54.583655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f2b55-7446-4173-b62b-291a49919768 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:54.598345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 99/199] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:54 2022] GET /identity/v3/role_assignments?user.id=d77c1d5014ca41b29b6cb3e680821ec6&scope.project.id=9bcee52eea134a719563c19653e9371c&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:54.600048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f2b55-7446-4173-b62b-291a49919768 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:54.644158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c542d12-cf2a-4039-8b45-12ef613aa945 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:54.741967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c797a7b-08f3-40fb-afe8-6b5784aa1d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:54.742887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c797a7b-08f3-40fb-afe8-6b5784aa1d74 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:54.743176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c797a7b-08f3-40fb-afe8-6b5784aa1d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:54.743446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c797a7b-08f3-40fb-afe8-6b5784aa1d74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:54.764776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c797a7b-08f3-40fb-afe8-6b5784aa1d74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-8c797a7b-08f3-40fb-afe8-6b5784aa1d74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:54.770023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:54.771207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:54.772163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:54.772163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:54.772163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:54.772163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:54.772163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:54.772163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:54.772163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:54.772163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:54.772163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:54.772163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:54.772163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:06:54.772163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:54.773848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 101/200] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:54.774191 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c797a7b-08f3-40fb-afe8-6b5784aa1d74 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:54.910528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f2b55-7446-4173-b62b-291a49919768 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:54.981458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a3892-ed0b-4372-a9d4-4086e1cac5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:54.982103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a3892-ed0b-4372-a9d4-4086e1cac5ad None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:54.982535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a3892-ed0b-4372-a9d4-4086e1cac5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:54.982796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a3892-ed0b-4372-a9d4-4086e1cac5ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:54.983935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a3892-ed0b-4372-a9d4-4086e1cac5ad None admin] RBAC: Adding query filter params (role.id=3b2b994bb5314391bf684502bd09e733, scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60, user.id=0ffa4f559dec498ab5306648d2a6ecd3) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:54.984345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a3892-ed0b-4372-a9d4-4086e1cac5ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:54.986123 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a3892-ed0b-4372-a9d4-4086e1cac5ad None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:55.005509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 100/201] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:54 2022] GET /identity/v3/role_assignments?user.id=0ffa4f559dec498ab5306648d2a6ecd3&scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60&role.id=3b2b994bb5314391bf684502bd09e733 => generated 608 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:55.007084 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a3892-ed0b-4372-a9d4-4086e1cac5ad None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:55.020332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:55.024659 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c797a7b-08f3-40fb-afe8-6b5784aa1d74 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:55.122558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:55.151504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e37d2-6839-407c-ab8f-0518f755f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:55.153157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e37d2-6839-407c-ab8f-0518f755f40c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.153645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e37d2-6839-407c-ab8f-0518f755f40c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.154157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e37d2-6839-407c-ab8f-0518f755f40c None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.155951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e37d2-6839-407c-ab8f-0518f755f40c None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:55.157734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e37d2-6839-407c-ab8f-0518f755f40c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:55.160306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 102/202] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:54 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:55.167749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e37d2-6839-407c-ab8f-0518f755f40c None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:55.358262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a3892-ed0b-4372-a9d4-4086e1cac5ad None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:55.446995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e37d2-6839-407c-ab8f-0518f755f40c None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:55.481250 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf71dc-b02e-4bad-99a1-acbc21aeef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:55.482364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf71dc-b02e-4bad-99a1-acbc21aeef12 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.482866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf71dc-b02e-4bad-99a1-acbc21aeef12 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.483344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf71dc-b02e-4bad-99a1-acbc21aeef12 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.485833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf71dc-b02e-4bad-99a1-acbc21aeef12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:55.486492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf71dc-b02e-4bad-99a1-acbc21aeef12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:55.489119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf71dc-b02e-4bad-99a1-acbc21aeef12 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:55.530971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 101/203] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:55.534540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf71dc-b02e-4bad-99a1-acbc21aeef12 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:55.585193 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd442d-7cf6-4dc8-bbed-3428b5fef013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:55.585901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd442d-7cf6-4dc8-bbed-3428b5fef013 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.586398 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd442d-7cf6-4dc8-bbed-3428b5fef013 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.587102 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd442d-7cf6-4dc8-bbed-3428b5fef013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.591099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd442d-7cf6-4dc8-bbed-3428b5fef013 None admin] RBAC: Adding query filter params (role.id=3b2b994bb5314391bf684502bd09e733, scope.project.id=9bcee52eea134a719563c19653e9371c, user.id=d77c1d5014ca41b29b6cb3e680821ec6) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:55.593368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd442d-7cf6-4dc8-bbed-3428b5fef013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:55.596818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd442d-7cf6-4dc8-bbed-3428b5fef013 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:55.621777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 103/204] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:55 2022] GET /identity/v3/role_assignments?user.id=d77c1d5014ca41b29b6cb3e680821ec6&scope.project.id=9bcee52eea134a719563c19653e9371c&role.id=3b2b994bb5314391bf684502bd09e733 => generated 259 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:55.732798 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:55.831952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf71dc-b02e-4bad-99a1-acbc21aeef12 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:55.907342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fce527-c5ff-40fd-84b2-8ed0277bd557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:55.908309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fce527-c5ff-40fd-84b2-8ed0277bd557 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.908701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fce527-c5ff-40fd-84b2-8ed0277bd557 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.909139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fce527-c5ff-40fd-84b2-8ed0277bd557 None admin] PATH_INFO: `/v3/users/4ce6bddbca024ceaa74ef6234dcf6abf` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.915473 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fce527-c5ff-40fd-84b2-8ed0277bd557 None admin] RBAC: Authorizing `identity:get_user(user_id=4ce6bddbca024ceaa74ef6234dcf6abf)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:55.918204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fce527-c5ff-40fd-84b2-8ed0277bd557 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:55.921219 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 102/205] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:55 2022] GET /identity/v3/users/4ce6bddbca024ceaa74ef6234dcf6abf => generated 289 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:55.927523 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd442d-7cf6-4dc8-bbed-3428b5fef013 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:56.044918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:56.072204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b65c73-0c90-405f-87ba-a146230195da None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.072985 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b65c73-0c90-405f-87ba-a146230195da None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.073985 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b65c73-0c90-405f-87ba-a146230195da None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.076105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 103/206] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:56.083095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec757d5-be4b-4fad-a470-1d79740c7b71 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.083995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec757d5-be4b-4fad-a470-1d79740c7b71 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.084691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec757d5-be4b-4fad-a470-1d79740c7b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.111309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-aec757d5-be4b-4fad-a470-1d79740c7b71 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:56.112919 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-aec757d5-be4b-4fad-a470-1d79740c7b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:56.150037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd442d-7cf6-4dc8-bbed-3428b5fef013 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:56.223902 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278594cd-a7f3-4a46-b026-9f4fb8beb158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:56.225070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278594cd-a7f3-4a46-b026-9f4fb8beb158 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.225599 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278594cd-a7f3-4a46-b026-9f4fb8beb158 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.226071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278594cd-a7f3-4a46-b026-9f4fb8beb158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.241898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 104/207] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:56.243448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205e88c-036b-46c9-9c45-b29d36250ee6 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.250495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205e88c-036b-46c9-9c45-b29d36250ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.250495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205e88c-036b-46c9-9c45-b29d36250ee6 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.250495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 105/208] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:56.254505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296ec4f-40df-4166-9ec4-3e8a71866b09 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.254965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296ec4f-40df-4166-9ec4-3e8a71866b09 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.255414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296ec4f-40df-4166-9ec4-3e8a71866b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.279422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1296ec4f-40df-4166-9ec4-3e8a71866b09 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:56.280654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1296ec4f-40df-4166-9ec4-3e8a71866b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:56.368001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:56.398289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 106/209] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:56.431840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278594cd-a7f3-4a46-b026-9f4fb8beb158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:56.434259 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278594cd-a7f3-4a46-b026-9f4fb8beb158 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:56.562730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:56.625328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296ec4f-40df-4166-9ec4-3e8a71866b09 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:56.676053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 104/210] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:56.684289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278594cd-a7f3-4a46-b026-9f4fb8beb158 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:56.778920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296ec4f-40df-4166-9ec4-3e8a71866b09 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:56.842322 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336af023-7553-4221-b1f9-4e2035044450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:56.843156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336af023-7553-4221-b1f9-4e2035044450 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.843652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336af023-7553-4221-b1f9-4e2035044450 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.844133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336af023-7553-4221-b1f9-4e2035044450 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.845570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336af023-7553-4221-b1f9-4e2035044450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:56.848058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336af023-7553-4221-b1f9-4e2035044450 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:56.850400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 107/211] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:56.863995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336af023-7553-4221-b1f9-4e2035044450 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:56.906198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278594cd-a7f3-4a46-b026-9f4fb8beb158 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:56.957407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88122c-3b24-4088-abf3-95b01752c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:56.958087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88122c-3b24-4088-abf3-95b01752c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.958383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88122c-3b24-4088-abf3-95b01752c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.958657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88122c-3b24-4088-abf3-95b01752c6a5 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.963199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88122c-3b24-4088-abf3-95b01752c6a5 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:56.964949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88122c-3b24-4088-abf3-95b01752c6a5 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:56.967876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 105/212] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:56 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:56.974072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88122c-3b24-4088-abf3-95b01752c6a5 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:56.981337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:57.042775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:57.051483 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336af023-7553-4221-b1f9-4e2035044450 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:57.117622 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f4cec-ff2d-4d58-b70f-39a7b0c027f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:57.119255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f4cec-ff2d-4d58-b70f-39a7b0c027f5 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.120056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f4cec-ff2d-4d58-b70f-39a7b0c027f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.121536 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f4cec-ff2d-4d58-b70f-39a7b0c027f5 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.123346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f4cec-ff2d-4d58-b70f-39a7b0c027f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:57.126955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f4cec-ff2d-4d58-b70f-39a7b0c027f5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:57.197680 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88122c-3b24-4088-abf3-95b01752c6a5 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:57.270669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 108/213] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:06:56 2022] POST /identity/v3/users => generated 297 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:57.273124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f4cec-ff2d-4d58-b70f-39a7b0c027f5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:57.293539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c31e7a-a11d-4d4a-8d90-b11e6ea0fb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:57.294894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c31e7a-a11d-4d4a-8d90-b11e6ea0fb02 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.295412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c31e7a-a11d-4d4a-8d90-b11e6ea0fb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.295882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c31e7a-a11d-4d4a-8d90-b11e6ea0fb02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.297422 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c31e7a-a11d-4d4a-8d90-b11e6ea0fb02 None admin] RBAC: Adding query filter params (role.id=a4aee179070047af9cda6fea5ed98558, scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60, user.id=4ce6bddbca024ceaa74ef6234dcf6abf) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:57.297966 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c31e7a-a11d-4d4a-8d90-b11e6ea0fb02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:57.306316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c31e7a-a11d-4d4a-8d90-b11e6ea0fb02 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:57.311367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 106/214] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:56 2022] GET /identity/v3/role_assignments?user.id=4ce6bddbca024ceaa74ef6234dcf6abf&scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60&role.id=a4aee179070047af9cda6fea5ed98558 => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:57.556020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f4cec-ff2d-4d58-b70f-39a7b0c027f5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:57.582809 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:57.598028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32674c-4ee2-4ead-b9bb-569b1d6444ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:57.598780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32674c-4ee2-4ead-b9bb-569b1d6444ac None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.599062 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32674c-4ee2-4ead-b9bb-569b1d6444ac None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.599329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32674c-4ee2-4ead-b9bb-569b1d6444ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.612184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32674c-4ee2-4ead-b9bb-569b1d6444ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-7e32674c-4ee2-4ead-b9bb-569b1d6444ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:57.617932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:57.619703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:06:57.621299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 109/215] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:57.631127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c31e7a-a11d-4d4a-8d90-b11e6ea0fb02 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:57.787547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:57.800652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c31e7a-a11d-4d4a-8d90-b11e6ea0fb02 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:57.850358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744068b-10f6-4706-8aeb-51b2ebe5100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:57.850906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744068b-10f6-4706-8aeb-51b2ebe5100d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.851180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744068b-10f6-4706-8aeb-51b2ebe5100d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.851459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744068b-10f6-4706-8aeb-51b2ebe5100d None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.852137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744068b-10f6-4706-8aeb-51b2ebe5100d None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:57.852499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744068b-10f6-4706-8aeb-51b2ebe5100d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:57.854238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744068b-10f6-4706-8aeb-51b2ebe5100d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:57.865440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 107/216] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:57.872662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32674c-4ee2-4ead-b9bb-569b1d6444ac None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:57.939499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a06b57-3a65-4ff9-9d4a-0d379fe87632 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.939762 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a06b57-3a65-4ff9-9d4a-0d379fe87632 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.940126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a06b57-3a65-4ff9-9d4a-0d379fe87632 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.942377 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 108/217] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:57.953361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968b29c-4be9-4a73-98e1-a441a9e2ea79 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.954326 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968b29c-4be9-4a73-98e1-a441a9e2ea79 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.955076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968b29c-4be9-4a73-98e1-a441a9e2ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.991465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-2968b29c-4be9-4a73-98e1-a441a9e2ea79 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:57.992675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2968b29c-4be9-4a73-98e1-a441a9e2ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:58.033677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32674c-4ee2-4ead-b9bb-569b1d6444ac None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:58.086164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f647303-f593-42a6-8ec5-1cd7eace0b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:58.086867 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f647303-f593-42a6-8ec5-1cd7eace0b8c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.087148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f647303-f593-42a6-8ec5-1cd7eace0b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.087424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f647303-f593-42a6-8ec5-1cd7eace0b8c None admin] PATH_INFO: `/v3/users/b0eaf614bb23465fb143fcbcd6d6cd28` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.101661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 109/218] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:58.111922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f647303-f593-42a6-8ec5-1cd7eace0b8c None admin] RBAC: Authorizing `identity:get_user(user_id=b0eaf614bb23465fb143fcbcd6d6cd28)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:58.115180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f647303-f593-42a6-8ec5-1cd7eace0b8c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:58.118761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 110/219] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:57 2022] GET /identity/v3/users/b0eaf614bb23465fb143fcbcd6d6cd28 => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:58.127416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968b29c-4be9-4a73-98e1-a441a9e2ea79 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:58.242352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:58.263020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968b29c-4be9-4a73-98e1-a441a9e2ea79 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:58.308200 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016ee81-738a-433e-8c37-9f0baa147b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:58.309337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016ee81-738a-433e-8c37-9f0baa147b72 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.309815 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016ee81-738a-433e-8c37-9f0baa147b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.310327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016ee81-738a-433e-8c37-9f0baa147b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.408721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016ee81-738a-433e-8c37-9f0baa147b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:58.410686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016ee81-738a-433e-8c37-9f0baa147b72 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:58.513076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613cee3-52f7-43e1-9e26-44e7c46e9c9d None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.514105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613cee3-52f7-43e1-9e26-44e7c46e9c9d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.515580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613cee3-52f7-43e1-9e26-44e7c46e9c9d None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.524696 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:58.526009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 111/220] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:06:58 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:58.528305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613cee3-52f7-43e1-9e26-44e7c46e9c9d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:58.541755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 110/221] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:58.545877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e641-5646-4825-8b19-8f324908f279 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.546408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e641-5646-4825-8b19-8f324908f279 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.546886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e641-5646-4825-8b19-8f324908f279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.580428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-7e57e641-5646-4825-8b19-8f324908f279 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:58.581719 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7e57e641-5646-4825-8b19-8f324908f279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:58.602014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:58.686383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 111/222] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:58.686383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e641-5646-4825-8b19-8f324908f279 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:58.805288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613cee3-52f7-43e1-9e26-44e7c46e9c9d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:58.814060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e641-5646-4825-8b19-8f324908f279 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:58.838282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:58.888149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54b18f-c248-4bb0-92b2-da3244955ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:58.888850 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54b18f-c248-4bb0-92b2-da3244955ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.889184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54b18f-c248-4bb0-92b2-da3244955ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.889464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54b18f-c248-4bb0-92b2-da3244955ad3 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.890779 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54b18f-c248-4bb0-92b2-da3244955ad3 None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:58.892276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54b18f-c248-4bb0-92b2-da3244955ad3 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:58.898693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 112/223] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:58 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:58.901126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54b18f-c248-4bb0-92b2-da3244955ad3 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:58.906996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410076aa-88de-4653-b74f-529f1de21829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:58.907653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410076aa-88de-4653-b74f-529f1de21829 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.907927 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410076aa-88de-4653-b74f-529f1de21829 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.908193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410076aa-88de-4653-b74f-529f1de21829 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.967108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410076aa-88de-4653-b74f-529f1de21829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-410076aa-88de-4653-b74f-529f1de21829 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:58.972648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:58.973572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:58.974380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:58.974380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:58.974380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:58.974380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:58.974380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:58.974380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:58.974380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:58.974380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:58.974380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:58.974380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:58.974380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:58.974380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:06:58.985343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 112/224] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:59.012325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410076aa-88de-4653-b74f-529f1de21829 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:59.091030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54b18f-c248-4bb0-92b2-da3244955ad3 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:59.156066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193190c-1183-46e9-8d58-6404dc11f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:59.157197 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193190c-1183-46e9-8d58-6404dc11f904 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:59.157708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193190c-1183-46e9-8d58-6404dc11f904 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:59.158215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193190c-1183-46e9-8d58-6404dc11f904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:59.159651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193190c-1183-46e9-8d58-6404dc11f904 None admin] RBAC: Adding query filter params (role.id=6721d4c1040945dd8817af24236acb65, scope.project.id=9bcee52eea134a719563c19653e9371c, user.id=b0eaf614bb23465fb143fcbcd6d6cd28) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:59.160216 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193190c-1183-46e9-8d58-6404dc11f904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:59.163037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193190c-1183-46e9-8d58-6404dc11f904 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:59.176977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 113/225] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:58 2022] GET /identity/v3/role_assignments?user.id=b0eaf614bb23465fb143fcbcd6d6cd28&scope.project.id=9bcee52eea134a719563c19653e9371c&role.id=6721d4c1040945dd8817af24236acb65 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:59.300458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:59.317675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410076aa-88de-4653-b74f-529f1de21829 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:59.371768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193190c-1183-46e9-8d58-6404dc11f904 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:59.401897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0e16d-4bfc-48b0-9f63-8a6221930dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:59.403167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0e16d-4bfc-48b0-9f63-8a6221930dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:59.403636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0e16d-4bfc-48b0-9f63-8a6221930dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:59.404106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0e16d-4bfc-48b0-9f63-8a6221930dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:59.405485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0e16d-4bfc-48b0-9f63-8a6221930dd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:59.405971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0e16d-4bfc-48b0-9f63-8a6221930dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:59.407694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0e16d-4bfc-48b0-9f63-8a6221930dd3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:59.420971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 113/226] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:59.435868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0e16d-4bfc-48b0-9f63-8a6221930dd3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:59.446929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:59.512114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193190c-1183-46e9-8d58-6404dc11f904 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:59.553758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296848b-4112-40a5-86b6-710dbff61b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:59.554435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296848b-4112-40a5-86b6-710dbff61b2e None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:59.554722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296848b-4112-40a5-86b6-710dbff61b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:59.554997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296848b-4112-40a5-86b6-710dbff61b2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:59.568275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296848b-4112-40a5-86b6-710dbff61b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-2296848b-4112-40a5-86b6-710dbff61b2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:59.574479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:59.575485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:06:59.576260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 114/227] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:06:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:59.581838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296848b-4112-40a5-86b6-710dbff61b2e None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:59.715003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296848b-4112-40a5-86b6-710dbff61b2e None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:59.720168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:59.753115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dc8e4-4b64-4ca2-876a-6853c8716806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:59.754802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dc8e4-4b64-4ca2-876a-6853c8716806 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:59.756025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dc8e4-4b64-4ca2-876a-6853c8716806 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:59.756634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dc8e4-4b64-4ca2-876a-6853c8716806 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:59.762856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1dc8e4-4b64-4ca2-876a-6853c8716806 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:59.764941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0e16d-4bfc-48b0-9f63-8a6221930dd3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:59.765896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1dc8e4-4b64-4ca2-876a-6853c8716806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:59.767549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1dc8e4-4b64-4ca2-876a-6853c8716806 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:59.784526 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 115/228] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:06:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:59.792899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dc8e4-4b64-4ca2-876a-6853c8716806 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:59.851106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdd4b7-8449-4fe7-b420-53f9d4a50dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:59.851694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdd4b7-8449-4fe7-b420-53f9d4a50dea None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:59.851990 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdd4b7-8449-4fe7-b420-53f9d4a50dea None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:59.852251 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdd4b7-8449-4fe7-b420-53f9d4a50dea None admin] PATH_INFO: `/v3/users/d77c1d5014ca41b29b6cb3e680821ec6` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:59.853784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fdd4b7-8449-4fe7-b420-53f9d4a50dea None admin] RBAC: Authorizing `identity:get_user(user_id=d77c1d5014ca41b29b6cb3e680821ec6)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:59.856213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fdd4b7-8449-4fe7-b420-53f9d4a50dea None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:59.858422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 114/229] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:59 2022] GET /identity/v3/users/d77c1d5014ca41b29b6cb3e680821ec6 => generated 283 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:59.873634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdd4b7-8449-4fe7-b420-53f9d4a50dea None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:59.928348 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dc8e4-4b64-4ca2-876a-6853c8716806 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:59.942496 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:59.968918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4a788-a364-4ef6-99df-9c2327e73cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:59.969857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4a788-a364-4ef6-99df-9c2327e73cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:59.970368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4a788-a364-4ef6-99df-9c2327e73cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:59.970806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4a788-a364-4ef6-99df-9c2327e73cc0 None admin] PATH_INFO: `/v3/users/d77c1d5014ca41b29b6cb3e680821ec6` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:59.972174 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4a788-a364-4ef6-99df-9c2327e73cc0 None admin] RBAC: Authorizing `identity:get_user(user_id=d77c1d5014ca41b29b6cb3e680821ec6)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:59.973911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4a788-a364-4ef6-99df-9c2327e73cc0 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:59.975865 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 116/230] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:59 2022] GET /identity/v3/users/d77c1d5014ca41b29b6cb3e680821ec6 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:59.983250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4a788-a364-4ef6-99df-9c2327e73cc0 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:00.045811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:00.124842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4a788-a364-4ef6-99df-9c2327e73cc0 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:00.136102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdd4b7-8449-4fe7-b420-53f9d4a50dea None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:00.168968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a147d88-15e6-4102-806d-b0fe3610e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:00.170094 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a147d88-15e6-4102-806d-b0fe3610e90a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:00.170649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a147d88-15e6-4102-806d-b0fe3610e90a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:00.171262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a147d88-15e6-4102-806d-b0fe3610e90a None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:00.172839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a147d88-15e6-4102-806d-b0fe3610e90a None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:00.174707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a147d88-15e6-4102-806d-b0fe3610e90a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:00.176794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 117/231] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:59 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:00.183726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a147d88-15e6-4102-806d-b0fe3610e90a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:00.216858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708cca2-e000-40a9-ab0a-a74b963b52db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:00.217822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708cca2-e000-40a9-ab0a-a74b963b52db None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:00.218283 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708cca2-e000-40a9-ab0a-a74b963b52db None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:00.218720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708cca2-e000-40a9-ab0a-a74b963b52db None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:00.223090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708cca2-e000-40a9-ab0a-a74b963b52db None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:00.224834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708cca2-e000-40a9-ab0a-a74b963b52db None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:00.227167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 115/232] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:59 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:00.251317 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708cca2-e000-40a9-ab0a-a74b963b52db None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:00.313625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a147d88-15e6-4102-806d-b0fe3610e90a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:00.322737 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:00.372553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7b8e3-cf2c-4c40-ae2e-a1fbad49af77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:00.376054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7b8e3-cf2c-4c40-ae2e-a1fbad49af77 None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:00.376645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7b8e3-cf2c-4c40-ae2e-a1fbad49af77 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:00.377613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7b8e3-cf2c-4c40-ae2e-a1fbad49af77 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c/users/d77c1d5014ca41b29b6cb3e680821ec6/roles/3b2b994bb5314391bf684502bd09e733` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:00.383031 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7b8e3-cf2c-4c40-ae2e-a1fbad49af77 None admin] RBAC: Authorizing `identity:create_grant(project_id=9bcee52eea134a719563c19653e9371c, user_id=d77c1d5014ca41b29b6cb3e680821ec6, role_id=3b2b994bb5314391bf684502bd09e733)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:00.388176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7b8e3-cf2c-4c40-ae2e-a1fbad49af77 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:00.490436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:00.516163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 118/233] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:07:00 2022] PUT /identity/v3/projects/9bcee52eea134a719563c19653e9371c/users/d77c1d5014ca41b29b6cb3e680821ec6/roles/3b2b994bb5314391bf684502bd09e733 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:07:00.523561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708cca2-e000-40a9-ab0a-a74b963b52db None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:00.599618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107ddf5-6892-4c24-b371-e2647cf55bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:00.600704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107ddf5-6892-4c24-b371-e2647cf55bad None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:00.601136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107ddf5-6892-4c24-b371-e2647cf55bad None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:00.601610 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107ddf5-6892-4c24-b371-e2647cf55bad None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c/users/d77c1d5014ca41b29b6cb3e680821ec6/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:00.606745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107ddf5-6892-4c24-b371-e2647cf55bad None admin] RBAC: Authorizing `identity:create_grant(project_id=9bcee52eea134a719563c19653e9371c, user_id=d77c1d5014ca41b29b6cb3e680821ec6, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:00.609555 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107ddf5-6892-4c24-b371-e2647cf55bad None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:00.679463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd206-8d86-4d05-bb3f-c48bab2d9edd None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:00.679882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd206-8d86-4d05-bb3f-c48bab2d9edd None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:00.680322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd206-8d86-4d05-bb3f-c48bab2d9edd None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:00.684508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 119/234] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:00.692091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de43a9a-d711-475e-b8ad-df54d12f71bf None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:00.692548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de43a9a-d711-475e-b8ad-df54d12f71bf None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:00.692948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de43a9a-d711-475e-b8ad-df54d12f71bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:00.715607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 116/235] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:07:00 2022] PUT /identity/v3/projects/9bcee52eea134a719563c19653e9371c/users/d77c1d5014ca41b29b6cb3e680821ec6/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:00.722257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-3de43a9a-d711-475e-b8ad-df54d12f71bf None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:00.723625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3de43a9a-d711-475e-b8ad-df54d12f71bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:00.810473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 120/236] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:01.124182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107ddf5-6892-4c24-b371-e2647cf55bad None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:01.268083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c54eee-f901-46db-96d6-2f7fbd01a972 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:01.268370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c54eee-f901-46db-96d6-2f7fbd01a972 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:01.268764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c54eee-f901-46db-96d6-2f7fbd01a972 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:01.270050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 121/237] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:01.289390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb925407-1b86-4213-9ae4-01b071a1c9e3 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:01.289809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb925407-1b86-4213-9ae4-01b071a1c9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:01.289970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107ddf5-6892-4c24-b371-e2647cf55bad None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:01.290107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb925407-1b86-4213-9ae4-01b071a1c9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:01.331520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-fb925407-1b86-4213-9ae4-01b071a1c9e3 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:01.332810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-fb925407-1b86-4213-9ae4-01b071a1c9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:01.379573 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53d48-10ad-4da4-8b5e-715ecabcaccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:01.380515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53d48-10ad-4da4-8b5e-715ecabcaccc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:01.381001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53d48-10ad-4da4-8b5e-715ecabcaccc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:01.381512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53d48-10ad-4da4-8b5e-715ecabcaccc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:01.422777 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a53d48-10ad-4da4-8b5e-715ecabcaccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-64a53d48-10ad-4da4-8b5e-715ecabcaccc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:01.443489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:01.445314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:01.447668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 117/238] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:01.453683 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53d48-10ad-4da4-8b5e-715ecabcaccc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:01.479543 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:01.498566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 122/239] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:01.613278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53d48-10ad-4da4-8b5e-715ecabcaccc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:01.679653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fa2f6-9938-448d-95db-ab20657b16e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:01.680609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fa2f6-9938-448d-95db-ab20657b16e2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:01.681131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fa2f6-9938-448d-95db-ab20657b16e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:01.681594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fa2f6-9938-448d-95db-ab20657b16e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:01.683079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fa2f6-9938-448d-95db-ab20657b16e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:01.683775 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fa2f6-9938-448d-95db-ab20657b16e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:01.685512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fa2f6-9938-448d-95db-ab20657b16e2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:01.700088 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 118/240] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:01.707127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb925407-1b86-4213-9ae4-01b071a1c9e3 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:01.780839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:01.978103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fa2f6-9938-448d-95db-ab20657b16e2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:01.992397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb925407-1b86-4213-9ae4-01b071a1c9e3 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:02.050051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a81c3-1bb4-426c-be45-9aaa9f3c528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:02.051078 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a81c3-1bb4-426c-be45-9aaa9f3c528b None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:02.051509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a81c3-1bb4-426c-be45-9aaa9f3c528b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:02.051949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a81c3-1bb4-426c-be45-9aaa9f3c528b None admin] PATH_INFO: `/v3/users/403c0b99886e440087c811483f2eed5f` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:02.069609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a81c3-1bb4-426c-be45-9aaa9f3c528b None admin] RBAC: Authorizing `identity:get_user(user_id=403c0b99886e440087c811483f2eed5f)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:02.071582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a81c3-1bb4-426c-be45-9aaa9f3c528b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:02.074586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 123/241] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:01 2022] GET /identity/v3/users/403c0b99886e440087c811483f2eed5f => generated 297 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:02.076448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646ccf5-b9ea-413e-a54d-5342e366dd6f None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:02.076980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646ccf5-b9ea-413e-a54d-5342e366dd6f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:02.077478 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646ccf5-b9ea-413e-a54d-5342e366dd6f None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:02.083746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 124/242] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:02.085051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646ccf5-b9ea-413e-a54d-5342e366dd6f None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:02.146066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:02.192944 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:02.210899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fa2f6-9938-448d-95db-ab20657b16e2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:02.223844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646ccf5-b9ea-413e-a54d-5342e366dd6f None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:02.262643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f584b0-b921-4b20-81eb-08284041cba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:02.263673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f584b0-b921-4b20-81eb-08284041cba4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:02.264312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f584b0-b921-4b20-81eb-08284041cba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:02.264791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f584b0-b921-4b20-81eb-08284041cba4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:02.267061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f584b0-b921-4b20-81eb-08284041cba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:02.270175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f584b0-b921-4b20-81eb-08284041cba4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:02.278378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 119/243] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:02.280396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23740-9301-458e-8cf8-c27e3302df01 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:02.280898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23740-9301-458e-8cf8-c27e3302df01 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:02.281466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23740-9301-458e-8cf8-c27e3302df01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:02.288991 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f91da-1b31-4552-a780-09ede8d3793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:02.291610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f91da-1b31-4552-a780-09ede8d3793d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:02.292229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f91da-1b31-4552-a780-09ede8d3793d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:02.292789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f91da-1b31-4552-a780-09ede8d3793d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:02.305335 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-78c23740-9301-458e-8cf8-c27e3302df01 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:02.307015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-78c23740-9301-458e-8cf8-c27e3302df01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:02.431686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 120/244] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:02.434299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c23740-9301-458e-8cf8-c27e3302df01 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:02.457085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f91da-1b31-4552-a780-09ede8d3793d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:02.460358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f91da-1b31-4552-a780-09ede8d3793d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:02.626497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:02.650443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 125/245] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:02.653020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:02.660151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f91da-1b31-4552-a780-09ede8d3793d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:02.739348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c23740-9301-458e-8cf8-c27e3302df01 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:02.779873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609fb8b-b54e-4bdf-971e-b60a56aabe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:02.780615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609fb8b-b54e-4bdf-971e-b60a56aabe8a None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:02.780962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609fb8b-b54e-4bdf-971e-b60a56aabe8a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:02.781297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609fb8b-b54e-4bdf-971e-b60a56aabe8a None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:02.782032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609fb8b-b54e-4bdf-971e-b60a56aabe8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:02.783618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609fb8b-b54e-4bdf-971e-b60a56aabe8a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:02.807432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f91da-1b31-4552-a780-09ede8d3793d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:02.851766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b400e-399e-4648-bfe6-8640eb799d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:02.852478 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b400e-399e-4648-bfe6-8640eb799d5f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:02.852763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b400e-399e-4648-bfe6-8640eb799d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:02.853035 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b400e-399e-4648-bfe6-8640eb799d5f None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:02.854336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b400e-399e-4648-bfe6-8640eb799d5f None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:02.856362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b400e-399e-4648-bfe6-8640eb799d5f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:02.858322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 126/246] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:02 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:02.865045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b400e-399e-4648-bfe6-8640eb799d5f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:02.899422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 121/247] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:02 2022] POST /identity/v3/users => generated 293 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:02.899422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609fb8b-b54e-4bdf-971e-b60a56aabe8a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:02.988996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:03.128010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b400e-399e-4648-bfe6-8640eb799d5f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:03.157595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609fb8b-b54e-4bdf-971e-b60a56aabe8a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:03.171136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46932b00-84d1-4251-b987-32e19400ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:03.171797 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46932b00-84d1-4251-b987-32e19400ba12 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:03.172081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46932b00-84d1-4251-b987-32e19400ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:03.172346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46932b00-84d1-4251-b987-32e19400ba12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:03.184825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46932b00-84d1-4251-b987-32e19400ba12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:03.189768 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-46932b00-84d1-4251-b987-32e19400ba12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:03.189960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:03.190924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:03.191712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:03.191712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:03.191712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:03.191712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:03.191712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:03.191712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:03.191712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:03.191712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:03.191712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:03.191712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:03.191712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:03.191712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:03.192378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 127/248] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:03.198491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46932b00-84d1-4251-b987-32e19400ba12 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:03.200612 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507f41a-748f-4d4c-a95d-8cbaafcffa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:03.217663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507f41a-748f-4d4c-a95d-8cbaafcffa85 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:03.217663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507f41a-748f-4d4c-a95d-8cbaafcffa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:03.217663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507f41a-748f-4d4c-a95d-8cbaafcffa85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:03.217663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507f41a-748f-4d4c-a95d-8cbaafcffa85 None admin] RBAC: Adding query filter params (role.id=a4aee179070047af9cda6fea5ed98558, scope.project.id=9bcee52eea134a719563c19653e9371c, user.id=403c0b99886e440087c811483f2eed5f) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:03.217663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507f41a-748f-4d4c-a95d-8cbaafcffa85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:03.217663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507f41a-748f-4d4c-a95d-8cbaafcffa85 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:03.218595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 122/249] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:02 2022] GET /identity/v3/role_assignments?user.id=403c0b99886e440087c811483f2eed5f&scope.project.id=9bcee52eea134a719563c19653e9371c&role.id=a4aee179070047af9cda6fea5ed98558 => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:03.366930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46932b00-84d1-4251-b987-32e19400ba12 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:03.382817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:03.420362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df702cd7-fd5a-4b72-8ed4-6c3b697d104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:03.420999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df702cd7-fd5a-4b72-8ed4-6c3b697d104e None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:03.421358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df702cd7-fd5a-4b72-8ed4-6c3b697d104e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:03.421805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df702cd7-fd5a-4b72-8ed4-6c3b697d104e None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:03.422791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df702cd7-fd5a-4b72-8ed4-6c3b697d104e None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df702cd7-fd5a-4b72-8ed4-6c3b697d104e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:03.424835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df702cd7-fd5a-4b72-8ed4-6c3b697d104e None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:03.439772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 128/250] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:03.453055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507f41a-748f-4d4c-a95d-8cbaafcffa85 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:03.566038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126adab8-da90-4cb4-bcde-fa87a1a978c6 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:03.566416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126adab8-da90-4cb4-bcde-fa87a1a978c6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:03.566626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126adab8-da90-4cb4-bcde-fa87a1a978c6 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:03.568267 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 129/251] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:03.574077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9ca00-66e8-4bd0-9e1c-cc4a847b5d9d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:03.574597 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9ca00-66e8-4bd0-9e1c-cc4a847b5d9d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:03.574867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9ca00-66e8-4bd0-9e1c-cc4a847b5d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:03.591679 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507f41a-748f-4d4c-a95d-8cbaafcffa85 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:03.600412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-41f9ca00-66e8-4bd0-9e1c-cc4a847b5d9d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:03.602398 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-41f9ca00-66e8-4bd0-9e1c-cc4a847b5d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:03.640519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9eff9-a09e-4e0a-b40d-0b64e9af7996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:03.641388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9eff9-a09e-4e0a-b40d-0b64e9af7996 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:03.641676 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9eff9-a09e-4e0a-b40d-0b64e9af7996 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:03.642082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9eff9-a09e-4e0a-b40d-0b64e9af7996 None admin] PATH_INFO: `/v3/users/b0eaf614bb23465fb143fcbcd6d6cd28` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:03.644867 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9eff9-a09e-4e0a-b40d-0b64e9af7996 None admin] RBAC: Authorizing `identity:get_user(user_id=b0eaf614bb23465fb143fcbcd6d6cd28)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:03.647263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9eff9-a09e-4e0a-b40d-0b64e9af7996 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:03.650312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 123/252] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:03 2022] GET /identity/v3/users/b0eaf614bb23465fb143fcbcd6d6cd28 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:03.659048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9eff9-a09e-4e0a-b40d-0b64e9af7996 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:03.737204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 130/253] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:03.740111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c030d7-8e32-4365-bcca-6746df212f8c None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:03.740601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c030d7-8e32-4365-bcca-6746df212f8c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:03.741085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c030d7-8e32-4365-bcca-6746df212f8c None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:03.743598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 131/254] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:03.760347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edbbf1-bb26-41c4-a6d5-7d6696e9ac06 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:03.760780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edbbf1-bb26-41c4-a6d5-7d6696e9ac06 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:03.761077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edbbf1-bb26-41c4-a6d5-7d6696e9ac06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:03.764377 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:03.798849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e9edbbf1-bb26-41c4-a6d5-7d6696e9ac06 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:03.800127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e9edbbf1-bb26-41c4-a6d5-7d6696e9ac06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:03.838634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9eff9-a09e-4e0a-b40d-0b64e9af7996 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:03.885220 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869127e0-5eac-4d62-a3d3-eabc8c675015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:03.886357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869127e0-5eac-4d62-a3d3-eabc8c675015 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:03.886885 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869127e0-5eac-4d62-a3d3-eabc8c675015 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:03.887365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869127e0-5eac-4d62-a3d3-eabc8c675015 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:03.888866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869127e0-5eac-4d62-a3d3-eabc8c675015 None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:03.890837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869127e0-5eac-4d62-a3d3-eabc8c675015 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:03.898129 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 124/255] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:03 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:03.901983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869127e0-5eac-4d62-a3d3-eabc8c675015 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:04.014341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 132/256] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:04.092575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869127e0-5eac-4d62-a3d3-eabc8c675015 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:04.126813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:04.132216 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c340931-5cd1-4614-80ef-d71d9a46bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:04.132936 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c340931-5cd1-4614-80ef-d71d9a46bf3f None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:04.133262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c340931-5cd1-4614-80ef-d71d9a46bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:04.133538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c340931-5cd1-4614-80ef-d71d9a46bf3f None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c/users/b0eaf614bb23465fb143fcbcd6d6cd28/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:04.136283 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c340931-5cd1-4614-80ef-d71d9a46bf3f None admin] RBAC: Authorizing `identity:create_grant(project_id=9bcee52eea134a719563c19653e9371c, user_id=b0eaf614bb23465fb143fcbcd6d6cd28, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:04.155744 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c340931-5cd1-4614-80ef-d71d9a46bf3f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:04.246153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 125/257] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:07:03 2022] PUT /identity/v3/projects/9bcee52eea134a719563c19653e9371c/users/b0eaf614bb23465fb143fcbcd6d6cd28/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:04.275269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edbbf1-bb26-41c4-a6d5-7d6696e9ac06 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:04.343344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:04.407824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c340931-5cd1-4614-80ef-d71d9a46bf3f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:04.453933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edbbf1-bb26-41c4-a6d5-7d6696e9ac06 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:04.518861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2413ea-39ff-4cc0-9fe2-706dd3b64ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:04.519515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2413ea-39ff-4cc0-9fe2-706dd3b64ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:04.519790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2413ea-39ff-4cc0-9fe2-706dd3b64ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:04.520052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2413ea-39ff-4cc0-9fe2-706dd3b64ca5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:04.557476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2413ea-39ff-4cc0-9fe2-706dd3b64ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-ee2413ea-39ff-4cc0-9fe2-706dd3b64ca5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:04.566010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:04.566982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:04.567756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 133/258] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:04.583903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2413ea-39ff-4cc0-9fe2-706dd3b64ca5 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:04.701359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c340931-5cd1-4614-80ef-d71d9a46bf3f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:04.804971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20389f24-e2cc-415e-8f2a-81fe66c27439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:04.808951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20389f24-e2cc-415e-8f2a-81fe66c27439 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:04.811375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20389f24-e2cc-415e-8f2a-81fe66c27439 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:04.812168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20389f24-e2cc-415e-8f2a-81fe66c27439 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:04.848078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20389f24-e2cc-415e-8f2a-81fe66c27439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:04.851889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-20389f24-e2cc-415e-8f2a-81fe66c27439 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:04.862891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:04.875980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:04.877601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 126/259] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:07:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:04.879872 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2413ea-39ff-4cc0-9fe2-706dd3b64ca5 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:04.881964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20389f24-e2cc-415e-8f2a-81fe66c27439 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:04.951055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153f380-3de6-4e70-b510-a41195c1f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:04.951701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153f380-3de6-4e70-b510-a41195c1f483 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:04.951994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153f380-3de6-4e70-b510-a41195c1f483 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:04.952270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153f380-3de6-4e70-b510-a41195c1f483 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:04.952973 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153f380-3de6-4e70-b510-a41195c1f483 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:04.953282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153f380-3de6-4e70-b510-a41195c1f483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:04.954787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153f380-3de6-4e70-b510-a41195c1f483 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:04.964521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 134/260] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:04.970567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153f380-3de6-4e70-b510-a41195c1f483 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:05.025301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:05.192246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153f380-3de6-4e70-b510-a41195c1f483 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:05.213278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20389f24-e2cc-415e-8f2a-81fe66c27439 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:05.276043 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa538f4-090a-4850-80a6-c833ed092229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:05.277445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa538f4-090a-4850-80a6-c833ed092229 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:05.277735 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa538f4-090a-4850-80a6-c833ed092229 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:05.277996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa538f4-090a-4850-80a6-c833ed092229 None admin] PATH_INFO: `/v3/users/d77c1d5014ca41b29b6cb3e680821ec6` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:05.278958 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273fbff-182e-4881-9920-ba8b779fc0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:05.280193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273fbff-182e-4881-9920-ba8b779fc0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:05.280669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273fbff-182e-4881-9920-ba8b779fc0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:05.281170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273fbff-182e-4881-9920-ba8b779fc0a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:05.282060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273fbff-182e-4881-9920-ba8b779fc0a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:05.282598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273fbff-182e-4881-9920-ba8b779fc0a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:05.283321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa538f4-090a-4850-80a6-c833ed092229 None admin] RBAC: Authorizing `identity:get_user(user_id=d77c1d5014ca41b29b6cb3e680821ec6)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:05.284461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273fbff-182e-4881-9920-ba8b779fc0a4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:05.284964 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa538f4-090a-4850-80a6-c833ed092229 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:05.286844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 135/261] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:04 2022] GET /identity/v3/users/d77c1d5014ca41b29b6cb3e680821ec6 => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:05.298306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa538f4-090a-4850-80a6-c833ed092229 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:05.304094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 127/262] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:05.312989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273fbff-182e-4881-9920-ba8b779fc0a4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:05.353358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:05.573993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa538f4-090a-4850-80a6-c833ed092229 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:05.622011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273fbff-182e-4881-9920-ba8b779fc0a4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:05.627005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48621ac-0d3e-4e9a-ba5d-e7f57c230745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:05.627653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48621ac-0d3e-4e9a-ba5d-e7f57c230745 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:05.627940 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48621ac-0d3e-4e9a-ba5d-e7f57c230745 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:05.628222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48621ac-0d3e-4e9a-ba5d-e7f57c230745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:05.653657 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:05.748778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f3869-7d73-4b15-86dc-0d323d29f712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:05.749912 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f3869-7d73-4b15-86dc-0d323d29f712 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:05.750478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f3869-7d73-4b15-86dc-0d323d29f712 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:05.751060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f3869-7d73-4b15-86dc-0d323d29f712 None admin] PATH_INFO: `/v3/users/d77c1d5014ca41b29b6cb3e680821ec6` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:05.751599 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48621ac-0d3e-4e9a-ba5d-e7f57c230745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:05.753253 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48621ac-0d3e-4e9a-ba5d-e7f57c230745 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:05.759741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f3869-7d73-4b15-86dc-0d323d29f712 None admin] RBAC: Authorizing `identity:get_user(user_id=d77c1d5014ca41b29b6cb3e680821ec6)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:05.763636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f3869-7d73-4b15-86dc-0d323d29f712 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:05.767282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 128/263] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:05 2022] GET /identity/v3/users/d77c1d5014ca41b29b6cb3e680821ec6 => generated 283 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:05.778799 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f3869-7d73-4b15-86dc-0d323d29f712 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:05.806646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:05.946836 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 136/264] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:05.952969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48621ac-0d3e-4e9a-ba5d-e7f57c230745 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:06.065351 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f3869-7d73-4b15-86dc-0d323d29f712 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:06.118158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48621ac-0d3e-4e9a-ba5d-e7f57c230745 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:06.187613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0d31d-1854-4771-890e-fbc53ecad9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:06.188245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0d31d-1854-4771-890e-fbc53ecad9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.188522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0d31d-1854-4771-890e-fbc53ecad9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.188790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0d31d-1854-4771-890e-fbc53ecad9d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.213119 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:06.256198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a4694-38b1-4ea8-988a-6f3517a68fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:06.256965 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a4694-38b1-4ea8-988a-6f3517a68fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.257258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a4694-38b1-4ea8-988a-6f3517a68fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.257522 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a4694-38b1-4ea8-988a-6f3517a68fd6 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.260022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a4694-38b1-4ea8-988a-6f3517a68fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:06.263151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a4694-38b1-4ea8-988a-6f3517a68fd6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:06.265110 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 137/265] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:05 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:06.271593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d39a5c-e4bc-4c78-92e8-a3f8ac6908ca None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.271869 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d39a5c-e4bc-4c78-92e8-a3f8ac6908ca None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.272172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d39a5c-e4bc-4c78-92e8-a3f8ac6908ca None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.274934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 138/266] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:06.274934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d39a5c-e4bc-4c78-92e8-a3f8ac6908ca None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:06.295313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:06.321820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0d31d-1854-4771-890e-fbc53ecad9d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:06.323450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0d31d-1854-4771-890e-fbc53ecad9d0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:06.519023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d39a5c-e4bc-4c78-92e8-a3f8ac6908ca None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:06.539860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 129/267] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 764 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:06.543871 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ce10e-2fb7-4d9f-a7ca-ec1a8519f7ed None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.544146 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ce10e-2fb7-4d9f-a7ca-ec1a8519f7ed None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.544442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ce10e-2fb7-4d9f-a7ca-ec1a8519f7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.571891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-418ce10e-2fb7-4d9f-a7ca-ec1a8519f7ed None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:06.574546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-418ce10e-2fb7-4d9f-a7ca-ec1a8519f7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:06.577733 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9a6b0-9505-4b58-b858-ec767f9c4bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:06.578384 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9a6b0-9505-4b58-b858-ec767f9c4bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.578661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9a6b0-9505-4b58-b858-ec767f9c4bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.578940 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9a6b0-9505-4b58-b858-ec767f9c4bb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.579698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9a6b0-9505-4b58-b858-ec767f9c4bb1 None admin] RBAC: Adding query filter params (role.id=3b2b994bb5314391bf684502bd09e733, scope.project.id=9bcee52eea134a719563c19653e9371c, user.id=d77c1d5014ca41b29b6cb3e680821ec6) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:06.580007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9a6b0-9505-4b58-b858-ec767f9c4bb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:06.581514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9a6b0-9505-4b58-b858-ec767f9c4bb1 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:06.592171 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 139/268] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:06 2022] GET /identity/v3/role_assignments?user.id=d77c1d5014ca41b29b6cb3e680821ec6&scope.project.id=9bcee52eea134a719563c19653e9371c&role.id=3b2b994bb5314391bf684502bd09e733 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:06.593170 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9a6b0-9505-4b58-b858-ec767f9c4bb1 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:06.664864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:06.720365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 130/269] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:06.722694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9a6b0-9505-4b58-b858-ec767f9c4bb1 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:06.723871 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764c9f9-3ded-4332-9fef-58cbfff42709 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.724665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764c9f9-3ded-4332-9fef-58cbfff42709 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.725431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764c9f9-3ded-4332-9fef-58cbfff42709 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.728482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 131/270] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:06.731799 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674533d5-0e46-485b-8cd0-6dbca804189c None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.732855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674533d5-0e46-485b-8cd0-6dbca804189c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.733616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674533d5-0e46-485b-8cd0-6dbca804189c None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.736729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 132/271] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:06.739767 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbdf0b-b1b2-4640-a2d1-6ecec6b68aa0 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.740643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbdf0b-b1b2-4640-a2d1-6ecec6b68aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.741822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbdf0b-b1b2-4640-a2d1-6ecec6b68aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.771707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4936be0-88ea-4079-b6ac-059d9091b2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:06.772274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4936be0-88ea-4079-b6ac-059d9091b2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.772562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4936be0-88ea-4079-b6ac-059d9091b2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.773133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4936be0-88ea-4079-b6ac-059d9091b2f3 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.774557 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4936be0-88ea-4079-b6ac-059d9091b2f3 None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:06.776104 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4936be0-88ea-4079-b6ac-059d9091b2f3 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:06.778048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-44cbdf0b-b1b2-4640-a2d1-6ecec6b68aa0 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:06.778942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 140/272] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:06 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:06.780331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c8d12-1198-4c31-94d7-3d83dd8b5488 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.780621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c8d12-1198-4c31-94d7-3d83dd8b5488 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.780896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c8d12-1198-4c31-94d7-3d83dd8b5488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.782099 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-44cbdf0b-b1b2-4640-a2d1-6ecec6b68aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:06.786528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:06.802141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6b0c8d12-1198-4c31-94d7-3d83dd8b5488 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:06.803359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6b0c8d12-1198-4c31-94d7-3d83dd8b5488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:06.938085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 133/273] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:06.940048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbdf0b-b1b2-4640-a2d1-6ecec6b68aa0 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:06.970868 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 141/274] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:07.113146 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbdf0b-b1b2-4640-a2d1-6ecec6b68aa0 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.161612 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9b9cd-cdc4-4744-a56e-9349c3ad1cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.162259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9b9cd-cdc4-4744-a56e-9349c3ad1cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.162555 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9b9cd-cdc4-4744-a56e-9349c3ad1cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.162829 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9b9cd-cdc4-4744-a56e-9349c3ad1cb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.163570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9b9cd-cdc4-4744-a56e-9349c3ad1cb8 None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=9bcee52eea134a719563c19653e9371c, user.id=d77c1d5014ca41b29b6cb3e680821ec6) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:07.163880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9b9cd-cdc4-4744-a56e-9349c3ad1cb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:07.165378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9b9cd-cdc4-4744-a56e-9349c3ad1cb8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:07.179806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 134/275] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:06 2022] GET /identity/v3/role_assignments?user.id=d77c1d5014ca41b29b6cb3e680821ec6&scope.project.id=9bcee52eea134a719563c19653e9371c&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:07.216577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c8d12-1198-4c31-94d7-3d83dd8b5488 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.308110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9b9cd-cdc4-4744-a56e-9349c3ad1cb8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.311561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:07.344093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:07.427389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c8d12-1198-4c31-94d7-3d83dd8b5488 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.462041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9b9cd-cdc4-4744-a56e-9349c3ad1cb8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.499871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097d6d8-2540-4f71-af9b-4b4adf60130d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.501443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097d6d8-2540-4f71-af9b-4b4adf60130d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.502265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097d6d8-2540-4f71-af9b-4b4adf60130d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.502786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097d6d8-2540-4f71-af9b-4b4adf60130d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.511923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333fe4-abea-45eb-b33c-1fb0cdbe0411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.512693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333fe4-abea-45eb-b33c-1fb0cdbe0411 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.512914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333fe4-abea-45eb-b33c-1fb0cdbe0411 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.513191 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333fe4-abea-45eb-b33c-1fb0cdbe0411 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.514602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333fe4-abea-45eb-b33c-1fb0cdbe0411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:07.516086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333fe4-abea-45eb-b33c-1fb0cdbe0411 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:07.518265 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 135/276] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:07.521897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333fe4-abea-45eb-b33c-1fb0cdbe0411 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.526109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097d6d8-2540-4f71-af9b-4b4adf60130d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-7097d6d8-2540-4f71-af9b-4b4adf60130d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:07.537342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:07.538396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:07.539161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:07.539161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:07.539161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:07.539161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:07.539161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:07.539161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:07.539161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:07.539161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:07.539161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:07.539161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:07.539161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:07.539161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:07.541432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 142/277] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:07.543312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097d6d8-2540-4f71-af9b-4b4adf60130d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.621771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:07.660013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333fe4-abea-45eb-b33c-1fb0cdbe0411 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.679715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097d6d8-2540-4f71-af9b-4b4adf60130d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.695737 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:07.703699 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e423b-2d89-4664-abd9-dc446330042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.704428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e423b-2d89-4664-abd9-dc446330042b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.704746 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e423b-2d89-4664-abd9-dc446330042b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.704979 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e423b-2d89-4664-abd9-dc446330042b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.717822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e423b-2d89-4664-abd9-dc446330042b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-e17e423b-2d89-4664-abd9-dc446330042b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:07.723381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:07.725477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 136/278] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:07.727316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e423b-2d89-4664-abd9-dc446330042b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.733782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509cbf9-0bf2-4b5f-8429-51af17871e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.734577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509cbf9-0bf2-4b5f-8429-51af17871e03 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.734853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509cbf9-0bf2-4b5f-8429-51af17871e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.735120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509cbf9-0bf2-4b5f-8429-51af17871e03 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.735788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509cbf9-0bf2-4b5f-8429-51af17871e03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:07.737364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509cbf9-0bf2-4b5f-8429-51af17871e03 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:07.806059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 143/279] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:07 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:07.809853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f269f-b5c3-4ac8-9ae6-f9cc179cfd7b None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.810723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f269f-b5c3-4ac8-9ae6-f9cc179cfd7b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.811479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f269f-b5c3-4ac8-9ae6-f9cc179cfd7b None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.813409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 144/280] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:07.815861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f269f-b5c3-4ac8-9ae6-f9cc179cfd7b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.929202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e423b-2d89-4664-abd9-dc446330042b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.990942 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:08.001951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f269f-b5c3-4ac8-9ae6-f9cc179cfd7b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.003335 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca9938-2863-4894-ad09-dc550c4c91ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.004312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca9938-2863-4894-ad09-dc550c4c91ce None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.012891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca9938-2863-4894-ad09-dc550c4c91ce None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.012891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca9938-2863-4894-ad09-dc550c4c91ce None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.012891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca9938-2863-4894-ad09-dc550c4c91ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:08.012891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca9938-2863-4894-ad09-dc550c4c91ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.012891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca9938-2863-4894-ad09-dc550c4c91ce None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.018337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 137/281] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:08.019763 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaefdba-a6b4-48ee-9511-f630a565ca45 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.020064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaefdba-a6b4-48ee-9511-f630a565ca45 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.020301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaefdba-a6b4-48ee-9511-f630a565ca45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.044852 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-bfaefdba-a6b4-48ee-9511-f630a565ca45 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:08.046110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bfaefdba-a6b4-48ee-9511-f630a565ca45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:08.064182 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d8f76-73cd-43e0-9208-b1345377bedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.065645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d8f76-73cd-43e0-9208-b1345377bedb None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.065802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d8f76-73cd-43e0-9208-b1345377bedb None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.066123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d8f76-73cd-43e0-9208-b1345377bedb None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.067338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d8f76-73cd-43e0-9208-b1345377bedb None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:08.067872 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d8f76-73cd-43e0-9208-b1345377bedb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.070564 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d8f76-73cd-43e0-9208-b1345377bedb None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.087112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 145/282] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:08.088009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d8f76-73cd-43e0-9208-b1345377bedb None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.148370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:08.191090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 138/283] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:08.192333 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaefdba-a6b4-48ee-9511-f630a565ca45 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.283211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d8f76-73cd-43e0-9208-b1345377bedb None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.366323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305ae84-87cb-485f-9b59-135ddde15126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.369565 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305ae84-87cb-485f-9b59-135ddde15126 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.372711 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305ae84-87cb-485f-9b59-135ddde15126 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.373508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305ae84-87cb-485f-9b59-135ddde15126 None admin] PATH_INFO: `/v3/users/403c0b99886e440087c811483f2eed5f` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.378937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305ae84-87cb-485f-9b59-135ddde15126 None admin] RBAC: Authorizing `identity:get_user(user_id=403c0b99886e440087c811483f2eed5f)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.383820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305ae84-87cb-485f-9b59-135ddde15126 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.388758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 146/284] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/users/403c0b99886e440087c811483f2eed5f => generated 297 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:08.395706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305ae84-87cb-485f-9b59-135ddde15126 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.399840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaefdba-a6b4-48ee-9511-f630a565ca45 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.472320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:08.494794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73bb95-c2bf-46b5-b1b8-fd052f78e7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.497204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73bb95-c2bf-46b5-b1b8-fd052f78e7ed None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.498848 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73bb95-c2bf-46b5-b1b8-fd052f78e7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.501236 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73bb95-c2bf-46b5-b1b8-fd052f78e7ed None admin] PATH_INFO: `/v3/users/8ee3f74104784435acd4e7a78db9ca0e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.540012 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73bb95-c2bf-46b5-b1b8-fd052f78e7ed None admin] RBAC: Authorizing `identity:get_user(user_id=8ee3f74104784435acd4e7a78db9ca0e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.544888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73bb95-c2bf-46b5-b1b8-fd052f78e7ed None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.551531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 139/285] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/users/8ee3f74104784435acd4e7a78db9ca0e => generated 293 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:08.553719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73bb95-c2bf-46b5-b1b8-fd052f78e7ed None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.587896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:08.593003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305ae84-87cb-485f-9b59-135ddde15126 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.667487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00715e4e-a558-4917-bbbc-8cbdcd40cd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.669093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00715e4e-a558-4917-bbbc-8cbdcd40cd38 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.669897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00715e4e-a558-4917-bbbc-8cbdcd40cd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.670691 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00715e4e-a558-4917-bbbc-8cbdcd40cd38 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.673280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00715e4e-a558-4917-bbbc-8cbdcd40cd38 None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.676660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00715e4e-a558-4917-bbbc-8cbdcd40cd38 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.680806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 147/286] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:08.683101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00715e4e-a558-4917-bbbc-8cbdcd40cd38 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.730482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73bb95-c2bf-46b5-b1b8-fd052f78e7ed None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.771557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a390c10-df9b-4c09-99d0-1a0ce8efbbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.772212 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a390c10-df9b-4c09-99d0-1a0ce8efbbca None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.772516 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a390c10-df9b-4c09-99d0-1a0ce8efbbca None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.773057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a390c10-df9b-4c09-99d0-1a0ce8efbbca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.786193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a390c10-df9b-4c09-99d0-1a0ce8efbbca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-1a390c10-df9b-4c09-99d0-1a0ce8efbbca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:08.791471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:08.795133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 140/287] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:08.796818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a390c10-df9b-4c09-99d0-1a0ce8efbbca None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.845326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:08.911311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00715e4e-a558-4917-bbbc-8cbdcd40cd38 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.915578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a390c10-df9b-4c09-99d0-1a0ce8efbbca None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.955947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567cba8-e7f7-4d0d-b9e9-91a675140ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.956638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567cba8-e7f7-4d0d-b9e9-91a675140ce1 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.956918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567cba8-e7f7-4d0d-b9e9-91a675140ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.957193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567cba8-e7f7-4d0d-b9e9-91a675140ce1 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c/users/403c0b99886e440087c811483f2eed5f/roles/a4aee179070047af9cda6fea5ed98558` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.959487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567cba8-e7f7-4d0d-b9e9-91a675140ce1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9bcee52eea134a719563c19653e9371c, user_id=403c0b99886e440087c811483f2eed5f, role_id=a4aee179070047af9cda6fea5ed98558)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.960996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567cba8-e7f7-4d0d-b9e9-91a675140ce1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.984942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53da770-9821-4d57-983e-a4d975f083e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.985612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53da770-9821-4d57-983e-a4d975f083e9 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.986189 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53da770-9821-4d57-983e-a4d975f083e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.987544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53da770-9821-4d57-983e-a4d975f083e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.987544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53da770-9821-4d57-983e-a4d975f083e9 None admin] RBAC: Adding query filter params (role.id=6721d4c1040945dd8817af24236acb65, user.id=8ee3f74104784435acd4e7a78db9ca0e, scope.system=all) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:08.987544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53da770-9821-4d57-983e-a4d975f083e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.988825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53da770-9821-4d57-983e-a4d975f083e9 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:09.002547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 148/288] 10.222.0.81 () {56 vars in 1308 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/role_assignments?user.id=8ee3f74104784435acd4e7a78db9ca0e&scope.system=all&role.id=6721d4c1040945dd8817af24236acb65 => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:09.002547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53da770-9821-4d57-983e-a4d975f083e9 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:09.043364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:09.057350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 141/289] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:07:08 2022] PUT /identity/v3/projects/9bcee52eea134a719563c19653e9371c/users/403c0b99886e440087c811483f2eed5f/roles/a4aee179070047af9cda6fea5ed98558 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:09.164009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53da770-9821-4d57-983e-a4d975f083e9 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:09.227589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce8be5-9d26-4f6b-bce7-e35195e725de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:09.228299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce8be5-9d26-4f6b-bce7-e35195e725de None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:09.228607 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce8be5-9d26-4f6b-bce7-e35195e725de None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:09.228882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce8be5-9d26-4f6b-bce7-e35195e725de None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:09.229858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce8be5-9d26-4f6b-bce7-e35195e725de None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:09.230295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce8be5-9d26-4f6b-bce7-e35195e725de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:09.231875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce8be5-9d26-4f6b-bce7-e35195e725de None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:09.246107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 149/290] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:09.252950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567cba8-e7f7-4d0d-b9e9-91a675140ce1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:09.389884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:09.394208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567cba8-e7f7-4d0d-b9e9-91a675140ce1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:09.441715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6c0b7-70e0-48db-9b07-429040dfe5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:09.442407 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6c0b7-70e0-48db-9b07-429040dfe5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:09.442683 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6c0b7-70e0-48db-9b07-429040dfe5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:09.442957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6c0b7-70e0-48db-9b07-429040dfe5e3 None admin] PATH_INFO: `/v3/users/b0eaf614bb23465fb143fcbcd6d6cd28` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:09.444218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6c0b7-70e0-48db-9b07-429040dfe5e3 None admin] RBAC: Authorizing `identity:get_user(user_id=b0eaf614bb23465fb143fcbcd6d6cd28)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:09.445690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6c0b7-70e0-48db-9b07-429040dfe5e3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:09.447408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 142/291] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:09 2022] GET /identity/v3/users/b0eaf614bb23465fb143fcbcd6d6cd28 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:09.454877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce8be5-9d26-4f6b-bce7-e35195e725de None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:09.613144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:09.631600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce8be5-9d26-4f6b-bce7-e35195e725de None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:09.707740 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e928b-663f-4093-8917-28c91df0bf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:09.708999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e928b-663f-4093-8917-28c91df0bf53 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:09.709624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e928b-663f-4093-8917-28c91df0bf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:09.710262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e928b-663f-4093-8917-28c91df0bf53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:09.796826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e928b-663f-4093-8917-28c91df0bf53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:09.798725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e928b-663f-4093-8917-28c91df0bf53 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:09.952386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:09.967828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 150/292] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:09.973580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6c0b7-70e0-48db-9b07-429040dfe5e3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:10.119734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6c0b7-70e0-48db-9b07-429040dfe5e3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:10.181400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19da3e-e0e3-472d-9e23-462b228bab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:10.182345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19da3e-e0e3-472d-9e23-462b228bab35 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:10.182889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19da3e-e0e3-472d-9e23-462b228bab35 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:10.183309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19da3e-e0e3-472d-9e23-462b228bab35 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:10.187176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19da3e-e0e3-472d-9e23-462b228bab35 None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:10.188881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19da3e-e0e3-472d-9e23-462b228bab35 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:10.190841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 143/293] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:09 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:10.197368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e928b-663f-4093-8917-28c91df0bf53 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:10.364474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e928b-663f-4093-8917-28c91df0bf53 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:10.414038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18971b86-1d49-41b2-9fe6-b2d28949e121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:10.414744 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18971b86-1d49-41b2-9fe6-b2d28949e121 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:10.415027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18971b86-1d49-41b2-9fe6-b2d28949e121 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:10.415297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18971b86-1d49-41b2-9fe6-b2d28949e121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:10.416044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18971b86-1d49-41b2-9fe6-b2d28949e121 None admin] RBAC: Adding query filter params (role.id=6721d4c1040945dd8817af24236acb65, scope.project.id=9bcee52eea134a719563c19653e9371c, user.id=b0eaf614bb23465fb143fcbcd6d6cd28) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:10.416350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18971b86-1d49-41b2-9fe6-b2d28949e121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:10.418382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18971b86-1d49-41b2-9fe6-b2d28949e121 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:10.425458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 151/294] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:10 2022] GET /identity/v3/role_assignments?user.id=b0eaf614bb23465fb143fcbcd6d6cd28&scope.project.id=9bcee52eea134a719563c19653e9371c&role.id=6721d4c1040945dd8817af24236acb65 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:10.702082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ec15-50c1-4b39-b568-d7d177931f65 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:10.703739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ec15-50c1-4b39-b568-d7d177931f65 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:10.704539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ec15-50c1-4b39-b568-d7d177931f65 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:10.707563 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 144/295] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:10.714639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660c71-baae-46ef-bf15-488ff5ae1841 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:10.714639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660c71-baae-46ef-bf15-488ff5ae1841 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:10.715615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660c71-baae-46ef-bf15-488ff5ae1841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:10.740536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ee660c71-baae-46ef-bf15-488ff5ae1841 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:10.741967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ee660c71-baae-46ef-bf15-488ff5ae1841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:10.817290 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:10.841015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 152/296] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:11.126134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406e5e9-a1c9-447e-bc28-56c129bb22f7 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.127044 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406e5e9-a1c9-447e-bc28-56c129bb22f7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.127844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406e5e9-a1c9-447e-bc28-56c129bb22f7 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.131687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 145/297] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:11.142086 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd249e-ea95-4e88-a3f5-7249e455680d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.143172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd249e-ea95-4e88-a3f5-7249e455680d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.143973 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd249e-ea95-4e88-a3f5-7249e455680d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.161034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406e5e9-a1c9-447e-bc28-56c129bb22f7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:11.180637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6abd249e-ea95-4e88-a3f5-7249e455680d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:11.182158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6abd249e-ea95-4e88-a3f5-7249e455680d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:11.205549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:11.284194 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 153/298] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:11.291374 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406e5e9-a1c9-447e-bc28-56c129bb22f7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:11.333212 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f649b02-aaeb-40cc-ae8e-dfd54e3abae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:11.333860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f649b02-aaeb-40cc-ae8e-dfd54e3abae7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.334140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f649b02-aaeb-40cc-ae8e-dfd54e3abae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.334436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f649b02-aaeb-40cc-ae8e-dfd54e3abae7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.335659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f649b02-aaeb-40cc-ae8e-dfd54e3abae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:11.337220 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f649b02-aaeb-40cc-ae8e-dfd54e3abae7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:11.340065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 146/299] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:11.349945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd249e-ea95-4e88-a3f5-7249e455680d None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:11.562013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd249e-ea95-4e88-a3f5-7249e455680d None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:11.597517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:11.632398 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d099f7c-af3d-4b97-85f0-63c4e99e8c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:11.633626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d099f7c-af3d-4b97-85f0-63c4e99e8c9c None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.634136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d099f7c-af3d-4b97-85f0-63c4e99e8c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.634675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d099f7c-af3d-4b97-85f0-63c4e99e8c9c None admin] PATH_INFO: `/v3/groups` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.636561 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d099f7c-af3d-4b97-85f0-63c4e99e8c9c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:11.640142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d099f7c-af3d-4b97-85f0-63c4e99e8c9c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:11.680625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f649b02-aaeb-40cc-ae8e-dfd54e3abae7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:11.761414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 154/300] 10.222.0.81 () {60 vars in 1134 bytes} [Mon Aug 29 20:07:11 2022] POST /identity/v3/groups => generated 229 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:11.851905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46fd82-da2e-4818-afb1-5248e401048e None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.852311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46fd82-da2e-4818-afb1-5248e401048e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.852802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46fd82-da2e-4818-afb1-5248e401048e None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.856277 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 155/301] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:11.860011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f649b02-aaeb-40cc-ae8e-dfd54e3abae7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:11.863974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908cf77-4928-4963-b096-1636e53c30a7 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.864578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908cf77-4928-4963-b096-1636e53c30a7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.865198 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:11.865966 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908cf77-4928-4963-b096-1636e53c30a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.888789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-2908cf77-4928-4963-b096-1636e53c30a7 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:11.891056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2908cf77-4928-4963-b096-1636e53c30a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:11.935865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f389cc-8fa4-40c0-b9d8-d37a301b868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:11.936999 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f389cc-8fa4-40c0-b9d8-d37a301b868c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.937501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f389cc-8fa4-40c0-b9d8-d37a301b868c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.937997 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f389cc-8fa4-40c0-b9d8-d37a301b868c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.960418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f389cc-8fa4-40c0-b9d8-d37a301b868c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-87f389cc-8fa4-40c0-b9d8-d37a301b868c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:11.967309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:11.968296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:11.969075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:11.969075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:11.969075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:11.969075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:11.969075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:11.969075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:11.969075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:11.969075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:11.969075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:11.969075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:11.969075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:11.969075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:11.975392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 147/302] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:07:11.975392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb9454-b92e-4d44-ba26-a203bba29e8e None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.975392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb9454-b92e-4d44-ba26-a203bba29e8e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.975392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb9454-b92e-4d44-ba26-a203bba29e8e None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.975392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 148/303] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:11.978157 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb9454-b92e-4d44-ba26-a203bba29e8e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:12.006292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 156/304] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:12.006292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86292a-a62f-47c8-a80c-e61587fb9c36 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:12.006292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86292a-a62f-47c8-a80c-e61587fb9c36 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:12.006605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86292a-a62f-47c8-a80c-e61587fb9c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:12.040715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-0d86292a-a62f-47c8-a80c-e61587fb9c36 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:12.042568 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-0d86292a-a62f-47c8-a80c-e61587fb9c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:12.153012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 157/305] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:12.200080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb9454-b92e-4d44-ba26-a203bba29e8e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:12.270855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338abb4-bffc-49ea-8a62-1abce7faeb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:12.272081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338abb4-bffc-49ea-8a62-1abce7faeb29 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:12.272577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338abb4-bffc-49ea-8a62-1abce7faeb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:12.273307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338abb4-bffc-49ea-8a62-1abce7faeb29 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:12.274544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338abb4-bffc-49ea-8a62-1abce7faeb29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:12.275071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338abb4-bffc-49ea-8a62-1abce7faeb29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:12.279591 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338abb4-bffc-49ea-8a62-1abce7faeb29 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:12.288368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86292a-a62f-47c8-a80c-e61587fb9c36 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:12.301782 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 149/306] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:12.307969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338abb4-bffc-49ea-8a62-1abce7faeb29 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:12.342371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:12.367074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:12.446468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86292a-a62f-47c8-a80c-e61587fb9c36 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:12.459538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338abb4-bffc-49ea-8a62-1abce7faeb29 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:12.503954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd07842-154e-471f-b6eb-7b7017fd4e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:12.504602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd07842-154e-471f-b6eb-7b7017fd4e6d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:12.504879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd07842-154e-471f-b6eb-7b7017fd4e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:12.505184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd07842-154e-471f-b6eb-7b7017fd4e6d None admin] PATH_INFO: `/v3/users/1f5a0baefea54835b6a064bca980b922` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:12.515628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a42038-5578-411f-aab5-64e76234f832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:12.516480 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a42038-5578-411f-aab5-64e76234f832 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:12.516918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a42038-5578-411f-aab5-64e76234f832 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:12.517214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a42038-5578-411f-aab5-64e76234f832 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:12.526012 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd07842-154e-471f-b6eb-7b7017fd4e6d None admin] RBAC: Authorizing `identity:get_user(user_id=1f5a0baefea54835b6a064bca980b922)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:12.528097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd07842-154e-471f-b6eb-7b7017fd4e6d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:12.530647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 150/307] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:12 2022] GET /identity/v3/users/1f5a0baefea54835b6a064bca980b922 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:12.531676 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd07842-154e-471f-b6eb-7b7017fd4e6d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:12.540455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a42038-5578-411f-aab5-64e76234f832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-78a42038-5578-411f-aab5-64e76234f832 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:12.552133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:12.553661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:12.555090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 158/308] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:12.555910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a42038-5578-411f-aab5-64e76234f832 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:12.696761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:12.699427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:12.708063 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a42038-5578-411f-aab5-64e76234f832 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:12.730089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd07842-154e-471f-b6eb-7b7017fd4e6d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:12.755995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3e317-86da-4370-af71-a0f2cce46766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:12.756622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3e317-86da-4370-af71-a0f2cce46766 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:12.757032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3e317-86da-4370-af71-a0f2cce46766 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:12.757314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3e317-86da-4370-af71-a0f2cce46766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:12.758074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3e317-86da-4370-af71-a0f2cce46766 None admin] RBAC: Adding query filter params (role.id=a4aee179070047af9cda6fea5ed98558, user.id=1f5a0baefea54835b6a064bca980b922, scope.system=all) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:12.758422 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3e317-86da-4370-af71-a0f2cce46766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:12.759945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3e317-86da-4370-af71-a0f2cce46766 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:12.767958 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 159/309] 10.222.0.81 () {56 vars in 1308 bytes} [Mon Aug 29 20:07:12 2022] GET /identity/v3/role_assignments?user.id=1f5a0baefea54835b6a064bca980b922&scope.system=all&role.id=a4aee179070047af9cda6fea5ed98558 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:12.768878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3e317-86da-4370-af71-a0f2cce46766 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:12.803404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb3893-55e1-47c6-bf25-e7ce68b502fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:12.804580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb3893-55e1-47c6-bf25-e7ce68b502fc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:12.805119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb3893-55e1-47c6-bf25-e7ce68b502fc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:12.805656 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb3893-55e1-47c6-bf25-e7ce68b502fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:12.827094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb3893-55e1-47c6-bf25-e7ce68b502fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-78fb3893-55e1-47c6-bf25-e7ce68b502fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:12.836695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:12.838523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:12.840346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 151/310] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:12.850640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb3893-55e1-47c6-bf25-e7ce68b502fc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:12.957664 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3e317-86da-4370-af71-a0f2cce46766 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:13.010906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49377f-d997-4d2b-8892-e1d1cd93c740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:13.012003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49377f-d997-4d2b-8892-e1d1cd93c740 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.012472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49377f-d997-4d2b-8892-e1d1cd93c740 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.012955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49377f-d997-4d2b-8892-e1d1cd93c740 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.014682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49377f-d997-4d2b-8892-e1d1cd93c740 None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:13.015282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49377f-d997-4d2b-8892-e1d1cd93c740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:13.017609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49377f-d997-4d2b-8892-e1d1cd93c740 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:13.037486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 160/311] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:13.039691 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49377f-d997-4d2b-8892-e1d1cd93c740 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:13.075676 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb3893-55e1-47c6-bf25-e7ce68b502fc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:13.101697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:13.147038 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288e642-5b06-44ea-8820-41af448e22da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:13.148305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e642-5b06-44ea-8820-41af448e22da None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.148792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e642-5b06-44ea-8820-41af448e22da None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.149391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e642-5b06-44ea-8820-41af448e22da None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.150647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288e642-5b06-44ea-8820-41af448e22da None admin] RBAC: Adding query filter params (name=reader) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:13.151247 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288e642-5b06-44ea-8820-41af448e22da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:13.156228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288e642-5b06-44ea-8820-41af448e22da None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:13.178468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 152/312] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:13.182636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288e642-5b06-44ea-8820-41af448e22da None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:13.201046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:13.254468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49377f-d997-4d2b-8892-e1d1cd93c740 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:13.337430 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d8e10-44f9-4124-89db-874d3b8a9e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:13.338864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8e10-44f9-4124-89db-874d3b8a9e1a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.339225 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8e10-44f9-4124-89db-874d3b8a9e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.339725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8e10-44f9-4124-89db-874d3b8a9e1a None admin] PATH_INFO: `/v3/users/8ee3f74104784435acd4e7a78db9ca0e` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.341863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d8e10-44f9-4124-89db-874d3b8a9e1a None admin] RBAC: Authorizing `identity:get_user(user_id=8ee3f74104784435acd4e7a78db9ca0e)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:13.344867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d8e10-44f9-4124-89db-874d3b8a9e1a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:13.348260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 161/313] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:13 2022] GET /identity/v3/users/8ee3f74104784435acd4e7a78db9ca0e => generated 293 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:13.362738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d8e10-44f9-4124-89db-874d3b8a9e1a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:13.381820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288e642-5b06-44ea-8820-41af448e22da None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:13.449397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c2674-05d8-401a-bc3b-e7a723b81fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:13.451671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c2674-05d8-401a-bc3b-e7a723b81fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.452308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c2674-05d8-401a-bc3b-e7a723b81fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.452913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c2674-05d8-401a-bc3b-e7a723b81fc6 None admin] PATH_INFO: `/v3/users/403c0b99886e440087c811483f2eed5f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.456444 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c2674-05d8-401a-bc3b-e7a723b81fc6 None admin] RBAC: Authorizing `identity:get_user(user_id=403c0b99886e440087c811483f2eed5f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:13.459934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c2674-05d8-401a-bc3b-e7a723b81fc6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:13.466274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 153/314] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:13 2022] GET /identity/v3/users/403c0b99886e440087c811483f2eed5f => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:13.472830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c2674-05d8-401a-bc3b-e7a723b81fc6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:13.570207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:13.588351 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d8e10-44f9-4124-89db-874d3b8a9e1a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:13.595125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:13.645931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c2674-05d8-401a-bc3b-e7a723b81fc6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:13.657843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d66347-f1a6-4b9b-b01c-e4be5bec27bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:13.659487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d66347-f1a6-4b9b-b01c-e4be5bec27bb None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.660264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d66347-f1a6-4b9b-b01c-e4be5bec27bb None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.660992 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d66347-f1a6-4b9b-b01c-e4be5bec27bb None admin] PATH_INFO: `/v3/system/users/8ee3f74104784435acd4e7a78db9ca0e/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.663874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d66347-f1a6-4b9b-b01c-e4be5bec27bb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8ee3f74104784435acd4e7a78db9ca0e, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:13.666883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d66347-f1a6-4b9b-b01c-e4be5bec27bb None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:13.705259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480820b-89e9-4e37-9050-a35478ba8f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:13.706119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480820b-89e9-4e37-9050-a35478ba8f6b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.706587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480820b-89e9-4e37-9050-a35478ba8f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.707017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480820b-89e9-4e37-9050-a35478ba8f6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.756127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 162/315] 10.222.0.81 () {58 vars in 1334 bytes} [Mon Aug 29 20:07:13 2022] PUT /identity/v3/system/users/8ee3f74104784435acd4e7a78db9ca0e/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:13.795854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480820b-89e9-4e37-9050-a35478ba8f6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:13.797473 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480820b-89e9-4e37-9050-a35478ba8f6b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:13.893551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:13.928894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 154/316] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:13.938593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d66347-f1a6-4b9b-b01c-e4be5bec27bb None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:14.084482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d66347-f1a6-4b9b-b01c-e4be5bec27bb None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:14.149926 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a914e7a-c827-49c8-be1d-46a41fab5af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:14.150976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914e7a-c827-49c8-be1d-46a41fab5af6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:14.151544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914e7a-c827-49c8-be1d-46a41fab5af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:14.152038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914e7a-c827-49c8-be1d-46a41fab5af6 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.154269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a914e7a-c827-49c8-be1d-46a41fab5af6 None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:14.156887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a914e7a-c827-49c8-be1d-46a41fab5af6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:14.160622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 163/317] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:13 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:14.170872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480820b-89e9-4e37-9050-a35478ba8f6b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:14.267399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8bb4e-d8da-4d6f-b345-0338b730f209 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:14.267956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8bb4e-d8da-4d6f-b345-0338b730f209 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:14.268366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8bb4e-d8da-4d6f-b345-0338b730f209 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.274552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 164/318] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:14.276901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ee07f-b0b5-4146-a6fd-eb094704169a None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:14.277350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ee07f-b0b5-4146-a6fd-eb094704169a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:14.277820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ee07f-b0b5-4146-a6fd-eb094704169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.298602 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ac9ee07f-b0b5-4146-a6fd-eb094704169a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:14.299908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ac9ee07f-b0b5-4146-a6fd-eb094704169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:14.331413 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480820b-89e9-4e37-9050-a35478ba8f6b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:14.358826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:14.374240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b6af9-8c22-40fb-a9fd-f50bf85a8739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:14.374999 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b6af9-8c22-40fb-a9fd-f50bf85a8739 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:14.375353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b6af9-8c22-40fb-a9fd-f50bf85a8739 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:14.375687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b6af9-8c22-40fb-a9fd-f50bf85a8739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.377525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b6af9-8c22-40fb-a9fd-f50bf85a8739 None admin] RBAC: Adding query filter params (role.id=a4aee179070047af9cda6fea5ed98558, scope.project.id=9bcee52eea134a719563c19653e9371c, user.id=403c0b99886e440087c811483f2eed5f) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:14.377525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b6af9-8c22-40fb-a9fd-f50bf85a8739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:14.378523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b6af9-8c22-40fb-a9fd-f50bf85a8739 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:14.390257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 155/319] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:14 2022] GET /identity/v3/role_assignments?user.id=403c0b99886e440087c811483f2eed5f&scope.project.id=9bcee52eea134a719563c19653e9371c&role.id=a4aee179070047af9cda6fea5ed98558 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:14.428472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 165/320] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:14.711779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b6af9-8c22-40fb-a9fd-f50bf85a8739 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:14.766837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:14.842995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b6af9-8c22-40fb-a9fd-f50bf85a8739 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:14.882777 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27620639-0143-49ab-a97e-fa4bb1eb7ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:14.883429 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27620639-0143-49ab-a97e-fa4bb1eb7ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:14.883710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27620639-0143-49ab-a97e-fa4bb1eb7ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:14.884008 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27620639-0143-49ab-a97e-fa4bb1eb7ae2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.887788 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27620639-0143-49ab-a97e-fa4bb1eb7ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:14.889270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27620639-0143-49ab-a97e-fa4bb1eb7ae2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:14.891303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 156/321] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:14.897658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ee07f-b0b5-4146-a6fd-eb094704169a None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:15.094060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ee07f-b0b5-4146-a6fd-eb094704169a None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:15.159888 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37845ec3-d20f-4050-9986-c0adb3c1103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:15.160970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37845ec3-d20f-4050-9986-c0adb3c1103c None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:15.161476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37845ec3-d20f-4050-9986-c0adb3c1103c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:15.161972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37845ec3-d20f-4050-9986-c0adb3c1103c None admin] PATH_INFO: `/v3/groups` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:15.163228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37845ec3-d20f-4050-9986-c0adb3c1103c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:15.166110 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37845ec3-d20f-4050-9986-c0adb3c1103c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:15.287462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 166/322] 10.222.0.81 () {60 vars in 1134 bytes} [Mon Aug 29 20:07:14 2022] POST /identity/v3/groups => generated 226 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:15.495882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc550a7-b547-4ffe-a61d-44ce0b86e86d None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:15.496484 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc550a7-b547-4ffe-a61d-44ce0b86e86d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:15.496861 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc550a7-b547-4ffe-a61d-44ce0b86e86d None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:15.499645 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 157/323] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:15.508233 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca6d1c-72c8-4f02-90b4-9cc0e86b09eb None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:15.508708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca6d1c-72c8-4f02-90b4-9cc0e86b09eb None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:15.509180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca6d1c-72c8-4f02-90b4-9cc0e86b09eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:15.539980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a2ca6d1c-72c8-4f02-90b4-9cc0e86b09eb None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:15.542558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a2ca6d1c-72c8-4f02-90b4-9cc0e86b09eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:15.556370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:15.669155 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 167/324] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:16.165968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc550a7-b547-4ffe-a61d-44ce0b86e86d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:16.383115 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc550a7-b547-4ffe-a61d-44ce0b86e86d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:16.398287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:16.456752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7f64e-69b7-4867-8099-322a0b5184d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:16.457766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7f64e-69b7-4867-8099-322a0b5184d0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.458289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7f64e-69b7-4867-8099-322a0b5184d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.458826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7f64e-69b7-4867-8099-322a0b5184d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.480488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7f64e-69b7-4867-8099-322a0b5184d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-ffa7f64e-69b7-4867-8099-322a0b5184d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:16.490070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:16.491226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:16.492007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:16.492007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:16.492007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:16.492007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:16.492007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:16.492007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:16.492007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:16.492007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:16.492007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:16.492007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:16.492007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:16.492007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:16.492587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 158/325] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:16.502885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca6d1c-72c8-4f02-90b4-9cc0e86b09eb None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:16.702113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bef45-4be2-41a8-bae9-3c21e1029caa None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.702913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bef45-4be2-41a8-bae9-3c21e1029caa None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.702913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bef45-4be2-41a8-bae9-3c21e1029caa None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.704111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 159/326] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:16.710139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9dca5-99b8-4053-a55e-9d1440407f69 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.710414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9dca5-99b8-4053-a55e-9d1440407f69 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.710649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9dca5-99b8-4053-a55e-9d1440407f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.720559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca6d1c-72c8-4f02-90b4-9cc0e86b09eb None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:16.746655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-79f9dca5-99b8-4053-a55e-9d1440407f69 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:16.746655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-79f9dca5-99b8-4053-a55e-9d1440407f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:16.772493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29ce8d-fc6c-49de-a7db-8c5d5c7b2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:16.773444 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29ce8d-fc6c-49de-a7db-8c5d5c7b2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.773802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29ce8d-fc6c-49de-a7db-8c5d5c7b2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.774157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29ce8d-fc6c-49de-a7db-8c5d5c7b2cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.774950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29ce8d-fc6c-49de-a7db-8c5d5c7b2cd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:16.775256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29ce8d-fc6c-49de-a7db-8c5d5c7b2cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:16.777361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29ce8d-fc6c-49de-a7db-8c5d5c7b2cd4 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:16.787741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 168/327] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:16.799531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29ce8d-fc6c-49de-a7db-8c5d5c7b2cd4 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:16.804719 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:16.928829 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 160/328] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:16.937333 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29ce8d-fc6c-49de-a7db-8c5d5c7b2cd4 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:16.989092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80843b-49ed-49e4-94f3-5efdb23ae2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:16.989641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80843b-49ed-49e4-94f3-5efdb23ae2df None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.989929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80843b-49ed-49e4-94f3-5efdb23ae2df None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.990203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80843b-49ed-49e4-94f3-5efdb23ae2df None admin] PATH_INFO: `/v3/users/1f5a0baefea54835b6a064bca980b922` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.995205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80843b-49ed-49e4-94f3-5efdb23ae2df None admin] RBAC: Authorizing `identity:get_user(user_id=1f5a0baefea54835b6a064bca980b922)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:16.996816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80843b-49ed-49e4-94f3-5efdb23ae2df None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:16.998950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 169/329] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:16 2022] GET /identity/v3/users/1f5a0baefea54835b6a064bca980b922 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:17.008240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9dca5-99b8-4053-a55e-9d1440407f69 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:17.183837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:17.195421 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9dca5-99b8-4053-a55e-9d1440407f69 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:17.239836 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503ffcc-8d29-4859-a5e7-a702ffcc42ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:17.240507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503ffcc-8d29-4859-a5e7-a702ffcc42ee None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:17.240792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503ffcc-8d29-4859-a5e7-a702ffcc42ee None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:17.241067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503ffcc-8d29-4859-a5e7-a702ffcc42ee None admin] PATH_INFO: `/v3/system/users/1f5a0baefea54835b6a064bca980b922/roles/a4aee179070047af9cda6fea5ed98558` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:17.242690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503ffcc-8d29-4859-a5e7-a702ffcc42ee None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1f5a0baefea54835b6a064bca980b922, role_id=a4aee179070047af9cda6fea5ed98558)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:17.244235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503ffcc-8d29-4859-a5e7-a702ffcc42ee None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:17.310010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 161/330] 10.222.0.81 () {58 vars in 1334 bytes} [Mon Aug 29 20:07:17 2022] PUT /identity/v3/system/users/1f5a0baefea54835b6a064bca980b922/roles/a4aee179070047af9cda6fea5ed98558 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:07:17.475924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80843b-49ed-49e4-94f3-5efdb23ae2df None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:17.584389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:17.627087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80843b-49ed-49e4-94f3-5efdb23ae2df None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:17.672632 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1be0c-c871-40ec-ba73-ea254916e727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:17.673298 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1be0c-c871-40ec-ba73-ea254916e727 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:17.673582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1be0c-c871-40ec-ba73-ea254916e727 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:17.673858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1be0c-c871-40ec-ba73-ea254916e727 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:17.689892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1be0c-c871-40ec-ba73-ea254916e727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-9ea1be0c-c871-40ec-ba73-ea254916e727 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:17.695566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:17.696497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:17.697255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 170/331] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:17.704789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503ffcc-8d29-4859-a5e7-a702ffcc42ee None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:17.864896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503ffcc-8d29-4859-a5e7-a702ffcc42ee None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:17.919152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7d188-03e8-47ba-8702-9cd3f8cadad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:17.919850 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7d188-03e8-47ba-8702-9cd3f8cadad9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:17.920129 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7d188-03e8-47ba-8702-9cd3f8cadad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:17.920403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7d188-03e8-47ba-8702-9cd3f8cadad9 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:17.921114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7d188-03e8-47ba-8702-9cd3f8cadad9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:17.921419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7d188-03e8-47ba-8702-9cd3f8cadad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:17.926252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7d188-03e8-47ba-8702-9cd3f8cadad9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:17.926582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a1e6b-704c-45e8-a6b2-2b63f7287587 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:17.926582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a1e6b-704c-45e8-a6b2-2b63f7287587 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:17.926582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a1e6b-704c-45e8-a6b2-2b63f7287587 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:17.927446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 171/332] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:17.934130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b150c8-c90c-47bb-bd4e-2097e1d0f886 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:17.934807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b150c8-c90c-47bb-bd4e-2097e1d0f886 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:17.935284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b150c8-c90c-47bb-bd4e-2097e1d0f886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:17.938561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 162/333] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:17.943836 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7d188-03e8-47ba-8702-9cd3f8cadad9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:17.975414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-79b150c8-c90c-47bb-bd4e-2097e1d0f886 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:17.977024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-79b150c8-c90c-47bb-bd4e-2097e1d0f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:17.986138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:18.098168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 172/334] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:18.157631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7d188-03e8-47ba-8702-9cd3f8cadad9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:18.235500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23abd6-9ae7-45e9-9c8a-95fb439c598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:18.236587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23abd6-9ae7-45e9-9c8a-95fb439c598e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:18.237084 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23abd6-9ae7-45e9-9c8a-95fb439c598e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:18.237589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23abd6-9ae7-45e9-9c8a-95fb439c598e None admin] PATH_INFO: `/v3/users/8ee3f74104784435acd4e7a78db9ca0e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:18.240483 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23abd6-9ae7-45e9-9c8a-95fb439c598e None admin] RBAC: Authorizing `identity:get_user(user_id=8ee3f74104784435acd4e7a78db9ca0e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:18.243410 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23abd6-9ae7-45e9-9c8a-95fb439c598e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:18.249170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 163/335] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:17 2022] GET /identity/v3/users/8ee3f74104784435acd4e7a78db9ca0e => generated 293 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:18.254120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b150c8-c90c-47bb-bd4e-2097e1d0f886 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:18.380419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:18.438760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b150c8-c90c-47bb-bd4e-2097e1d0f886 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:18.490743 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad79e8-586f-47ae-a62c-e72e570a6186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:18.491376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad79e8-586f-47ae-a62c-e72e570a6186 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:18.491655 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad79e8-586f-47ae-a62c-e72e570a6186 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:18.491928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad79e8-586f-47ae-a62c-e72e570a6186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:18.492683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad79e8-586f-47ae-a62c-e72e570a6186 None admin] RBAC: Adding query filter params (role.id=6721d4c1040945dd8817af24236acb65, user.id=8ee3f74104784435acd4e7a78db9ca0e, scope.system=all) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:18.492996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad79e8-586f-47ae-a62c-e72e570a6186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:18.494566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad79e8-586f-47ae-a62c-e72e570a6186 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:18.515016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 173/336] 10.222.0.81 () {56 vars in 1308 bytes} [Mon Aug 29 20:07:18 2022] GET /identity/v3/role_assignments?user.id=8ee3f74104784435acd4e7a78db9ca0e&scope.system=all&role.id=6721d4c1040945dd8817af24236acb65 => generated 510 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:18.605657 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23abd6-9ae7-45e9-9c8a-95fb439c598e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:18.737224 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:18.754888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23abd6-9ae7-45e9-9c8a-95fb439c598e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:18.822050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604030a3-21ad-4e4c-a662-bf0c5ed6a2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:18.822780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604030a3-21ad-4e4c-a662-bf0c5ed6a2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:18.823158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604030a3-21ad-4e4c-a662-bf0c5ed6a2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:18.823435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604030a3-21ad-4e4c-a662-bf0c5ed6a2e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:18.836390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604030a3-21ad-4e4c-a662-bf0c5ed6a2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-604030a3-21ad-4e4c-a662-bf0c5ed6a2e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:18.842509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:18.843408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:18.844202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:18.844202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:18.844202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:18.844202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:18.844202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:18.844202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:18.844202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:18.844202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:18.844202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:18.844202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:18.844202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:18.844202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:18.845328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 164/337] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:18.850751 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad79e8-586f-47ae-a62c-e72e570a6186 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:19.021660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad79e8-586f-47ae-a62c-e72e570a6186 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:19.051260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:19.073762 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fcc27-ffc2-4c16-a952-bcd11892c3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:19.074563 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fcc27-ffc2-4c16-a952-bcd11892c3ca None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:19.074845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fcc27-ffc2-4c16-a952-bcd11892c3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:19.075114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fcc27-ffc2-4c16-a952-bcd11892c3ca None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:19.075808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fcc27-ffc2-4c16-a952-bcd11892c3ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:19.076109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fcc27-ffc2-4c16-a952-bcd11892c3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:19.077527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fcc27-ffc2-4c16-a952-bcd11892c3ca None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:19.088136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 174/338] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:19.097581 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604030a3-21ad-4e4c-a662-bf0c5ed6a2e2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:19.255045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604030a3-21ad-4e4c-a662-bf0c5ed6a2e2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:19.317224 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c94dab-f508-433c-8504-5457c69decbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:19.318255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c94dab-f508-433c-8504-5457c69decbc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:19.318778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c94dab-f508-433c-8504-5457c69decbc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:19.319282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c94dab-f508-433c-8504-5457c69decbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:19.362209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:19.488890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c94dab-f508-433c-8504-5457c69decbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:19.492287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c94dab-f508-433c-8504-5457c69decbc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:19.716552 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 165/339] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:19.725625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fcc27-ffc2-4c16-a952-bcd11892c3ca None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:19.909458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fcc27-ffc2-4c16-a952-bcd11892c3ca None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:19.994064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8787c6-da32-4324-bf16-5baa9cc4ea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:19.995437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8787c6-da32-4324-bf16-5baa9cc4ea11 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:19.995910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8787c6-da32-4324-bf16-5baa9cc4ea11 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:19.996397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8787c6-da32-4324-bf16-5baa9cc4ea11 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.004048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8787c6-da32-4324-bf16-5baa9cc4ea11 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:20.006995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8787c6-da32-4324-bf16-5baa9cc4ea11 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:20.011509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 175/340] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:19 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:20.020535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c94dab-f508-433c-8504-5457c69decbc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:20.051928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a88d01-83ea-4ea2-8087-45dde973b511 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.052419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a88d01-83ea-4ea2-8087-45dde973b511 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.052893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a88d01-83ea-4ea2-8087-45dde973b511 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.055898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 176/341] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:20.065449 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328c11b-b83f-4ece-81a3-bd364e7332a5 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.065935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328c11b-b83f-4ece-81a3-bd364e7332a5 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.066426 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328c11b-b83f-4ece-81a3-bd364e7332a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.114179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e328c11b-b83f-4ece-81a3-bd364e7332a5 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:20.116322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e328c11b-b83f-4ece-81a3-bd364e7332a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:20.117445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:20.245418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:20.272568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c94dab-f508-433c-8504-5457c69decbc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:20.291352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 177/342] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:20.305672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba992f0-1e34-40c7-a1f0-a70176c45ad7 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.306513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba992f0-1e34-40c7-a1f0-a70176c45ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.307085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba992f0-1e34-40c7-a1f0-a70176c45ad7 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.311685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 178/343] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:20.321932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a7d66-6316-49dc-a92d-4ebe09ccd161 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.322922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a7d66-6316-49dc-a92d-4ebe09ccd161 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.329149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a7d66-6316-49dc-a92d-4ebe09ccd161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.354274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5273062-995e-42ad-81e5-c3fdcaa95bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:20.355151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5273062-995e-42ad-81e5-c3fdcaa95bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.355442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5273062-995e-42ad-81e5-c3fdcaa95bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.355733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5273062-995e-42ad-81e5-c3fdcaa95bb6 None admin] PATH_INFO: `/v3/groups/d68d7afdc3254505b48996933bc260ad` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.375256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ee2a7d66-6316-49dc-a92d-4ebe09ccd161 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:20.378147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ee2a7d66-6316-49dc-a92d-4ebe09ccd161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:20.380033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5273062-995e-42ad-81e5-c3fdcaa95bb6 None admin] RBAC: Authorizing `identity:get_group(group_id=d68d7afdc3254505b48996933bc260ad)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:20.381721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5273062-995e-42ad-81e5-c3fdcaa95bb6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:20.384110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 166/344] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:20 2022] GET /identity/v3/groups/d68d7afdc3254505b48996933bc260ad => generated 226 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:20.416009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5273062-995e-42ad-81e5-c3fdcaa95bb6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:20.567173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 179/345] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:20.676228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5273062-995e-42ad-81e5-c3fdcaa95bb6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:20.704414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:20.752312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f3d7f-a0c0-4cc8-8a2b-0962274b08ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:20.753219 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3d7f-a0c0-4cc8-8a2b-0962274b08ff None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.753681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3d7f-a0c0-4cc8-8a2b-0962274b08ff None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.754101 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3d7f-a0c0-4cc8-8a2b-0962274b08ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.755335 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f3d7f-a0c0-4cc8-8a2b-0962274b08ff None admin] RBAC: Adding query filter params (group.id=d68d7afdc3254505b48996933bc260ad, role.id=6721d4c1040945dd8817af24236acb65, scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:20.755838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f3d7f-a0c0-4cc8-8a2b-0962274b08ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:20.758415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f3d7f-a0c0-4cc8-8a2b-0962274b08ff None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:20.773843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 167/346] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:20 2022] GET /identity/v3/role_assignments?group.id=d68d7afdc3254505b48996933bc260ad&scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60&role.id=6721d4c1040945dd8817af24236acb65 => generated 260 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:20.975545 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a7d66-6316-49dc-a92d-4ebe09ccd161 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:21.112978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a7d66-6316-49dc-a92d-4ebe09ccd161 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:21.126348 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:21.161953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0c5b5-74bf-4ebe-9e43-4d43364fc4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:21.162640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0c5b5-74bf-4ebe-9e43-4d43364fc4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.162919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0c5b5-74bf-4ebe-9e43-4d43364fc4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.163188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0c5b5-74bf-4ebe-9e43-4d43364fc4a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.179468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0c5b5-74bf-4ebe-9e43-4d43364fc4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-a7a0c5b5-74bf-4ebe-9e43-4d43364fc4a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:21.184844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:21.185788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:21.186589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 180/347] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:21.192897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f3d7f-a0c0-4cc8-8a2b-0962274b08ff None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:21.210115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0c5b5-74bf-4ebe-9e43-4d43364fc4a1 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:21.387099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0c5b5-74bf-4ebe-9e43-4d43364fc4a1 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:21.417727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f3d7f-a0c0-4cc8-8a2b-0962274b08ff None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:21.491408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdfb56-9889-4d4a-a74f-3925f6512fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:21.492575 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdfb56-9889-4d4a-a74f-3925f6512fef None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.493045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdfb56-9889-4d4a-a74f-3925f6512fef None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.493531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdfb56-9889-4d4a-a74f-3925f6512fef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.494009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce4e7c-9ac0-4094-9bd4-948fb7761d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:21.494832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce4e7c-9ac0-4094-9bd4-948fb7761d7d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.495684 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce4e7c-9ac0-4094-9bd4-948fb7761d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.496359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce4e7c-9ac0-4094-9bd4-948fb7761d7d None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.497378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce4e7c-9ac0-4094-9bd4-948fb7761d7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:21.497682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce4e7c-9ac0-4094-9bd4-948fb7761d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:21.499132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce4e7c-9ac0-4094-9bd4-948fb7761d7d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:21.513543 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 168/348] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:21.514984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be778dc7-1507-4f53-b08d-d7be37cead21 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.515273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be778dc7-1507-4f53-b08d-d7be37cead21 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.515599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be778dc7-1507-4f53-b08d-d7be37cead21 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.517248 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 169/349] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:21.524864 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae45d2-3856-4b67-a487-45c25fcd02b0 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.525183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae45d2-3856-4b67-a487-45c25fcd02b0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.525400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae45d2-3856-4b67-a487-45c25fcd02b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.529474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdfb56-9889-4d4a-a74f-3925f6512fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-3dcdfb56-9889-4d4a-a74f-3925f6512fef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:21.542184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:21.543517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:21.544311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:21.544311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:21.544311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:21.544311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:21.544311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:21.544311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:21.544311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:21.544311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:21.544311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:21.544311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:21.544311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:21.544311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:21.545388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 181/350] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:21.547553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdfb56-9889-4d4a-a74f-3925f6512fef None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:21.567520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1eae45d2-3856-4b67-a487-45c25fcd02b0 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:21.569436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1eae45d2-3856-4b67-a487-45c25fcd02b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:21.626458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:21.691558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:21.766784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 170/351] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:21.767781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae45d2-3856-4b67-a487-45c25fcd02b0 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:21.831098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdfb56-9889-4d4a-a74f-3925f6512fef None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:21.928325 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403e6b3-a26b-4c5a-9a26-5d672eaf0c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:21.929342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403e6b3-a26b-4c5a-9a26-5d672eaf0c73 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.929832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403e6b3-a26b-4c5a-9a26-5d672eaf0c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.930408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403e6b3-a26b-4c5a-9a26-5d672eaf0c73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.996949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae45d2-3856-4b67-a487-45c25fcd02b0 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.044294 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036eee2-60fb-4e95-a211-5696e457b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.045318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036eee2-60fb-4e95-a211-5696e457b59b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.045765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036eee2-60fb-4e95-a211-5696e457b59b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.046203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036eee2-60fb-4e95-a211-5696e457b59b None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.047068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036eee2-60fb-4e95-a211-5696e457b59b None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:22.047516 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036eee2-60fb-4e95-a211-5696e457b59b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:22.049066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036eee2-60fb-4e95-a211-5696e457b59b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:22.061468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 171/352] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:22.063584 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282d93f-abcf-4bb4-9784-68123baf110b None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.064178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282d93f-abcf-4bb4-9784-68123baf110b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.064593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282d93f-abcf-4bb4-9784-68123baf110b None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.068106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 172/353] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:22.069979 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe660914-7d20-42b4-a077-083fde05ce6c None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.070594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe660914-7d20-42b4-a077-083fde05ce6c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.071135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe660914-7d20-42b4-a077-083fde05ce6c None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.073019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 173/354] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:22.074104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe660914-7d20-42b4-a077-083fde05ce6c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.089783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403e6b3-a26b-4c5a-9a26-5d672eaf0c73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:22.093073 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403e6b3-a26b-4c5a-9a26-5d672eaf0c73 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:22.120006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.162639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.211383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe660914-7d20-42b4-a077-083fde05ce6c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.267668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 182/355] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:22.269096 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3302d-91ed-42aa-9ec5-49c3ba58a40b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.269387 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3302d-91ed-42aa-9ec5-49c3ba58a40b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.269664 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3302d-91ed-42aa-9ec5-49c3ba58a40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.273434 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da049e68-e717-4fd1-8178-99692fe15d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.274168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da049e68-e717-4fd1-8178-99692fe15d12 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.274504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da049e68-e717-4fd1-8178-99692fe15d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.274889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da049e68-e717-4fd1-8178-99692fe15d12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.290704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d1b3302d-91ed-42aa-9ec5-49c3ba58a40b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:22.292513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d1b3302d-91ed-42aa-9ec5-49c3ba58a40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:22.389890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da049e68-e717-4fd1-8178-99692fe15d12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:22.390830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da049e68-e717-4fd1-8178-99692fe15d12 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:22.422832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 183/356] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:22.425301 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb79e-fd5d-4975-a938-8459487ae066 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.426102 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb79e-fd5d-4975-a938-8459487ae066 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.426843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb79e-fd5d-4975-a938-8459487ae066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.452539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.462773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-938fb79e-fd5d-4975-a938-8459487ae066 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:22.466330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-938fb79e-fd5d-4975-a938-8459487ae066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:22.571128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.596443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 184/357] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:22.598452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fb79e-fd5d-4975-a938-8459487ae066 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.629712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 174/358] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:22.631406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da049e68-e717-4fd1-8178-99692fe15d12 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.822043 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fb79e-fd5d-4975-a938-8459487ae066 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.884546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bb82a-dc87-4361-a5e3-e103bceac044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.886594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bb82a-dc87-4361-a5e3-e103bceac044 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.887335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bb82a-dc87-4361-a5e3-e103bceac044 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.888085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bb82a-dc87-4361-a5e3-e103bceac044 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.894253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da049e68-e717-4fd1-8178-99692fe15d12 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.909829 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bb82a-dc87-4361-a5e3-e103bceac044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-692bb82a-dc87-4361-a5e3-e103bceac044 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:22.920248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:22.921962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:22.923510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:22.923510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:22.923510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:22.923510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:22.923510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:22.923510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:22.923510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:22.923510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:22.923510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:22.923510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:22.923510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:22.923510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:22.927229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 185/359] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:22.928388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bb82a-dc87-4361-a5e3-e103bceac044 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.972482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.983104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396ebf2-4036-4333-8d52-7ed49fa0ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.984117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396ebf2-4036-4333-8d52-7ed49fa0ec32 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.984655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396ebf2-4036-4333-8d52-7ed49fa0ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.995042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396ebf2-4036-4333-8d52-7ed49fa0ec32 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.995042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396ebf2-4036-4333-8d52-7ed49fa0ec32 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:22.995042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396ebf2-4036-4333-8d52-7ed49fa0ec32 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:22.995334 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 175/360] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:22.996739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396ebf2-4036-4333-8d52-7ed49fa0ec32 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.034959 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:23.118001 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bb82a-dc87-4361-a5e3-e103bceac044 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.193730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7ade3-8903-4654-866b-10328a401531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.195861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7ade3-8903-4654-866b-10328a401531 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.198305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7ade3-8903-4654-866b-10328a401531 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.198305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7ade3-8903-4654-866b-10328a401531 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.201184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7ade3-8903-4654-866b-10328a401531 None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:23.203138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396ebf2-4036-4333-8d52-7ed49fa0ec32 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.203732 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7ade3-8903-4654-866b-10328a401531 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:23.207541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 186/361] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:23.210752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7ade3-8903-4654-866b-10328a401531 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.290474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976021c-779a-46f7-9de4-ad749c0ace14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.291168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976021c-779a-46f7-9de4-ad749c0ace14 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.291893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976021c-779a-46f7-9de4-ad749c0ace14 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.292066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976021c-779a-46f7-9de4-ad749c0ace14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.310463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976021c-779a-46f7-9de4-ad749c0ace14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-6976021c-779a-46f7-9de4-ad749c0ace14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:23.320975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:23.321941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:23.323868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:23.323868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:23.323868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:23.323868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:23.323868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:23.323868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:23.323868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:23.323868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:23.323868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:23.323868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:23.323868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:23.323868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:23.326390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 176/362] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:23.327617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976021c-779a-46f7-9de4-ad749c0ace14 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.412638 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7ade3-8903-4654-866b-10328a401531 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.426115 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:23.438634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:23.470934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb06d9-5c58-4700-9c6d-47ae6e844114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.472459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb06d9-5c58-4700-9c6d-47ae6e844114 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.473604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb06d9-5c58-4700-9c6d-47ae6e844114 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.474132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb06d9-5c58-4700-9c6d-47ae6e844114 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.475666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb06d9-5c58-4700-9c6d-47ae6e844114 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:23.476436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb06d9-5c58-4700-9c6d-47ae6e844114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:23.485464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb06d9-5c58-4700-9c6d-47ae6e844114 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:23.496070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 187/363] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:23.498068 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb06d9-5c58-4700-9c6d-47ae6e844114 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.515342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976021c-779a-46f7-9de4-ad749c0ace14 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.566045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceb215-b408-4966-b7b0-22c3f15ce1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.566770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceb215-b408-4966-b7b0-22c3f15ce1ef None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.567054 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceb215-b408-4966-b7b0-22c3f15ce1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.570619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceb215-b408-4966-b7b0-22c3f15ce1ef None admin] PATH_INFO: `/v3/groups/d68d7afdc3254505b48996933bc260ad` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.571828 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fceb215-b408-4966-b7b0-22c3f15ce1ef None admin] RBAC: Authorizing `identity:get_group(group_id=d68d7afdc3254505b48996933bc260ad)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:23.575237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fceb215-b408-4966-b7b0-22c3f15ce1ef None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:23.578128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 177/364] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:23 2022] GET /identity/v3/groups/d68d7afdc3254505b48996933bc260ad => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:23.579534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceb215-b408-4966-b7b0-22c3f15ce1ef None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.690183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb06d9-5c58-4700-9c6d-47ae6e844114 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.761048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff943e04-6a69-4241-83aa-065ad1b98ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.762330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff943e04-6a69-4241-83aa-065ad1b98ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.762800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff943e04-6a69-4241-83aa-065ad1b98ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.763175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff943e04-6a69-4241-83aa-065ad1b98ea7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.764191 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceb215-b408-4966-b7b0-22c3f15ce1ef None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.784232 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff943e04-6a69-4241-83aa-065ad1b98ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-ff943e04-6a69-4241-83aa-065ad1b98ea7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:23.794999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:23.795978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:23.796794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:23.796794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:23.796794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:23.796794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:23.796794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:23.796794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:23.796794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:23.796794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:23.796794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:23.796794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:23.796794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:23.796794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:23.797464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 188/365] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:07:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:23.798614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff943e04-6a69-4241-83aa-065ad1b98ea7 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.805462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:23.827226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eba3f-d743-4da7-b511-684b73b07ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.828343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eba3f-d743-4da7-b511-684b73b07ffa None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.828801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eba3f-d743-4da7-b511-684b73b07ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.829267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eba3f-d743-4da7-b511-684b73b07ffa None admin] PATH_INFO: `/v3/groups/d68d7afdc3254505b48996933bc260ad` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.831484 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731eba3f-d743-4da7-b511-684b73b07ffa None admin] RBAC: Authorizing `identity:get_group(group_id=d68d7afdc3254505b48996933bc260ad)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:23.834126 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731eba3f-d743-4da7-b511-684b73b07ffa None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:23.837412 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 178/366] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:23 2022] GET /identity/v3/groups/d68d7afdc3254505b48996933bc260ad => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:23.839361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eba3f-d743-4da7-b511-684b73b07ffa None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.880424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:24.002444 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff943e04-6a69-4241-83aa-065ad1b98ea7 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:24.005996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eba3f-d743-4da7-b511-684b73b07ffa None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:24.064376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed0fb1-b6dd-43e0-b9c9-debeaa424b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:24.064811 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f567404-ce3f-4af6-9761-9e4947809aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:24.065047 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed0fb1-b6dd-43e0-b9c9-debeaa424b92 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.065337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed0fb1-b6dd-43e0-b9c9-debeaa424b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.065484 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f567404-ce3f-4af6-9761-9e4947809aeb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.065618 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed0fb1-b6dd-43e0-b9c9-debeaa424b92 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.065736 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f567404-ce3f-4af6-9761-9e4947809aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.066024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f567404-ce3f-4af6-9761-9e4947809aeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.066366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed0fb1-b6dd-43e0-b9c9-debeaa424b92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:24.066703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed0fb1-b6dd-43e0-b9c9-debeaa424b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:24.068756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed0fb1-b6dd-43e0-b9c9-debeaa424b92 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:24.082696 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 189/367] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:24.083609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed0fb1-b6dd-43e0-b9c9-debeaa424b92 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:24.165701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:24.175525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f567404-ce3f-4af6-9761-9e4947809aeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:24.182141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f567404-ce3f-4af6-9761-9e4947809aeb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:24.260991 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed0fb1-b6dd-43e0-b9c9-debeaa424b92 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:24.265627 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:24.324782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669e5fb-f8aa-428c-8137-e13962bb3787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:24.325704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669e5fb-f8aa-428c-8137-e13962bb3787 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.325966 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669e5fb-f8aa-428c-8137-e13962bb3787 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.326324 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669e5fb-f8aa-428c-8137-e13962bb3787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.327147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669e5fb-f8aa-428c-8137-e13962bb3787 None admin] RBAC: Adding query filter params (group.id=d68d7afdc3254505b48996933bc260ad, role.id=3b2b994bb5314391bf684502bd09e733, scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:24.327560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669e5fb-f8aa-428c-8137-e13962bb3787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:24.329541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669e5fb-f8aa-428c-8137-e13962bb3787 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:24.339924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 190/368] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:24 2022] GET /identity/v3/role_assignments?group.id=d68d7afdc3254505b48996933bc260ad&scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60&role.id=3b2b994bb5314391bf684502bd09e733 => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:24.340572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669e5fb-f8aa-428c-8137-e13962bb3787 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:24.350904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 179/369] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:24.351825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f567404-ce3f-4af6-9761-9e4947809aeb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:24.498834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669e5fb-f8aa-428c-8137-e13962bb3787 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:24.528436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:24.535170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f567404-ce3f-4af6-9761-9e4947809aeb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:24.566170 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c39294-8f42-4c8b-998e-db251754c4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:24.567229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c39294-8f42-4c8b-998e-db251754c4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.567703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c39294-8f42-4c8b-998e-db251754c4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.568172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c39294-8f42-4c8b-998e-db251754c4b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.569395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c39294-8f42-4c8b-998e-db251754c4b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:24.569925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c39294-8f42-4c8b-998e-db251754c4b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:24.572591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c39294-8f42-4c8b-998e-db251754c4b0 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:24.582010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24e8da-d62b-4a66-89e9-2820d19bb16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:24.582669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24e8da-d62b-4a66-89e9-2820d19bb16b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.582939 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24e8da-d62b-4a66-89e9-2820d19bb16b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.583213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24e8da-d62b-4a66-89e9-2820d19bb16b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.583985 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24e8da-d62b-4a66-89e9-2820d19bb16b None admin] RBAC: Adding query filter params (group.id=d68d7afdc3254505b48996933bc260ad, role.id=6721d4c1040945dd8817af24236acb65, scope.project.id=9bcee52eea134a719563c19653e9371c) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:24.584425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24e8da-d62b-4a66-89e9-2820d19bb16b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:24.585901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24e8da-d62b-4a66-89e9-2820d19bb16b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:24.591567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 191/370] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:24.593206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ea4ee-2463-433b-b1b5-106d0f4f808e None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.593674 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ea4ee-2463-433b-b1b5-106d0f4f808e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.593947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ea4ee-2463-433b-b1b5-106d0f4f808e None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.595665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 192/371] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:24.596168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ea4ee-2463-433b-b1b5-106d0f4f808e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:24.601978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 180/372] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:24 2022] GET /identity/v3/role_assignments?group.id=d68d7afdc3254505b48996933bc260ad&scope.project.id=9bcee52eea134a719563c19653e9371c&role.id=6721d4c1040945dd8817af24236acb65 => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:24.603696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24e8da-d62b-4a66-89e9-2820d19bb16b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:24.636481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:24.763956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ea4ee-2463-433b-b1b5-106d0f4f808e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:24.817516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00b792-3efe-483f-86fb-19e38efa3d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:24.818603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00b792-3efe-483f-86fb-19e38efa3d1e None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.819099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00b792-3efe-483f-86fb-19e38efa3d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.819566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00b792-3efe-483f-86fb-19e38efa3d1e None admin] PATH_INFO: `/v3/users/1f5a0baefea54835b6a064bca980b922` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.821232 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00b792-3efe-483f-86fb-19e38efa3d1e None admin] RBAC: Authorizing `identity:get_user(user_id=1f5a0baefea54835b6a064bca980b922)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:24.825825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00b792-3efe-483f-86fb-19e38efa3d1e None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:24.829685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 193/373] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:24 2022] GET /identity/v3/users/1f5a0baefea54835b6a064bca980b922 => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:24.831317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00b792-3efe-483f-86fb-19e38efa3d1e None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:24.842140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24e8da-d62b-4a66-89e9-2820d19bb16b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:24.893312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62547e0f-7e6d-40e9-9195-7732ee9a533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:24.893977 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62547e0f-7e6d-40e9-9195-7732ee9a533e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.894301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62547e0f-7e6d-40e9-9195-7732ee9a533e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.894663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62547e0f-7e6d-40e9-9195-7732ee9a533e None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.897287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62547e0f-7e6d-40e9-9195-7732ee9a533e None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:24.899172 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62547e0f-7e6d-40e9-9195-7732ee9a533e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:24.905780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 181/374] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:24 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:24.905780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b51f3-a348-497e-91cc-3b0f9ebba782 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.905780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b51f3-a348-497e-91cc-3b0f9ebba782 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.905780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b51f3-a348-497e-91cc-3b0f9ebba782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.931049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-638b51f3-a348-497e-91cc-3b0f9ebba782 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:24.933177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-638b51f3-a348-497e-91cc-3b0f9ebba782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:24.971265 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:25.003238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00b792-3efe-483f-86fb-19e38efa3d1e None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:25.027142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:25.038499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 182/375] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:25.038499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b51f3-a348-497e-91cc-3b0f9ebba782 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:25.092376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a3cc1-6af7-4d9b-a280-f0e68544c763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:25.092921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a3cc1-6af7-4d9b-a280-f0e68544c763 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.093232 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a3cc1-6af7-4d9b-a280-f0e68544c763 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.093825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a3cc1-6af7-4d9b-a280-f0e68544c763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.171215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b51f3-a348-497e-91cc-3b0f9ebba782 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:25.217900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba79b07-0127-437a-b397-b9add14b55e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:25.219106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba79b07-0127-437a-b397-b9add14b55e4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.219590 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba79b07-0127-437a-b397-b9add14b55e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.220114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba79b07-0127-437a-b397-b9add14b55e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.221128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba79b07-0127-437a-b397-b9add14b55e4 None admin] RBAC: Adding query filter params (role.id=a4aee179070047af9cda6fea5ed98558, user.id=1f5a0baefea54835b6a064bca980b922, scope.system=all) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:25.221606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba79b07-0127-437a-b397-b9add14b55e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:25.223693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba79b07-0127-437a-b397-b9add14b55e4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:25.241074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 183/376] 10.222.0.81 () {56 vars in 1308 bytes} [Mon Aug 29 20:07:25 2022] GET /identity/v3/role_assignments?user.id=1f5a0baefea54835b6a064bca980b922&scope.system=all&role.id=a4aee179070047af9cda6fea5ed98558 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:25.242813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba79b07-0127-437a-b397-b9add14b55e4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:25.269445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:25.287411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a3cc1-6af7-4d9b-a280-f0e68544c763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:25.290053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a3cc1-6af7-4d9b-a280-f0e68544c763 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:25.383587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba79b07-0127-437a-b397-b9add14b55e4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:25.438091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f774c-eb50-46db-b1a9-e26ec181b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:25.439436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f774c-eb50-46db-b1a9-e26ec181b9bb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.439928 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f774c-eb50-46db-b1a9-e26ec181b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.440404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f774c-eb50-46db-b1a9-e26ec181b9bb None admin] PATH_INFO: `/v3/groups/d68d7afdc3254505b48996933bc260ad` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.442032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f774c-eb50-46db-b1a9-e26ec181b9bb None admin] RBAC: Authorizing `identity:get_group(group_id=d68d7afdc3254505b48996933bc260ad)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:25.444810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f774c-eb50-46db-b1a9-e26ec181b9bb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:25.447166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 184/377] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:25 2022] GET /identity/v3/groups/d68d7afdc3254505b48996933bc260ad => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:25.462185 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f774c-eb50-46db-b1a9-e26ec181b9bb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:25.581432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:25.602279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f774c-eb50-46db-b1a9-e26ec181b9bb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:25.610799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:25.633039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 194/378] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 803 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:25.638567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a3cc1-6af7-4d9b-a280-f0e68544c763 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:25.655448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15544781-6a3f-4cc7-8139-ea3a191bca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:25.656505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15544781-6a3f-4cc7-8139-ea3a191bca80 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.657002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15544781-6a3f-4cc7-8139-ea3a191bca80 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.657484 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15544781-6a3f-4cc7-8139-ea3a191bca80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.663679 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15544781-6a3f-4cc7-8139-ea3a191bca80 None admin] RBAC: Adding query filter params (group.id=d68d7afdc3254505b48996933bc260ad, role.id=3b2b994bb5314391bf684502bd09e733, scope.project.id=9bcee52eea134a719563c19653e9371c) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:25.663679 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15544781-6a3f-4cc7-8139-ea3a191bca80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:25.663679 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15544781-6a3f-4cc7-8139-ea3a191bca80 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:25.673601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 185/379] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:25 2022] GET /identity/v3/role_assignments?group.id=d68d7afdc3254505b48996933bc260ad&scope.project.id=9bcee52eea134a719563c19653e9371c&role.id=3b2b994bb5314391bf684502bd09e733 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:25.675324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15544781-6a3f-4cc7-8139-ea3a191bca80 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:25.911794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15544781-6a3f-4cc7-8139-ea3a191bca80 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.004115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a3cc1-6af7-4d9b-a280-f0e68544c763 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.046015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23491b-8d15-406f-bdc9-1a835a2c7233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.047170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23491b-8d15-406f-bdc9-1a835a2c7233 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.047656 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23491b-8d15-406f-bdc9-1a835a2c7233 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.048130 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23491b-8d15-406f-bdc9-1a835a2c7233 None admin] PATH_INFO: `/v3/projects/9f67ec719bc34531ae1e710c78054427` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.050279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23491b-8d15-406f-bdc9-1a835a2c7233 None admin] RBAC: Authorizing `identity:get_project(project_id=9f67ec719bc34531ae1e710c78054427)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:26.053143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23491b-8d15-406f-bdc9-1a835a2c7233 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:26.056510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 186/380] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:25 2022] GET /identity/v3/projects/9f67ec719bc34531ae1e710c78054427 => generated 344 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:26.065751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23491b-8d15-406f-bdc9-1a835a2c7233 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:26.091454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:26.103265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b53375-a8a9-4523-b80b-64ee312f0140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.104881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b53375-a8a9-4523-b80b-64ee312f0140 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.105635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b53375-a8a9-4523-b80b-64ee312f0140 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.106378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b53375-a8a9-4523-b80b-64ee312f0140 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.147916 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b53375-a8a9-4523-b80b-64ee312f0140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-77b53375-a8a9-4523-b80b-64ee312f0140 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:26.167919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:26.169644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:26.171468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:26.171468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:26.171468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:26.171468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:26.171468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:26.171468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:26.171468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:26.171468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:26.171468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:26.171468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:26.171468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:26.171468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:26.180342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 195/381] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 547 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:26.189604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b53375-a8a9-4523-b80b-64ee312f0140 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:26.202927 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23491b-8d15-406f-bdc9-1a835a2c7233 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.255393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965ec85-300b-4cd6-b10e-7390b1f0a520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.256359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965ec85-300b-4cd6-b10e-7390b1f0a520 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.256720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965ec85-300b-4cd6-b10e-7390b1f0a520 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.257323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965ec85-300b-4cd6-b10e-7390b1f0a520 None admin] PATH_INFO: `/v3/groups/d5a629c23c5f49af85a3658d2a3a45de` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.265948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965ec85-300b-4cd6-b10e-7390b1f0a520 None admin] RBAC: Authorizing `identity:get_group(group_id=d5a629c23c5f49af85a3658d2a3a45de)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:26.268009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965ec85-300b-4cd6-b10e-7390b1f0a520 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:26.272921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 187/382] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:26 2022] GET /identity/v3/groups/d5a629c23c5f49af85a3658d2a3a45de => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:26.278163 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965ec85-300b-4cd6-b10e-7390b1f0a520 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:26.330649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:26.404303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b53375-a8a9-4523-b80b-64ee312f0140 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.449146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f79f7-9ac5-41d8-90e5-30536e7a64ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.450138 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f79f7-9ac5-41d8-90e5-30536e7a64ff None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.450656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f79f7-9ac5-41d8-90e5-30536e7a64ff None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.451129 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f79f7-9ac5-41d8-90e5-30536e7a64ff None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.452390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f79f7-9ac5-41d8-90e5-30536e7a64ff None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:26.452952 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f79f7-9ac5-41d8-90e5-30536e7a64ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:26.454644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f79f7-9ac5-41d8-90e5-30536e7a64ff None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:26.466265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 196/383] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:26.476104 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f79f7-9ac5-41d8-90e5-30536e7a64ff None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:26.484632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:26.515276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965ec85-300b-4cd6-b10e-7390b1f0a520 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.615886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f79f7-9ac5-41d8-90e5-30536e7a64ff None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.650494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56fc9a-e9f6-4f22-9e97-834a02911094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.651239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56fc9a-e9f6-4f22-9e97-834a02911094 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.651527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56fc9a-e9f6-4f22-9e97-834a02911094 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.651808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56fc9a-e9f6-4f22-9e97-834a02911094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.652625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56fc9a-e9f6-4f22-9e97-834a02911094 None admin] RBAC: Adding query filter params (group.id=d5a629c23c5f49af85a3658d2a3a45de, role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=9f67ec719bc34531ae1e710c78054427) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:26.652884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56fc9a-e9f6-4f22-9e97-834a02911094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:26.654419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56fc9a-e9f6-4f22-9e97-834a02911094 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:26.662108 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:26.665663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc3c0b-c9d0-42eb-910c-39c8bc296cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.667366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3c0b-c9d0-42eb-910c-39c8bc296cbe None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.667884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3c0b-c9d0-42eb-910c-39c8bc296cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.668443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3c0b-c9d0-42eb-910c-39c8bc296cbe None admin] PATH_INFO: `/v3/groups/d68d7afdc3254505b48996933bc260ad` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.673771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 188/384] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:26 2022] GET /identity/v3/role_assignments?group.id=d5a629c23c5f49af85a3658d2a3a45de&scope.project.id=9f67ec719bc34531ae1e710c78054427&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 260 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:26.679395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc3c0b-c9d0-42eb-910c-39c8bc296cbe None admin] RBAC: Authorizing `identity:get_group(group_id=d68d7afdc3254505b48996933bc260ad)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:26.679395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc3c0b-c9d0-42eb-910c-39c8bc296cbe None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:26.679395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 197/385] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:26 2022] GET /identity/v3/groups/d68d7afdc3254505b48996933bc260ad => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:26.688374 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56fc9a-e9f6-4f22-9e97-834a02911094 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:26.844580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56fc9a-e9f6-4f22-9e97-834a02911094 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.885020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea262b2-acca-4616-bed0-7a1ec4de6717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.885825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea262b2-acca-4616-bed0-7a1ec4de6717 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.886304 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea262b2-acca-4616-bed0-7a1ec4de6717 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.886613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea262b2-acca-4616-bed0-7a1ec4de6717 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.887953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea262b2-acca-4616-bed0-7a1ec4de6717 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:26.889568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea262b2-acca-4616-bed0-7a1ec4de6717 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:26.896692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 189/386] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:26 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:26.899477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc3c0b-c9d0-42eb-910c-39c8bc296cbe None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:27.077333 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc3c0b-c9d0-42eb-910c-39c8bc296cbe None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:27.115288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416f13c-5a6e-4361-8364-6bf28695c7b4 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:27.115485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416f13c-5a6e-4361-8364-6bf28695c7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:27.115753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416f13c-5a6e-4361-8364-6bf28695c7b4 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:27.117288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 190/387] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:27.124810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4766e9-026d-4094-ac40-7e42445232bc None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:27.125918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4766e9-026d-4094-ac40-7e42445232bc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:27.126477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4766e9-026d-4094-ac40-7e42445232bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:27.141652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad6ea1-541f-4dd9-bbf8-00b6c82e86e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:27.142895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad6ea1-541f-4dd9-bbf8-00b6c82e86e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:27.143386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad6ea1-541f-4dd9-bbf8-00b6c82e86e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:27.143921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad6ea1-541f-4dd9-bbf8-00b6c82e86e6 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60/groups/d68d7afdc3254505b48996933bc260ad/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:27.147773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad6ea1-541f-4dd9-bbf8-00b6c82e86e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1e1d8f38ffd428f91d8d2285d020c60, group_id=d68d7afdc3254505b48996933bc260ad, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:27.152532 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad6ea1-541f-4dd9-bbf8-00b6c82e86e6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:27.154147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ee4766e9-026d-4094-ac40-7e42445232bc None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:27.155889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ee4766e9-026d-4094-ac40-7e42445232bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:27.168428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:27.240633 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 191/388] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:27.277179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 198/389] 10.222.0.81 () {58 vars in 1442 bytes} [Mon Aug 29 20:07:26 2022] PUT /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60/groups/d68d7afdc3254505b48996933bc260ad/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:27.605344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4766e9-026d-4094-ac40-7e42445232bc None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:27.671314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e23543-e9a7-474b-b9e9-938dbc8b744f None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:27.672287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e23543-e9a7-474b-b9e9-938dbc8b744f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:27.672780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e23543-e9a7-474b-b9e9-938dbc8b744f None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:27.674391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 199/390] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:27.681022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda9cb8-8aba-4f58-9a8b-2be5f1ba0b52 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:27.681521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda9cb8-8aba-4f58-9a8b-2be5f1ba0b52 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:27.682050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda9cb8-8aba-4f58-9a8b-2be5f1ba0b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:27.725485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-bbda9cb8-8aba-4f58-9a8b-2be5f1ba0b52 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:27.725485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bbda9cb8-8aba-4f58-9a8b-2be5f1ba0b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:27.759298 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4766e9-026d-4094-ac40-7e42445232bc None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:27.830058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1acde1-1c34-44a1-9e49-8f32b9781834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:27.832476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1acde1-1c34-44a1-9e49-8f32b9781834 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:27.833629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1acde1-1c34-44a1-9e49-8f32b9781834 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:27.834421 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1acde1-1c34-44a1-9e49-8f32b9781834 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:27.858463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1acde1-1c34-44a1-9e49-8f32b9781834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:27.871059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-1c1acde1-1c34-44a1-9e49-8f32b9781834 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:27.872402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:27.874006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:27.875737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:27.875737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:27.875737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:27.875737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:27.875737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:27.875737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:27.875737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:27.875737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:27.875737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:27.875737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:27.875737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:27.875737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:27.879862 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 192/391] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:27.890592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1acde1-1c34-44a1-9e49-8f32b9781834 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:27.896606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:27.957707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 200/392] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:28.077866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1acde1-1c34-44a1-9e49-8f32b9781834 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:28.117413 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cf7f6-6723-45ed-bdc1-0fb0cd732327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:28.118278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cf7f6-6723-45ed-bdc1-0fb0cd732327 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.118697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cf7f6-6723-45ed-bdc1-0fb0cd732327 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.119102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cf7f6-6723-45ed-bdc1-0fb0cd732327 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.120093 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cf7f6-6723-45ed-bdc1-0fb0cd732327 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:28.120847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cf7f6-6723-45ed-bdc1-0fb0cd732327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:28.122448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cf7f6-6723-45ed-bdc1-0fb0cd732327 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:28.132314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 193/393] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:28.139781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda9cb8-8aba-4f58-9a8b-2be5f1ba0b52 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:28.308845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cf7f6-6723-45ed-bdc1-0fb0cd732327 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:28.318282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda9cb8-8aba-4f58-9a8b-2be5f1ba0b52 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:28.405642 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57a43f-edce-4b33-a664-a78591125725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:28.406332 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57a43f-edce-4b33-a664-a78591125725 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.406617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57a43f-edce-4b33-a664-a78591125725 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.406895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57a43f-edce-4b33-a664-a78591125725 None admin] PATH_INFO: `/v3/groups/d68d7afdc3254505b48996933bc260ad` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.409258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57a43f-edce-4b33-a664-a78591125725 None admin] RBAC: Authorizing `identity:get_group(group_id=d68d7afdc3254505b48996933bc260ad)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:28.410855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57a43f-edce-4b33-a664-a78591125725 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:28.412812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 201/394] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:28 2022] GET /identity/v3/groups/d68d7afdc3254505b48996933bc260ad => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:28.416950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b488c4-7fdd-4641-9a3f-70a5e6b591d4 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.417666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b488c4-7fdd-4641-9a3f-70a5e6b591d4 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.418091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b488c4-7fdd-4641-9a3f-70a5e6b591d4 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.419933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 202/395] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:28.425000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b488c4-7fdd-4641-9a3f-70a5e6b591d4 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:28.435076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:28.489255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:28.495255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cf7f6-6723-45ed-bdc1-0fb0cd732327 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:28.541530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274bb1d-7f14-4dc5-888a-d0393ba78fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:28.542626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274bb1d-7f14-4dc5-888a-d0393ba78fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.543069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274bb1d-7f14-4dc5-888a-d0393ba78fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.543494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274bb1d-7f14-4dc5-888a-d0393ba78fd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.559803 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274bb1d-7f14-4dc5-888a-d0393ba78fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-a274bb1d-7f14-4dc5-888a-d0393ba78fd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:28.567113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:28.568824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 194/396] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:07:28.570070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7dc12-5954-47c3-8d11-8bb7f36ccc1e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.570920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7dc12-5954-47c3-8d11-8bb7f36ccc1e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.570920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7dc12-5954-47c3-8d11-8bb7f36ccc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.584651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b488c4-7fdd-4641-9a3f-70a5e6b591d4 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:28.592375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-8ce7dc12-5954-47c3-8d11-8bb7f36ccc1e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:28.593625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8ce7dc12-5954-47c3-8d11-8bb7f36ccc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:28.629104 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfc78d-71d7-4ccf-bdb7-077137dd3d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:28.630184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfc78d-71d7-4ccf-bdb7-077137dd3d7d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.630670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfc78d-71d7-4ccf-bdb7-077137dd3d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.631186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfc78d-71d7-4ccf-bdb7-077137dd3d7d None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.632608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfc78d-71d7-4ccf-bdb7-077137dd3d7d None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:28.634613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfc78d-71d7-4ccf-bdb7-077137dd3d7d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:28.637234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 203/397] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:28 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:28.638363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfc78d-71d7-4ccf-bdb7-077137dd3d7d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:28.698814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 195/398] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:28.701604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7dc12-5954-47c3-8d11-8bb7f36ccc1e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:28.849770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:28.902159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfc78d-71d7-4ccf-bdb7-077137dd3d7d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:28.907732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7dc12-5954-47c3-8d11-8bb7f36ccc1e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:28.919215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:28.953620 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50033e-9dab-4081-b113-8d63c2614ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:28.954747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50033e-9dab-4081-b113-8d63c2614ebf None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.955256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50033e-9dab-4081-b113-8d63c2614ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.955801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50033e-9dab-4081-b113-8d63c2614ebf None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60/groups/d68d7afdc3254505b48996933bc260ad/roles/3b2b994bb5314391bf684502bd09e733` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.958628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50033e-9dab-4081-b113-8d63c2614ebf None admin] RBAC: Authorizing `identity:create_grant(project_id=a1e1d8f38ffd428f91d8d2285d020c60, group_id=d68d7afdc3254505b48996933bc260ad, role_id=3b2b994bb5314391bf684502bd09e733)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:28.960480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50033e-9dab-4081-b113-8d63c2614ebf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:28.970887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fdf63-3858-4f86-8ab8-47c760b696d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:28.970887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fdf63-3858-4f86-8ab8-47c760b696d5 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.970887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fdf63-3858-4f86-8ab8-47c760b696d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.970887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fdf63-3858-4f86-8ab8-47c760b696d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.971624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fdf63-3858-4f86-8ab8-47c760b696d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:28.971624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fdf63-3858-4f86-8ab8-47c760b696d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:28.971624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fdf63-3858-4f86-8ab8-47c760b696d5 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:28.981222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 204/399] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:28.990676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fdf63-3858-4f86-8ab8-47c760b696d5 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:29.052254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 196/400] 10.222.0.81 () {58 vars in 1442 bytes} [Mon Aug 29 20:07:28 2022] PUT /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60/groups/d68d7afdc3254505b48996933bc260ad/roles/3b2b994bb5314391bf684502bd09e733 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:29.172243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50033e-9dab-4081-b113-8d63c2614ebf None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:29.212476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fdf63-3858-4f86-8ab8-47c760b696d5 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:29.279609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6a0b2-78f7-44ba-8c42-55a4c9165f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:29.281366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a0b2-78f7-44ba-8c42-55a4c9165f91 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.282047 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a0b2-78f7-44ba-8c42-55a4c9165f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.283149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a0b2-78f7-44ba-8c42-55a4c9165f91 None admin] PATH_INFO: `/v3/groups/d68d7afdc3254505b48996933bc260ad` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.286722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6a0b2-78f7-44ba-8c42-55a4c9165f91 None admin] RBAC: Authorizing `identity:get_group(group_id=d68d7afdc3254505b48996933bc260ad)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:29.291173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6a0b2-78f7-44ba-8c42-55a4c9165f91 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:29.298067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 205/401] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:28 2022] GET /identity/v3/groups/d68d7afdc3254505b48996933bc260ad => generated 226 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:29.310775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6a0b2-78f7-44ba-8c42-55a4c9165f91 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:29.364291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50033e-9dab-4081-b113-8d63c2614ebf None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:29.396599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:29.434601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:29.442578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de46b69-c337-4aab-a32c-e8dce051f8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:29.443241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de46b69-c337-4aab-a32c-e8dce051f8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.443522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de46b69-c337-4aab-a32c-e8dce051f8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.443794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de46b69-c337-4aab-a32c-e8dce051f8f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.468863 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de46b69-c337-4aab-a32c-e8dce051f8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-1de46b69-c337-4aab-a32c-e8dce051f8f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:29.478587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:29.480822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:29.481594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 197/402] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:29.491103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de46b69-c337-4aab-a32c-e8dce051f8f2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:29.628039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de46b69-c337-4aab-a32c-e8dce051f8f2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:29.649411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6a0b2-78f7-44ba-8c42-55a4c9165f91 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:29.672685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcae76b-5fab-4dbb-b83e-8d439a61e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:29.673569 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcae76b-5fab-4dbb-b83e-8d439a61e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.673990 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcae76b-5fab-4dbb-b83e-8d439a61e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.674464 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcae76b-5fab-4dbb-b83e-8d439a61e8b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.675314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcae76b-5fab-4dbb-b83e-8d439a61e8b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:29.675843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcae76b-5fab-4dbb-b83e-8d439a61e8b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:29.677260 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcae76b-5fab-4dbb-b83e-8d439a61e8b6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:29.688826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 198/403] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:29.690530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553c34-4fed-47c0-8337-1ea9c9f49edf None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.690880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553c34-4fed-47c0-8337-1ea9c9f49edf None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.691217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553c34-4fed-47c0-8337-1ea9c9f49edf None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.692679 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 199/404] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:29.696937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec3c85-488e-4292-b41f-98aac7e27639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:29.698463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15398f-926f-46bd-b42b-09e6430a10f6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.698713 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15398f-926f-46bd-b42b-09e6430a10f6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.698994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15398f-926f-46bd-b42b-09e6430a10f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.700344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec3c85-488e-4292-b41f-98aac7e27639 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.707809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec3c85-488e-4292-b41f-98aac7e27639 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.708594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec3c85-488e-4292-b41f-98aac7e27639 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.710392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec3c85-488e-4292-b41f-98aac7e27639 None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:29.712331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec3c85-488e-4292-b41f-98aac7e27639 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:29.714857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 206/405] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:29 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:29.720728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec3c85-488e-4292-b41f-98aac7e27639 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:29.725648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7d15398f-926f-46bd-b42b-09e6430a10f6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:29.726957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7d15398f-926f-46bd-b42b-09e6430a10f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:29.767497 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:29.821578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 200/406] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:29.823137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15398f-926f-46bd-b42b-09e6430a10f6 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:29.904596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec3c85-488e-4292-b41f-98aac7e27639 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:29.919663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:29.947415 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c81fb-564e-443f-ab9a-8745e8772e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:29.949091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c81fb-564e-443f-ab9a-8745e8772e20 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.949470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c81fb-564e-443f-ab9a-8745e8772e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.949871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c81fb-564e-443f-ab9a-8745e8772e20 None admin] PATH_INFO: `/v3/groups/d68d7afdc3254505b48996933bc260ad` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.951302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c81fb-564e-443f-ab9a-8745e8772e20 None admin] RBAC: Authorizing `identity:get_group(group_id=d68d7afdc3254505b48996933bc260ad)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:29.952985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c81fb-564e-443f-ab9a-8745e8772e20 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:29.954803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 207/407] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:29 2022] GET /identity/v3/groups/d68d7afdc3254505b48996933bc260ad => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:29.960529 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c81fb-564e-443f-ab9a-8745e8772e20 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:30.079830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c81fb-564e-443f-ab9a-8745e8772e20 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:30.121279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded6375-5320-4633-9f35-2933f9d00513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:30.122102 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded6375-5320-4633-9f35-2933f9d00513 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.122531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded6375-5320-4633-9f35-2933f9d00513 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.122943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded6375-5320-4633-9f35-2933f9d00513 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.124480 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded6375-5320-4633-9f35-2933f9d00513 None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:30.126210 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded6375-5320-4633-9f35-2933f9d00513 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:30.128399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 208/408] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:29 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:30.134515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded6375-5320-4633-9f35-2933f9d00513 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:30.140462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15398f-926f-46bd-b42b-09e6430a10f6 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:30.193809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:30.220101 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2d1bc-d0a2-4ef3-a31b-5f7c5d2b6baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:30.221091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2d1bc-d0a2-4ef3-a31b-5f7c5d2b6baa None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.221406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2d1bc-d0a2-4ef3-a31b-5f7c5d2b6baa None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.222392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2d1bc-d0a2-4ef3-a31b-5f7c5d2b6baa None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c/groups/d68d7afdc3254505b48996933bc260ad/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.225064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2d1bc-d0a2-4ef3-a31b-5f7c5d2b6baa None admin] RBAC: Authorizing `identity:create_grant(project_id=9bcee52eea134a719563c19653e9371c, group_id=d68d7afdc3254505b48996933bc260ad, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:30.227585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2d1bc-d0a2-4ef3-a31b-5f7c5d2b6baa None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:30.266117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded6375-5320-4633-9f35-2933f9d00513 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:30.310096 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d40cf5-2ffa-4760-8efc-03ff1d3c2eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:30.311039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d40cf5-2ffa-4760-8efc-03ff1d3c2eee None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.311511 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d40cf5-2ffa-4760-8efc-03ff1d3c2eee None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.311933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d40cf5-2ffa-4760-8efc-03ff1d3c2eee None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c/groups/d68d7afdc3254505b48996933bc260ad/roles/3b2b994bb5314391bf684502bd09e733` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.314587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d40cf5-2ffa-4760-8efc-03ff1d3c2eee None admin] RBAC: Authorizing `identity:create_grant(project_id=9bcee52eea134a719563c19653e9371c, group_id=d68d7afdc3254505b48996933bc260ad, role_id=3b2b994bb5314391bf684502bd09e733)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:30.316286 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d40cf5-2ffa-4760-8efc-03ff1d3c2eee None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:30.538611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 209/409] 10.222.0.81 () {58 vars in 1442 bytes} [Mon Aug 29 20:07:30 2022] PUT /identity/v3/projects/9bcee52eea134a719563c19653e9371c/groups/d68d7afdc3254505b48996933bc260ad/roles/3b2b994bb5314391bf684502bd09e733 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:07:30.547978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d40cf5-2ffa-4760-8efc-03ff1d3c2eee None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:30.558340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 201/410] 10.222.0.81 () {58 vars in 1442 bytes} [Mon Aug 29 20:07:29 2022] PUT /identity/v3/projects/9bcee52eea134a719563c19653e9371c/groups/d68d7afdc3254505b48996933bc260ad/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:30.801841 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d40cf5-2ffa-4760-8efc-03ff1d3c2eee None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:30.820575 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:30.837791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7010e-54f5-4986-b260-4f9a198b92a3 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.839975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7010e-54f5-4986-b260-4f9a198b92a3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.840696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7010e-54f5-4986-b260-4f9a198b92a3 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.844614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 202/411] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:30.864347 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a0066-f52d-42cd-97a1-63ebbba83451 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.867058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a0066-f52d-42cd-97a1-63ebbba83451 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.868081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a0066-f52d-42cd-97a1-63ebbba83451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.890175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed644901-d55f-449b-834f-0e338b38915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:30.891281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed644901-d55f-449b-834f-0e338b38915f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.891775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed644901-d55f-449b-834f-0e338b38915f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.892234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed644901-d55f-449b-834f-0e338b38915f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.905432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d46a0066-f52d-42cd-97a1-63ebbba83451 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:30.907954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d46a0066-f52d-42cd-97a1-63ebbba83451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:30.913540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed644901-d55f-449b-834f-0e338b38915f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-ed644901-d55f-449b-834f-0e338b38915f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:30.924483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:30.926382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:30.927910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:30.927910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:30.927910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:30.927910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:30.927910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:30.927910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:30.927910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:30.927910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:30.927910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:30.927910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:30.927910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:30.927910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:30.933892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 210/412] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:30.945652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed644901-d55f-449b-834f-0e338b38915f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:30.968984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:31.092569 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 203/413] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:31.107831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed644901-d55f-449b-834f-0e338b38915f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:31.186900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0d0ec-5406-4cdd-876e-1d7eb92045aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:31.188027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0d0ec-5406-4cdd-876e-1d7eb92045aa None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:31.188508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0d0ec-5406-4cdd-876e-1d7eb92045aa None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:31.188949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0d0ec-5406-4cdd-876e-1d7eb92045aa None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:31.190104 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0d0ec-5406-4cdd-876e-1d7eb92045aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:31.190634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0d0ec-5406-4cdd-876e-1d7eb92045aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:31.193148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0d0ec-5406-4cdd-876e-1d7eb92045aa None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:31.217634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 211/414] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:31.221159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a0066-f52d-42cd-97a1-63ebbba83451 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:31.452013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffb932-7220-4d83-b759-e0a4e2236939 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:31.452727 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffb932-7220-4d83-b759-e0a4e2236939 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:31.453182 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffb932-7220-4d83-b759-e0a4e2236939 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:31.462646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 212/415] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:31.465843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebafbd7-a1f9-442d-a16b-1b3ae1423caa None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:31.466154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebafbd7-a1f9-442d-a16b-1b3ae1423caa None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:31.466605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebafbd7-a1f9-442d-a16b-1b3ae1423caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:31.496640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-2ebafbd7-a1f9-442d-a16b-1b3ae1423caa None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:31.496910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2ebafbd7-a1f9-442d-a16b-1b3ae1423caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:31.497728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a0066-f52d-42cd-97a1-63ebbba83451 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:31.530793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:31.562142 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086a8eb-fb3d-4553-a21e-cd0c08a7c849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:31.563579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086a8eb-fb3d-4553-a21e-cd0c08a7c849 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:31.564187 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086a8eb-fb3d-4553-a21e-cd0c08a7c849 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:31.564812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086a8eb-fb3d-4553-a21e-cd0c08a7c849 None admin] PATH_INFO: `/v3/groups/d5a629c23c5f49af85a3658d2a3a45de` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:31.567238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086a8eb-fb3d-4553-a21e-cd0c08a7c849 None admin] RBAC: Authorizing `identity:get_group(group_id=d5a629c23c5f49af85a3658d2a3a45de)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:31.569946 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086a8eb-fb3d-4553-a21e-cd0c08a7c849 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:31.572278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 204/416] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:31 2022] GET /identity/v3/groups/d5a629c23c5f49af85a3658d2a3a45de => generated 229 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:31.573587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086a8eb-fb3d-4553-a21e-cd0c08a7c849 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:31.603584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 213/417] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:31.605929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebafbd7-a1f9-442d-a16b-1b3ae1423caa None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:31.645595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:31.729418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebafbd7-a1f9-442d-a16b-1b3ae1423caa None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:31.773655 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fae351-625b-4971-96e3-3650b4d4be67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:31.774395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fae351-625b-4971-96e3-3650b4d4be67 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:31.774728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fae351-625b-4971-96e3-3650b4d4be67 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:31.775067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fae351-625b-4971-96e3-3650b4d4be67 None admin] PATH_INFO: `/v3/projects/9f67ec719bc34531ae1e710c78054427` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:31.776829 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fae351-625b-4971-96e3-3650b4d4be67 None admin] RBAC: Authorizing `identity:get_project(project_id=9f67ec719bc34531ae1e710c78054427)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:31.778054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fae351-625b-4971-96e3-3650b4d4be67 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:31.780151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 214/418] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:31 2022] GET /identity/v3/projects/9f67ec719bc34531ae1e710c78054427 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:31.791111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fae351-625b-4971-96e3-3650b4d4be67 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:31.828818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:31.852753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086a8eb-fb3d-4553-a21e-cd0c08a7c849 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:31.924296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fae351-625b-4971-96e3-3650b4d4be67 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:31.957443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169798bd-3c8e-40d9-8461-8660184599e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:31.959367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169798bd-3c8e-40d9-8461-8660184599e1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:31.960386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169798bd-3c8e-40d9-8461-8660184599e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:31.961168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169798bd-3c8e-40d9-8461-8660184599e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:31.994994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169798bd-3c8e-40d9-8461-8660184599e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-169798bd-3c8e-40d9-8461-8660184599e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:32.000168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:32.001854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:32.003879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:32.003879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:32.003879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:32.003879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:32.003879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:32.003879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:32.003879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:32.003879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:32.003879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:32.003879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:32.003879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:32.003879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:32.013797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 205/419] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:32.019969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169798bd-3c8e-40d9-8461-8660184599e1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:32.029203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4404bb-577f-4a63-9ec3-cae154f2c2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:32.030004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4404bb-577f-4a63-9ec3-cae154f2c2f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:32.030372 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4404bb-577f-4a63-9ec3-cae154f2c2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:32.030649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4404bb-577f-4a63-9ec3-cae154f2c2f8 None admin] PATH_INFO: `/v3/projects/9f67ec719bc34531ae1e710c78054427/groups/d5a629c23c5f49af85a3658d2a3a45de/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:32.037763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4404bb-577f-4a63-9ec3-cae154f2c2f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f67ec719bc34531ae1e710c78054427, group_id=d5a629c23c5f49af85a3658d2a3a45de, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:32.039595 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4404bb-577f-4a63-9ec3-cae154f2c2f8 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:32.131195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 215/420] 10.222.0.81 () {58 vars in 1442 bytes} [Mon Aug 29 20:07:31 2022] PUT /identity/v3/projects/9f67ec719bc34531ae1e710c78054427/groups/d5a629c23c5f49af85a3658d2a3a45de/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:07:32.163408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:32.165447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4404bb-577f-4a63-9ec3-cae154f2c2f8 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:32.211331 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169798bd-3c8e-40d9-8461-8660184599e1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:32.287608 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9b16b-63f5-4752-b485-3a9577ee48bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:32.288276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9b16b-63f5-4752-b485-3a9577ee48bf None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:32.288554 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9b16b-63f5-4752-b485-3a9577ee48bf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:32.288856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9b16b-63f5-4752-b485-3a9577ee48bf None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:32.289507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9b16b-63f5-4752-b485-3a9577ee48bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:32.289809 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9b16b-63f5-4752-b485-3a9577ee48bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:32.291326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9b16b-63f5-4752-b485-3a9577ee48bf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:32.315526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 206/421] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:32.317842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9b16b-63f5-4752-b485-3a9577ee48bf None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:32.371664 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:32.402283 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4404bb-577f-4a63-9ec3-cae154f2c2f8 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:32.499504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00520c2-42af-48c0-9b7b-cc17ebddc0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:32.499504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00520c2-42af-48c0-9b7b-cc17ebddc0bc None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:32.499504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00520c2-42af-48c0-9b7b-cc17ebddc0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:32.499504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00520c2-42af-48c0-9b7b-cc17ebddc0bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:32.525438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00520c2-42af-48c0-9b7b-cc17ebddc0bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-b00520c2-42af-48c0-9b7b-cc17ebddc0bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:32.531776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:32.533695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:32.535611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:32.535611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:32.535611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:32.535611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:32.535611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:32.535611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:32.535611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:32.535611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:32.535611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:32.535611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:32.535611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:32.535611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:32.542967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 216/422] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:32.545465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9b16b-63f5-4752-b485-3a9577ee48bf None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:32.551293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00520c2-42af-48c0-9b7b-cc17ebddc0bc None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:32.631245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88715ba0-ddb4-4323-8144-61b891998001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:32.632269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88715ba0-ddb4-4323-8144-61b891998001 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:32.637482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88715ba0-ddb4-4323-8144-61b891998001 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:32.638134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88715ba0-ddb4-4323-8144-61b891998001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:32.675411 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:32.795367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00520c2-42af-48c0-9b7b-cc17ebddc0bc None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:32.799175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88715ba0-ddb4-4323-8144-61b891998001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:32.800608 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88715ba0-ddb4-4323-8144-61b891998001 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:32.869620 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ca660-4057-452a-b25f-a02d898daa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:32.870287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ca660-4057-452a-b25f-a02d898daa2d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:32.870797 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ca660-4057-452a-b25f-a02d898daa2d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:32.871192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ca660-4057-452a-b25f-a02d898daa2d None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:32.871785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ca660-4057-452a-b25f-a02d898daa2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:32.872090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ca660-4057-452a-b25f-a02d898daa2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:32.874988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ca660-4057-452a-b25f-a02d898daa2d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:32.884420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 217/423] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:32.899236 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ca660-4057-452a-b25f-a02d898daa2d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:32.920528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:33.065936 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ca660-4057-452a-b25f-a02d898daa2d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:33.106918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 207/424] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:33.115983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88715ba0-ddb4-4323-8144-61b891998001 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:33.119993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff62ea2-7833-430e-b93f-5784cf6017fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:33.120629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff62ea2-7833-430e-b93f-5784cf6017fe None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.121015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff62ea2-7833-430e-b93f-5784cf6017fe None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.121299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff62ea2-7833-430e-b93f-5784cf6017fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.206450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:33.306279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff62ea2-7833-430e-b93f-5784cf6017fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:33.310164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff62ea2-7833-430e-b93f-5784cf6017fe None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:33.342848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:33.354203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88715ba0-ddb4-4323-8144-61b891998001 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:33.479887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2412a-4cf6-450f-bbc2-2458cb0a1639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:33.480655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2412a-4cf6-450f-bbc2-2458cb0a1639 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.480998 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2412a-4cf6-450f-bbc2-2458cb0a1639 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.490405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2412a-4cf6-450f-bbc2-2458cb0a1639 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.492037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2412a-4cf6-450f-bbc2-2458cb0a1639 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:33.493650 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2412a-4cf6-450f-bbc2-2458cb0a1639 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:33.496246 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 208/425] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:33 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:33.505823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2412a-4cf6-450f-bbc2-2458cb0a1639 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:33.590915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 218/426] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:33.597149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff62ea2-7833-430e-b93f-5784cf6017fe None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:33.767989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2412a-4cf6-450f-bbc2-2458cb0a1639 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:33.790679 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:33.817236 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff62ea2-7833-430e-b93f-5784cf6017fe None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:33.832206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:33.833000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b32f1-7a12-46ec-bd24-64d626ef75a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:33.833984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b32f1-7a12-46ec-bd24-64d626ef75a1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.835641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b32f1-7a12-46ec-bd24-64d626ef75a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.836262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b32f1-7a12-46ec-bd24-64d626ef75a1 None admin] PATH_INFO: `/v3/groups/d68d7afdc3254505b48996933bc260ad` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.838981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b32f1-7a12-46ec-bd24-64d626ef75a1 None admin] RBAC: Authorizing `identity:get_group(group_id=d68d7afdc3254505b48996933bc260ad)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:33.843326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b32f1-7a12-46ec-bd24-64d626ef75a1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:33.848690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 209/427] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:33 2022] GET /identity/v3/groups/d68d7afdc3254505b48996933bc260ad => generated 226 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:33.850398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1b36-8371-459a-a37f-a55cbe306460 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.850721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1b36-8371-459a-a37f-a55cbe306460 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.850997 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1b36-8371-459a-a37f-a55cbe306460 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.852418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 210/428] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:33.858964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c1b36-8371-459a-a37f-a55cbe306460 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:33.877954 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199c6d1-a7c0-413e-b141-e8c4f222df74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:33.878950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199c6d1-a7c0-413e-b141-e8c4f222df74 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.879365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199c6d1-a7c0-413e-b141-e8c4f222df74 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.879762 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199c6d1-a7c0-413e-b141-e8c4f222df74 None admin] PATH_INFO: `/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.881615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199c6d1-a7c0-413e-b141-e8c4f222df74 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1d8f38ffd428f91d8d2285d020c60)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:33.883955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199c6d1-a7c0-413e-b141-e8c4f222df74 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:33.886921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 219/429] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:33 2022] GET /identity/v3/projects/a1e1d8f38ffd428f91d8d2285d020c60 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:33.888570 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf34f-b2eb-4f4e-8d59-5ea0cca3c412 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.888988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf34f-b2eb-4f4e-8d59-5ea0cca3c412 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.889390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf34f-b2eb-4f4e-8d59-5ea0cca3c412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.916024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-adbcf34f-b2eb-4f4e-8d59-5ea0cca3c412 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:33.918423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-adbcf34f-b2eb-4f4e-8d59-5ea0cca3c412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:34.018890 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 220/430] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:34.019662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcf34f-b2eb-4f4e-8d59-5ea0cca3c412 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.099915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c1b36-8371-459a-a37f-a55cbe306460 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:34.174090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611f6a-d994-4542-9174-9721b6d94c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:34.175166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611f6a-d994-4542-9174-9721b6d94c2c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.175638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611f6a-d994-4542-9174-9721b6d94c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.176117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611f6a-d994-4542-9174-9721b6d94c2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.177511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d611f6a-d994-4542-9174-9721b6d94c2c None admin] RBAC: Adding query filter params (group.id=d68d7afdc3254505b48996933bc260ad, role.id=6721d4c1040945dd8817af24236acb65, scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:34.178054 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d611f6a-d994-4542-9174-9721b6d94c2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:34.180955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d611f6a-d994-4542-9174-9721b6d94c2c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:34.192827 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 211/431] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:33 2022] GET /identity/v3/role_assignments?group.id=d68d7afdc3254505b48996933bc260ad&scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60&role.id=6721d4c1040945dd8817af24236acb65 => generated 611 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:34.195136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcf34f-b2eb-4f4e-8d59-5ea0cca3c412 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:34.195702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af38c57-1c05-426a-8b5a-fea7b6994324 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.195702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af38c57-1c05-426a-8b5a-fea7b6994324 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.196088 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af38c57-1c05-426a-8b5a-fea7b6994324 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.199812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 212/432] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:34.205002 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:34.208728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e002c-87aa-4bc6-9ca7-f33dca5fa6dc None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.218779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e002c-87aa-4bc6-9ca7-f33dca5fa6dc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.225879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e002c-87aa-4bc6-9ca7-f33dca5fa6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.241877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a2e36-70ab-4069-be0f-ea553e5193a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:34.249305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a2e36-70ab-4069-be0f-ea553e5193a2 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.249812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a2e36-70ab-4069-be0f-ea553e5193a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.250419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a2e36-70ab-4069-be0f-ea553e5193a2 None admin] PATH_INFO: `/v3/groups/d68d7afdc3254505b48996933bc260ad` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.251862 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a2e36-70ab-4069-be0f-ea553e5193a2 None admin] RBAC: Authorizing `identity:get_group(group_id=d68d7afdc3254505b48996933bc260ad)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:34.253265 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e97e002c-87aa-4bc6-9ca7-f33dca5fa6dc None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:34.253493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a2e36-70ab-4069-be0f-ea553e5193a2 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:34.255413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 221/433] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/groups/d68d7afdc3254505b48996933bc260ad => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:34.255816 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e97e002c-87aa-4bc6-9ca7-f33dca5fa6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:34.263043 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a2e36-70ab-4069-be0f-ea553e5193a2 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.366643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:34.408826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 213/434] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:34.410424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e002c-87aa-4bc6-9ca7-f33dca5fa6dc None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.550966 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a2e36-70ab-4069-be0f-ea553e5193a2 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:34.570458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e002c-87aa-4bc6-9ca7-f33dca5fa6dc None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:34.629486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104476f-afb8-4ac5-a8ed-12a3b4fa3c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:34.630553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104476f-afb8-4ac5-a8ed-12a3b4fa3c9a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.630858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104476f-afb8-4ac5-a8ed-12a3b4fa3c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.631173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104476f-afb8-4ac5-a8ed-12a3b4fa3c9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.647013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104476f-afb8-4ac5-a8ed-12a3b4fa3c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-8104476f-afb8-4ac5-a8ed-12a3b4fa3c9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:34.654527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:34.655495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:34.656284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 214/435] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:34.656931 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f27f4-3f2e-4a52-83a1-4fcf58608148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:34.658082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f27f4-3f2e-4a52-83a1-4fcf58608148 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.663731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f27f4-3f2e-4a52-83a1-4fcf58608148 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.663731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f27f4-3f2e-4a52-83a1-4fcf58608148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.663731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f27f4-3f2e-4a52-83a1-4fcf58608148 None admin] RBAC: Adding query filter params (group.id=d68d7afdc3254505b48996933bc260ad, role.id=3b2b994bb5314391bf684502bd09e733, scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:34.663731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f27f4-3f2e-4a52-83a1-4fcf58608148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:34.664672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f27f4-3f2e-4a52-83a1-4fcf58608148 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:34.665344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104476f-afb8-4ac5-a8ed-12a3b4fa3c9a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.684498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 222/436] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/role_assignments?group.id=d68d7afdc3254505b48996933bc260ad&scope.project.id=a1e1d8f38ffd428f91d8d2285d020c60&role.id=3b2b994bb5314391bf684502bd09e733 => generated 611 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:34.718730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:34.804095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104476f-afb8-4ac5-a8ed-12a3b4fa3c9a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:34.848636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d8853-ffc3-4377-9b87-0e0c5b78deac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:34.849272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8853-ffc3-4377-9b87-0e0c5b78deac None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.849550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8853-ffc3-4377-9b87-0e0c5b78deac None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.849821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8853-ffc3-4377-9b87-0e0c5b78deac None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.850570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d8853-ffc3-4377-9b87-0e0c5b78deac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:34.850872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d8853-ffc3-4377-9b87-0e0c5b78deac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:34.851349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f27f4-3f2e-4a52-83a1-4fcf58608148 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.852476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d8853-ffc3-4377-9b87-0e0c5b78deac None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:34.864820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 215/437] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:34.874923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d8853-ffc3-4377-9b87-0e0c5b78deac None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.953786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:35.097285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f27f4-3f2e-4a52-83a1-4fcf58608148 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.113530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:35.123785 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d8853-ffc3-4377-9b87-0e0c5b78deac None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.157973 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e22e7-1b4e-4857-8365-bcc2a44543fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.158720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e22e7-1b4e-4857-8365-bcc2a44543fe None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.159000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e22e7-1b4e-4857-8365-bcc2a44543fe None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.159269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e22e7-1b4e-4857-8365-bcc2a44543fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.181867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e22e7-1b4e-4857-8365-bcc2a44543fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-3f5e22e7-1b4e-4857-8365-bcc2a44543fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:35.192237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:35.193205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:35.194012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:35.194012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:35.194012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:35.194012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:35.194012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:35.194012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:35.194012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:35.194012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:35.194012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:35.194012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:35.194012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:35.194012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:35.202893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 223/438] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:35.203534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c859af-040d-4e26-9b50-1e5bfaf1749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.204267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c859af-040d-4e26-9b50-1e5bfaf1749d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.204784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c859af-040d-4e26-9b50-1e5bfaf1749d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.204784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c859af-040d-4e26-9b50-1e5bfaf1749d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.205357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f16edf-b94b-47b7-8acf-57eb3353f202 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.205807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f16edf-b94b-47b7-8acf-57eb3353f202 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.206177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f16edf-b94b-47b7-8acf-57eb3353f202 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.209461 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 224/439] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:35.214316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f16edf-b94b-47b7-8acf-57eb3353f202 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:35.342627 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c859af-040d-4e26-9b50-1e5bfaf1749d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:35.345302 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c859af-040d-4e26-9b50-1e5bfaf1749d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:35.410646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:35.419886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f16edf-b94b-47b7-8acf-57eb3353f202 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.482710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf5b86-f58c-470b-8112-7d0c9a4b0c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.484025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5b86-f58c-470b-8112-7d0c9a4b0c96 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.484455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5b86-f58c-470b-8112-7d0c9a4b0c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.484951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5b86-f58c-470b-8112-7d0c9a4b0c96 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.485998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf5b86-f58c-470b-8112-7d0c9a4b0c96 None admin] RBAC: Adding query filter params (name=member) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:35.486587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf5b86-f58c-470b-8112-7d0c9a4b0c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:35.489051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf5b86-f58c-470b-8112-7d0c9a4b0c96 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:35.506605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 225/440] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:35.508470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba67e2-2c1c-44a7-ae71-65813c22f762 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.508749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba67e2-2c1c-44a7-ae71-65813c22f762 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.509020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba67e2-2c1c-44a7-ae71-65813c22f762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.532453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e1ba67e2-2c1c-44a7-ae71-65813c22f762 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:35.533662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e1ba67e2-2c1c-44a7-ae71-65813c22f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:35.542833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:35.547550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 216/441] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:07:35.548443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c859af-040d-4e26-9b50-1e5bfaf1749d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:35.636012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 226/442] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:35.637475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba67e2-2c1c-44a7-ae71-65813c22f762 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:35.701437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c859af-040d-4e26-9b50-1e5bfaf1749d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.752681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81a3da-6f7c-404d-a79c-a26d4b9ef2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.753345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a3da-6f7c-404d-a79c-a26d4b9ef2ea None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.754283 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a3da-6f7c-404d-a79c-a26d4b9ef2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.754283 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a3da-6f7c-404d-a79c-a26d4b9ef2ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.820692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:35.837984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba67e2-2c1c-44a7-ae71-65813c22f762 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.856646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:35.862772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81a3da-6f7c-404d-a79c-a26d4b9ef2ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:35.864705 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81a3da-6f7c-404d-a79c-a26d4b9ef2ea None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:35.901968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c9e52-1a82-4813-ac08-9b7a810f97ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.902956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c9e52-1a82-4813-ac08-9b7a810f97ee None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.903235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c9e52-1a82-4813-ac08-9b7a810f97ee None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.903503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c9e52-1a82-4813-ac08-9b7a810f97ee None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.904799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c9e52-1a82-4813-ac08-9b7a810f97ee None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:35.906343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c9e52-1a82-4813-ac08-9b7a810f97ee None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:35.914060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 227/443] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:35 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:35.915952 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c9e52-1a82-4813-ac08-9b7a810f97ee None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.018295 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 217/444] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:36.019089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81a3da-6f7c-404d-a79c-a26d4b9ef2ea None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.059144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c9e52-1a82-4813-ac08-9b7a810f97ee None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.098756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82797d66-3a7f-40f6-b830-a689f0a0ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.099394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82797d66-3a7f-40f6-b830-a689f0a0ccfd None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.099673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82797d66-3a7f-40f6-b830-a689f0a0ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.099941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82797d66-3a7f-40f6-b830-a689f0a0ccfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.115156 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82797d66-3a7f-40f6-b830-a689f0a0ccfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-82797d66-3a7f-40f6-b830-a689f0a0ccfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:36.120303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:36.122482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:36.124076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:36.124076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:36.124076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:36.124076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:36.124076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:36.124076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:36.124076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:36.124076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:36.124076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:36.124076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:36.124076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:36.124076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:36.126869 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 228/445] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:07:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:36.128518 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82797d66-3a7f-40f6-b830-a689f0a0ccfd None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.155077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:36.156167 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:36.160631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81a3da-6f7c-404d-a79c-a26d4b9ef2ea None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.203936 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57581a94-8ba7-4eff-a047-124e5e57e68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.204789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57581a94-8ba7-4eff-a047-124e5e57e68c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.204905 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57581a94-8ba7-4eff-a047-124e5e57e68c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.205118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57581a94-8ba7-4eff-a047-124e5e57e68c None admin] PATH_INFO: `/v3/groups/d68d7afdc3254505b48996933bc260ad` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.206459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57581a94-8ba7-4eff-a047-124e5e57e68c None admin] RBAC: Authorizing `identity:get_group(group_id=d68d7afdc3254505b48996933bc260ad)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:36.207972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57581a94-8ba7-4eff-a047-124e5e57e68c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:36.209679 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 218/446] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/groups/d68d7afdc3254505b48996933bc260ad => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:36.210531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57581a94-8ba7-4eff-a047-124e5e57e68c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.263935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82797d66-3a7f-40f6-b830-a689f0a0ccfd None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.319103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab228a-2661-4f96-8888-035317113605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.319678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab228a-2661-4f96-8888-035317113605 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.320025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab228a-2661-4f96-8888-035317113605 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.320327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab228a-2661-4f96-8888-035317113605 None admin] PATH_INFO: `/v3/projects/9bcee52eea134a719563c19653e9371c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.322065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab228a-2661-4f96-8888-035317113605 None admin] RBAC: Authorizing `identity:get_project(project_id=9bcee52eea134a719563c19653e9371c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:36.324889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab228a-2661-4f96-8888-035317113605 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:36.328556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 229/447] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/projects/9bcee52eea134a719563c19653e9371c => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:36.329837 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab228a-2661-4f96-8888-035317113605 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.330003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57581a94-8ba7-4eff-a047-124e5e57e68c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.376335 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658fd91-37ba-4438-a71c-2a32758a2c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.376964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658fd91-37ba-4438-a71c-2a32758a2c3a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.377253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658fd91-37ba-4438-a71c-2a32758a2c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.377525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658fd91-37ba-4438-a71c-2a32758a2c3a None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.378212 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658fd91-37ba-4438-a71c-2a32758a2c3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:36.378546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658fd91-37ba-4438-a71c-2a32758a2c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:36.379996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658fd91-37ba-4438-a71c-2a32758a2c3a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:36.390653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 219/448] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:36.391532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658fd91-37ba-4438-a71c-2a32758a2c3a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.430263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:36.466429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:36.488747 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab228a-2661-4f96-8888-035317113605 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.522001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658fd91-37ba-4438-a71c-2a32758a2c3a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.531043 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630d64e-2fd4-4711-b86b-11b6a8a30d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.531668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630d64e-2fd4-4711-b86b-11b6a8a30d2d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.531953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630d64e-2fd4-4711-b86b-11b6a8a30d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.532233 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630d64e-2fd4-4711-b86b-11b6a8a30d2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.532993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630d64e-2fd4-4711-b86b-11b6a8a30d2d None admin] RBAC: Adding query filter params (group.id=d68d7afdc3254505b48996933bc260ad, role.id=3b2b994bb5314391bf684502bd09e733, scope.project.id=9bcee52eea134a719563c19653e9371c) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:36.533304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630d64e-2fd4-4711-b86b-11b6a8a30d2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:36.534830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630d64e-2fd4-4711-b86b-11b6a8a30d2d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:36.543756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 230/449] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/role_assignments?group.id=d68d7afdc3254505b48996933bc260ad&scope.project.id=9bcee52eea134a719563c19653e9371c&role.id=3b2b994bb5314391bf684502bd09e733 => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:36.545234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630d64e-2fd4-4711-b86b-11b6a8a30d2d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.585641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092ea17-e03f-458a-9084-145b37ae872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.586554 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092ea17-e03f-458a-9084-145b37ae872a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.586980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092ea17-e03f-458a-9084-145b37ae872a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.587392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092ea17-e03f-458a-9084-145b37ae872a None admin] PATH_INFO: `/v3/groups/d68d7afdc3254505b48996933bc260ad` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.590022 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092ea17-e03f-458a-9084-145b37ae872a None admin] RBAC: Authorizing `identity:get_group(group_id=d68d7afdc3254505b48996933bc260ad)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:36.592533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092ea17-e03f-458a-9084-145b37ae872a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:36.595575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 220/450] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/groups/d68d7afdc3254505b48996933bc260ad => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:36.604626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092ea17-e03f-458a-9084-145b37ae872a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.751724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:36.754303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630d64e-2fd4-4711-b86b-11b6a8a30d2d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.759506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092ea17-e03f-458a-9084-145b37ae872a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.816256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ebb21-7331-4479-942a-25465a13ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.817199 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ebb21-7331-4479-942a-25465a13ee1a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.817687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ebb21-7331-4479-942a-25465a13ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.818119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ebb21-7331-4479-942a-25465a13ee1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.819536 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ebb21-7331-4479-942a-25465a13ee1a None admin] RBAC: Adding query filter params (group.id=d68d7afdc3254505b48996933bc260ad, role.id=6721d4c1040945dd8817af24236acb65, scope.project.id=9bcee52eea134a719563c19653e9371c) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:36.820035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ebb21-7331-4479-942a-25465a13ee1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:36.821777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c5306-7fba-45c7-9d8a-28fd7788d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.822625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ebb21-7331-4479-942a-25465a13ee1a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:36.822877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c5306-7fba-45c7-9d8a-28fd7788d0aa None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.823314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c5306-7fba-45c7-9d8a-28fd7788d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.823746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c5306-7fba-45c7-9d8a-28fd7788d0aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.832534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 221/451] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/role_assignments?group.id=d68d7afdc3254505b48996933bc260ad&scope.project.id=9bcee52eea134a719563c19653e9371c&role.id=6721d4c1040945dd8817af24236acb65 => generated 611 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:36.855898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:36.934466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c5306-7fba-45c7-9d8a-28fd7788d0aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:36.936125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c5306-7fba-45c7-9d8a-28fd7788d0aa None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:37.083303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 231/452] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:37.090028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ebb21-7331-4479-942a-25465a13ee1a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:37.226316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ebb21-7331-4479-942a-25465a13ee1a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:37.268791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe668b-022e-440b-8375-741f05242ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:37.269466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe668b-022e-440b-8375-741f05242ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.274141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe668b-022e-440b-8375-741f05242ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.274141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe668b-022e-440b-8375-741f05242ba9 None admin] PATH_INFO: `/v3/projects/9f67ec719bc34531ae1e710c78054427` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.274141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe668b-022e-440b-8375-741f05242ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=9f67ec719bc34531ae1e710c78054427)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:37.274141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe668b-022e-440b-8375-741f05242ba9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:37.275088 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 222/453] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:37 2022] GET /identity/v3/projects/9f67ec719bc34531ae1e710c78054427 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:37.281363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c5306-7fba-45c7-9d8a-28fd7788d0aa None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:37.355413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:37.434845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c5306-7fba-45c7-9d8a-28fd7788d0aa None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:37.480877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02e17d-21d2-47e4-bd16-b85d993464a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:37.481614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e17d-21d2-47e4-bd16-b85d993464a9 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.482024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e17d-21d2-47e4-bd16-b85d993464a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.482448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e17d-21d2-47e4-bd16-b85d993464a9 None admin] PATH_INFO: `/v3/groups/d5a629c23c5f49af85a3658d2a3a45de` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.483971 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02e17d-21d2-47e4-bd16-b85d993464a9 None admin] RBAC: Authorizing `identity:get_group(group_id=d5a629c23c5f49af85a3658d2a3a45de)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:37.485621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02e17d-21d2-47e4-bd16-b85d993464a9 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:37.487485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 232/454] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:37 2022] GET /identity/v3/groups/d5a629c23c5f49af85a3658d2a3a45de => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:37.493908 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe668b-022e-440b-8375-741f05242ba9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:37.531695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:37.616384 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe668b-022e-440b-8375-741f05242ba9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:37.654884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290667cb-bb05-42a1-b776-d537fcaa61bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:37.655693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290667cb-bb05-42a1-b776-d537fcaa61bf None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.655909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290667cb-bb05-42a1-b776-d537fcaa61bf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.656223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290667cb-bb05-42a1-b776-d537fcaa61bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.657022 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290667cb-bb05-42a1-b776-d537fcaa61bf None admin] RBAC: Adding query filter params (group.id=d5a629c23c5f49af85a3658d2a3a45de, role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=9f67ec719bc34531ae1e710c78054427) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:37.657372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290667cb-bb05-42a1-b776-d537fcaa61bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:37.658955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290667cb-bb05-42a1-b776-d537fcaa61bf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:37.665991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 223/455] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:37 2022] GET /identity/v3/role_assignments?group.id=d5a629c23c5f49af85a3658d2a3a45de&scope.project.id=9f67ec719bc34531ae1e710c78054427&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:40.305114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a22d-8c59-4afa-a497-7318fa945274 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:40.305945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a22d-8c59-4afa-a497-7318fa945274 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:40.305945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a22d-8c59-4afa-a497-7318fa945274 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:40.307630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 233/456] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:40.314794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f68a9-124d-4b0a-8196-2a6445773497 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:40.316218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f68a9-124d-4b0a-8196-2a6445773497 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:40.316966 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f68a9-124d-4b0a-8196-2a6445773497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:40.362252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-804f68a9-124d-4b0a-8196-2a6445773497 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:40.362252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-804f68a9-124d-4b0a-8196-2a6445773497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:40.498971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 224/457] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:40.920751 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a22d-8c59-4afa-a497-7318fa945274 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:41.046437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41973-5262-46d8-9fcc-42765d2e9bee None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.047121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41973-5262-46d8-9fcc-42765d2e9bee None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.047624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41973-5262-46d8-9fcc-42765d2e9bee None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.051043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 225/458] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:41.057564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008fe7d-ae78-4af2-a655-ac72e668153d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.057962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008fe7d-ae78-4af2-a655-ac72e668153d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.058262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008fe7d-ae78-4af2-a655-ac72e668153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.098775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a22d-8c59-4afa-a497-7318fa945274 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:41.110538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f008fe7d-ae78-4af2-a655-ac72e668153d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:41.111791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f008fe7d-ae78-4af2-a655-ac72e668153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:41.138784 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:41.148961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54d72e-d52a-4d96-94e3-f04468b2b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:41.149606 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54d72e-d52a-4d96-94e3-f04468b2b3eb None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.149885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54d72e-d52a-4d96-94e3-f04468b2b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.154293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54d72e-d52a-4d96-94e3-f04468b2b3eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.160218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:41.171473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54d72e-d52a-4d96-94e3-f04468b2b3eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:41.172896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54d72e-d52a-4d96-94e3-f04468b2b3eb None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-af54d72e-d52a-4d96-94e3-f04468b2b3eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:41.238150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:41.239180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:41.240022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:41.240022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:41.240022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:41.240022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 234/459] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:41.248085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54d72e-d52a-4d96-94e3-f04468b2b3eb None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:41.307185 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 226/460] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:41.445713 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ae1e-e382-4619-a2ed-470f0d7ea1c5 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.446776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ae1e-e382-4619-a2ed-470f0d7ea1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.447363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ae1e-e382-4619-a2ed-470f0d7ea1c5 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.453352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 227/461] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:41.455256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717736be-c331-4da1-84d0-170ee53bfe7d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.455793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717736be-c331-4da1-84d0-170ee53bfe7d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.456293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717736be-c331-4da1-84d0-170ee53bfe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.458890 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54d72e-d52a-4d96-94e3-f04468b2b3eb None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:41.522663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-717736be-c331-4da1-84d0-170ee53bfe7d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:41.525061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-717736be-c331-4da1-84d0-170ee53bfe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:41.586558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605043de-9a51-41c2-abf9-d765cd3039af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:41.587667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605043de-9a51-41c2-abf9-d765cd3039af None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.588722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605043de-9a51-41c2-abf9-d765cd3039af None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.589222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605043de-9a51-41c2-abf9-d765cd3039af None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.590536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605043de-9a51-41c2-abf9-d765cd3039af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:41.591103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605043de-9a51-41c2-abf9-d765cd3039af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:41.593938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605043de-9a51-41c2-abf9-d765cd3039af None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:41.619273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 235/462] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:41.628858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605043de-9a51-41c2-abf9-d765cd3039af None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:41.701160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:41.731725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 228/463] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:41.733874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717736be-c331-4da1-84d0-170ee53bfe7d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:41.848950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605043de-9a51-41c2-abf9-d765cd3039af None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:41.889187 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:41.927466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6e536-9650-496f-bf12-fd5cca9bf5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:41.928091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6e536-9650-496f-bf12-fd5cca9bf5b7 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.928365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6e536-9650-496f-bf12-fd5cca9bf5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.928637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6e536-9650-496f-bf12-fd5cca9bf5b7 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.929394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6e536-9650-496f-bf12-fd5cca9bf5b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:41.931185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6e536-9650-496f-bf12-fd5cca9bf5b7 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:41.931546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717736be-c331-4da1-84d0-170ee53bfe7d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:41.983461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf0433-2908-479b-8124-925ef7e4bc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:41.984461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf0433-2908-479b-8124-925ef7e4bc7a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.984936 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf0433-2908-479b-8124-925ef7e4bc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.985405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf0433-2908-479b-8124-925ef7e4bc7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.999608 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf0433-2908-479b-8124-925ef7e4bc7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.001566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf0433-2908-479b-8124-925ef7e4bc7a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-facf0433-2908-479b-8124-925ef7e4bc7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:42.021425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:42.022858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:42.023995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:42.023995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:42.023995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:42.026841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 229/464] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:42.028666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69c325-76a3-4e19-b0e4-1f949ac5dc84 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.029179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69c325-76a3-4e19-b0e4-1f949ac5dc84 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.029637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69c325-76a3-4e19-b0e4-1f949ac5dc84 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.031726 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 230/465] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:42.032843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69c325-76a3-4e19-b0e4-1f949ac5dc84 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.037356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 236/466] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:41 2022] POST /identity/v3/users => generated 248 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:07:42.044039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b75118-0095-4483-b06d-c9732183113e None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.044728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b75118-0095-4483-b06d-c9732183113e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.045313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b75118-0095-4483-b06d-c9732183113e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.087751 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d8b75118-0095-4483-b06d-c9732183113e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:42.090330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d8b75118-0095-4483-b06d-c9732183113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:42.211956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 237/467] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:42.213404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b75118-0095-4483-b06d-c9732183113e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.265493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:42.286826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69c325-76a3-4e19-b0e4-1f949ac5dc84 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.362865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a1911-4c76-4038-8383-37591a65aad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.364610 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a1911-4c76-4038-8383-37591a65aad5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.365361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a1911-4c76-4038-8383-37591a65aad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.366319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a1911-4c76-4038-8383-37591a65aad5 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.367828 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a1911-4c76-4038-8383-37591a65aad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:42.368675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a1911-4c76-4038-8383-37591a65aad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.371738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a1911-4c76-4038-8383-37591a65aad5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.376678 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:42.410132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 231/468] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:42.419573 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a1911-4c76-4038-8383-37591a65aad5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.473234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b75118-0095-4483-b06d-c9732183113e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.557421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1873c9-9416-450e-a900-63855fb9e088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.558995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1873c9-9416-450e-a900-63855fb9e088 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.566181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1873c9-9416-450e-a900-63855fb9e088 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.567095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1873c9-9416-450e-a900-63855fb9e088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.588296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1873c9-9416-450e-a900-63855fb9e088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.591731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1873c9-9416-450e-a900-63855fb9e088 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-9a1873c9-9416-450e-a900-63855fb9e088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:42.622142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:42.623904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:42.625520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:42.625520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:42.625520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:42.627113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a1911-4c76-4038-8383-37591a65aad5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.629945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 238/469] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:42.631792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1873c9-9416-450e-a900-63855fb9e088 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.672358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b6f31-2024-477c-9a22-ba0c28aaab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.672983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b6f31-2024-477c-9a22-ba0c28aaab2f None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.673254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b6f31-2024-477c-9a22-ba0c28aaab2f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.673517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b6f31-2024-477c-9a22-ba0c28aaab2f None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.674180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b6f31-2024-477c-9a22-ba0c28aaab2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.675693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b6f31-2024-477c-9a22-ba0c28aaab2f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.766576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:42.790793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 232/470] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:42 2022] POST /identity/v3/users => generated 246 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:42.792384 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b6f31-2024-477c-9a22-ba0c28aaab2f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.868700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:42.871105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1873c9-9416-450e-a900-63855fb9e088 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.941045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b6f31-2024-477c-9a22-ba0c28aaab2f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.946863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234c817-6915-4d2e-9ad5-46614f2065f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.948252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234c817-6915-4d2e-9ad5-46614f2065f1 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.948745 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234c817-6915-4d2e-9ad5-46614f2065f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.949217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234c817-6915-4d2e-9ad5-46614f2065f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.965515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234c817-6915-4d2e-9ad5-46614f2065f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.967807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234c817-6915-4d2e-9ad5-46614f2065f1 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-4234c817-6915-4d2e-9ad5-46614f2065f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:42.988004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:42.988972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:42.989790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:42.989790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:42.989790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:42.991959 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 239/471] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:42.997410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75746855-9692-4264-8b4c-fca8921f7499 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.997600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75746855-9692-4264-8b4c-fca8921f7499 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.998486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75746855-9692-4264-8b4c-fca8921f7499 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.002624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 240/472] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:43.010980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75746855-9692-4264-8b4c-fca8921f7499 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:43.015919 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141180a-a578-41f7-a55a-5c618e800bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:43.016960 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141180a-a578-41f7-a55a-5c618e800bdd None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.017522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141180a-a578-41f7-a55a-5c618e800bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.018010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141180a-a578-41f7-a55a-5c618e800bdd None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.018973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141180a-a578-41f7-a55a-5c618e800bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:43.019497 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141180a-a578-41f7-a55a-5c618e800bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:43.021148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141180a-a578-41f7-a55a-5c618e800bdd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:43.037477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 233/473] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:43.043847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc2f10-ec3e-46a5-b3b3-83054e2c4e3f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.044498 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc2f10-ec3e-46a5-b3b3-83054e2c4e3f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.045110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc2f10-ec3e-46a5-b3b3-83054e2c4e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.066754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2ebc2f10-ec3e-46a5-b3b3-83054e2c4e3f None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:43.068571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2ebc2f10-ec3e-46a5-b3b3-83054e2c4e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:43.198307 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75746855-9692-4264-8b4c-fca8921f7499 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:43.202365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 234/474] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:43.205832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc2f10-ec3e-46a5-b3b3-83054e2c4e3f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:43.277309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:43.299049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:43.327694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6da54e-9519-461b-a99e-df5560ab0c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:43.328331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6da54e-9519-461b-a99e-df5560ab0c2a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.328616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6da54e-9519-461b-a99e-df5560ab0c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.328893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6da54e-9519-461b-a99e-df5560ab0c2a None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.329572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6da54e-9519-461b-a99e-df5560ab0c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:43.329877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6da54e-9519-461b-a99e-df5560ab0c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:43.331333 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6da54e-9519-461b-a99e-df5560ab0c2a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:43.374392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc2f10-ec3e-46a5-b3b3-83054e2c4e3f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:43.399998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 241/475] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:43.406957 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6da54e-9519-461b-a99e-df5560ab0c2a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:43.434680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808aaf-c6e4-409e-9244-08d722233c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:43.435697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808aaf-c6e4-409e-9244-08d722233c8b None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.436177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808aaf-c6e4-409e-9244-08d722233c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.436653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808aaf-c6e4-409e-9244-08d722233c8b None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.437851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87808aaf-c6e4-409e-9244-08d722233c8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:43.440623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87808aaf-c6e4-409e-9244-08d722233c8b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:43.570998 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 235/476] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:43 2022] POST /identity/v3/users => generated 248 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:43.650059 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808aaf-c6e4-409e-9244-08d722233c8b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:43.665396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6da54e-9519-461b-a99e-df5560ab0c2a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:43.756115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e18d5-c2b4-431f-8af2-7fdca5eb6869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:43.756791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e18d5-c2b4-431f-8af2-7fdca5eb6869 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.757067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e18d5-c2b4-431f-8af2-7fdca5eb6869 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.758489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e18d5-c2b4-431f-8af2-7fdca5eb6869 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.759219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e18d5-c2b4-431f-8af2-7fdca5eb6869 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:43.761265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e18d5-c2b4-431f-8af2-7fdca5eb6869 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:43.834766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:43.847888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808aaf-c6e4-409e-9244-08d722233c8b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:43.896933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 242/477] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:43 2022] POST /identity/v3/users => generated 249 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:43.913662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755e4e6-f1e3-41e4-a84e-750d3c920949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:43.914790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755e4e6-f1e3-41e4-a84e-750d3c920949 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.915393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755e4e6-f1e3-41e4-a84e-750d3c920949 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.915891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755e4e6-f1e3-41e4-a84e-750d3c920949 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.918791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755e4e6-f1e3-41e4-a84e-750d3c920949 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:43.921803 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755e4e6-f1e3-41e4-a84e-750d3c920949 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:43.988577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.sql.core [None req-b755e4e6-f1e3-41e4-a84e-750d3c920949 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 20:07:43.988577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 20:07:43.988577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [parameters: {'id': '8eb8bce3a0d64cefa4676124503f840b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 20:07:43.988577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81954) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b755e4e6-f1e3-41e4-a84e-750d3c920949 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application result.read() Aug 29 20:07:44.035839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:07:44.036945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application yield resource Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise self.value Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application session.commit() Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 20:07:44.038145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self.session.flush() Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application compat.raise_( Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 20:07:44.039097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:07:44.039949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application result.read() Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:07:44.041686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [parameters: {'id': '8eb8bce3a0d64cefa4676124503f840b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:44.042628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 20:07:44.043459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:44.044844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 236/478] 10.222.0.81 () {60 vars in 1131 bytes} [Mon Aug 29 20:07:43 2022] POST /identity/v3/roles => generated 144 bytes in 390 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:44.050288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e18d5-c2b4-431f-8af2-7fdca5eb6869 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:44.122239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:44.229790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e18d5-c2b4-431f-8af2-7fdca5eb6869 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:44.280554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0dd26-6b69-48aa-90c0-dc1442db7420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:44.281449 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0dd26-6b69-48aa-90c0-dc1442db7420 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:44.281871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0dd26-6b69-48aa-90c0-dc1442db7420 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:44.282366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0dd26-6b69-48aa-90c0-dc1442db7420 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:44.296826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0dd26-6b69-48aa-90c0-dc1442db7420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-37b0dd26-6b69-48aa-90c0-dc1442db7420 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:44.302881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:44.304485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:44.305445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:44.305445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:44.305445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:44.305445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:44.305445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:44.305445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:44.305445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:44.305445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:44.305445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:44.305445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:44.305445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:44.305445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:44.308139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 243/479] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:44.314108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755e4e6-f1e3-41e4-a84e-750d3c920949 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:44.521952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755e4e6-f1e3-41e4-a84e-750d3c920949 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:44.578981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afa541-aa15-4392-a404-485263015f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:44.579632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afa541-aa15-4392-a404-485263015f8d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:44.579910 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afa541-aa15-4392-a404-485263015f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:44.580182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afa541-aa15-4392-a404-485263015f8d None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:44.580962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afa541-aa15-4392-a404-485263015f8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:44.581270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afa541-aa15-4392-a404-485263015f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:44.582750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afa541-aa15-4392-a404-485263015f8d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:44.593929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 237/480] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:45.268791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780d3df-309f-450c-9a69-6df819e726fd None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:45.269797 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780d3df-309f-450c-9a69-6df819e726fd None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:45.270293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780d3df-309f-450c-9a69-6df819e726fd None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:45.272382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 244/481] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:45.279435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c5852-117e-4e8b-a8c8-8407a507a551 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:45.279974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c5852-117e-4e8b-a8c8-8407a507a551 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:45.279974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c5852-117e-4e8b-a8c8-8407a507a551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:45.315541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-bf7c5852-117e-4e8b-a8c8-8407a507a551 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:45.317021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bf7c5852-117e-4e8b-a8c8-8407a507a551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:45.339826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:45.424875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 238/482] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:45.743153 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e25e1-8050-4349-9054-a66947623f34 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:45.743458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e25e1-8050-4349-9054-a66947623f34 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:45.743885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e25e1-8050-4349-9054-a66947623f34 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:45.746848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 245/483] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:45.752710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27969449-c025-4e24-9d97-242ac8d94da9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:45.753113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27969449-c025-4e24-9d97-242ac8d94da9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:45.753265 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27969449-c025-4e24-9d97-242ac8d94da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:45.781455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-27969449-c025-4e24-9d97-242ac8d94da9 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:45.782704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-27969449-c025-4e24-9d97-242ac8d94da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:45.881885 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 239/484] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:45.946448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e25e1-8050-4349-9054-a66947623f34 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:46.155132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:46.173834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e25e1-8050-4349-9054-a66947623f34 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:46.247020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cb824-ee5f-4da9-8f4e-0bb9b9903b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:46.247669 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cb824-ee5f-4da9-8f4e-0bb9b9903b0e None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.248018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cb824-ee5f-4da9-8f4e-0bb9b9903b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.248273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cb824-ee5f-4da9-8f4e-0bb9b9903b0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.262997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cb824-ee5f-4da9-8f4e-0bb9b9903b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-3f9cb824-ee5f-4da9-8f4e-0bb9b9903b0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:46.268146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:46.269528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:46.270411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 246/485] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:46.283427 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27969449-c025-4e24-9d97-242ac8d94da9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:46.437211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cb824-ee5f-4da9-8f4e-0bb9b9903b0e None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:46.441776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:46.465118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27969449-c025-4e24-9d97-242ac8d94da9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:46.521670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0b35f-e222-4816-b2d7-b3828063e05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:46.522331 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0b35f-e222-4816-b2d7-b3828063e05e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.522611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0b35f-e222-4816-b2d7-b3828063e05e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.522876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0b35f-e222-4816-b2d7-b3828063e05e None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.523846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0b35f-e222-4816-b2d7-b3828063e05e None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:46.524183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0b35f-e222-4816-b2d7-b3828063e05e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:46.531419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0b35f-e222-4816-b2d7-b3828063e05e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:46.546331 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 240/486] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:46.547623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2213839-30dc-4070-bf7d-01b43c679b6b None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.547911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2213839-30dc-4070-bf7d-01b43c679b6b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.548217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2213839-30dc-4070-bf7d-01b43c679b6b None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.549703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 241/487] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:46.554188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2213839-30dc-4070-bf7d-01b43c679b6b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:46.644317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cb824-ee5f-4da9-8f4e-0bb9b9903b0e None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:46.707703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d86cf-d6a9-48c4-9fcf-516510f1d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:46.708223 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d86cf-d6a9-48c4-9fcf-516510f1d1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.708498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d86cf-d6a9-48c4-9fcf-516510f1d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.709173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d86cf-d6a9-48c4-9fcf-516510f1d1c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.726786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d86cf-d6a9-48c4-9fcf-516510f1d1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-a23d86cf-d6a9-48c4-9fcf-516510f1d1c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:46.732281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:46.733282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:46.734342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 247/488] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:46.735635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba209acc-9637-4f51-800a-c15f0033116d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.735635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba209acc-9637-4f51-800a-c15f0033116d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.735635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba209acc-9637-4f51-800a-c15f0033116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.747527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2213839-30dc-4070-bf7d-01b43c679b6b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:46.762593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ba209acc-9637-4f51-800a-c15f0033116d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:46.764007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ba209acc-9637-4f51-800a-c15f0033116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:46.781324 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:46.805359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a356f4-6423-47f6-b0b0-0f78c0051275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:46.806430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a356f4-6423-47f6-b0b0-0f78c0051275 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.807296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a356f4-6423-47f6-b0b0-0f78c0051275 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.807664 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a356f4-6423-47f6-b0b0-0f78c0051275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.822342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a356f4-6423-47f6-b0b0-0f78c0051275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:46.823812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a356f4-6423-47f6-b0b0-0f78c0051275 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:46.827541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-15a356f4-6423-47f6-b0b0-0f78c0051275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:46.842075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:46.843339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:46.844619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:46.844619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:46.844619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:46.844619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 242/489] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:46.845088 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6510fa-4d8b-4307-90d9-15d6a4b07974 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.845287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6510fa-4d8b-4307-90d9-15d6a4b07974 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.845559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6510fa-4d8b-4307-90d9-15d6a4b07974 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.851418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 243/490] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:46.851418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6510fa-4d8b-4307-90d9-15d6a4b07974 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:46.882802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 248/491] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:46.883408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba209acc-9637-4f51-800a-c15f0033116d None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.036554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba209acc-9637-4f51-800a-c15f0033116d None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.054536 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6510fa-4d8b-4307-90d9-15d6a4b07974 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.090297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523faade-b765-4b8b-9b81-341ba93df3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.091694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523faade-b765-4b8b-9b81-341ba93df3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.092128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523faade-b765-4b8b-9b81-341ba93df3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.092567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523faade-b765-4b8b-9b81-341ba93df3d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.093377 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523faade-b765-4b8b-9b81-341ba93df3d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:47.093823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523faade-b765-4b8b-9b81-341ba93df3d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.095466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523faade-b765-4b8b-9b81-341ba93df3d7 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.114028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 249/492] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:47.115739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaf0e5-edd6-4f35-88fe-13fec1786f37 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.116186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaf0e5-edd6-4f35-88fe-13fec1786f37 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.116674 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaf0e5-edd6-4f35-88fe-13fec1786f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.132561 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.132858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89de9fb-429a-4978-bb00-60668d178dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.134315 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89de9fb-429a-4978-bb00-60668d178dbf None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.135207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89de9fb-429a-4978-bb00-60668d178dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.135816 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89de9fb-429a-4978-bb00-60668d178dbf None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.137486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89de9fb-429a-4978-bb00-60668d178dbf None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:47.138307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89de9fb-429a-4978-bb00-60668d178dbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.141245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89de9fb-429a-4978-bb00-60668d178dbf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.147912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-1eeaf0e5-edd6-4f35-88fe-13fec1786f37 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:47.147912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-1eeaf0e5-edd6-4f35-88fe-13fec1786f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:47.158889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 244/493] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:47.160919 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89de9fb-429a-4978-bb00-60668d178dbf None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.266260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 250/494] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:47.266260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaf0e5-edd6-4f35-88fe-13fec1786f37 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.305675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.402864 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89de9fb-429a-4978-bb00-60668d178dbf None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.448587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6771b0-69e5-4e50-8a31-f3aae5534e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.448587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6771b0-69e5-4e50-8a31-f3aae5534e98 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.449010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6771b0-69e5-4e50-8a31-f3aae5534e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.449352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6771b0-69e5-4e50-8a31-f3aae5534e98 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.458184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6771b0-69e5-4e50-8a31-f3aae5534e98 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.460020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6771b0-69e5-4e50-8a31-f3aae5534e98 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-cd6771b0-69e5-4e50-8a31-f3aae5534e98 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:07:47.475197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:47.477065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:47.479019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:47.479019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:47.479019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:07:47.479019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:07:47.479019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:07:47.479019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:07:47.479019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:07:47.479019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:07:47.479019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:07:47.479019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:47.479019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 245/495] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:47.479019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6771b0-69e5-4e50-8a31-f3aae5534e98 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.489695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaf0e5-edd6-4f35-88fe-13fec1786f37 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.565842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0655f0-cb4e-4b89-b076-72381b242996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.566460 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0655f0-cb4e-4b89-b076-72381b242996 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.566744 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0655f0-cb4e-4b89-b076-72381b242996 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.567022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0655f0-cb4e-4b89-b076-72381b242996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.571794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.584028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0655f0-cb4e-4b89-b076-72381b242996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.585769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0655f0-cb4e-4b89-b076-72381b242996 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-2c0655f0-cb4e-4b89-b076-72381b242996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:47.603021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:47.605218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:47.607213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:47.607213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:47.607213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:47.607213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 251/496] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:47.607213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0655f0-cb4e-4b89-b076-72381b242996 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.621161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6771b0-69e5-4e50-8a31-f3aae5534e98 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.644519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.672519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d95d31-2b46-4a58-a7f1-430cf20f038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.673717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d95d31-2b46-4a58-a7f1-430cf20f038d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.674367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d95d31-2b46-4a58-a7f1-430cf20f038d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.674921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d95d31-2b46-4a58-a7f1-430cf20f038d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.695263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d95d31-2b46-4a58-a7f1-430cf20f038d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-95d95d31-2b46-4a58-a7f1-430cf20f038d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:47.704475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:47.705451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:47.706262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:47.706262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:47.706262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:47.706262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:47.706262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:47.706262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:47.706262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:47.706262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:47.706262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:47.706262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:47.706262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:47.706262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:47.707066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 246/497] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:47.708332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d37128-0c1d-4d47-ae4a-f3a2d69fe159 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.708781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d37128-0c1d-4d47-ae4a-f3a2d69fe159 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.709213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d37128-0c1d-4d47-ae4a-f3a2d69fe159 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.711357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 247/498] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:47.712496 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d37128-0c1d-4d47-ae4a-f3a2d69fe159 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.786172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0655f0-cb4e-4b89-b076-72381b242996 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.838978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0040a35-2184-4ca1-a997-15a39c32ee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.839609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0040a35-2184-4ca1-a997-15a39c32ee57 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.839894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0040a35-2184-4ca1-a997-15a39c32ee57 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.840172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0040a35-2184-4ca1-a997-15a39c32ee57 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.840967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0040a35-2184-4ca1-a997-15a39c32ee57 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:47.841276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0040a35-2184-4ca1-a997-15a39c32ee57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.842807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0040a35-2184-4ca1-a997-15a39c32ee57 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.884063 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d37128-0c1d-4d47-ae4a-f3a2d69fe159 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.885043 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 252/499] 10.222.0.81 () {56 vars in 1137 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:47.885916 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0040a35-2184-4ca1-a997-15a39c32ee57 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.929491 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc20ff-c608-415d-83fc-550934e9ca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.929999 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc20ff-c608-415d-83fc-550934e9ca8b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.930369 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc20ff-c608-415d-83fc-550934e9ca8b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.930642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc20ff-c608-415d-83fc-550934e9ca8b None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.931341 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc20ff-c608-415d-83fc-550934e9ca8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:47.932207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc20ff-c608-415d-83fc-550934e9ca8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.933654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc20ff-c608-415d-83fc-550934e9ca8b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.945220 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.948331 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 248/500] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:47.949603 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc20ff-c608-415d-83fc-550934e9ca8b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.004513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:48.022793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0040a35-2184-4ca1-a997-15a39c32ee57 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.066016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f96c-c45d-42b7-bc9f-5452754cb27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.066820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f96c-c45d-42b7-bc9f-5452754cb27c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.067101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f96c-c45d-42b7-bc9f-5452754cb27c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.067373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f96c-c45d-42b7-bc9f-5452754cb27c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.079508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305f96c-c45d-42b7-bc9f-5452754cb27c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-6305f96c-c45d-42b7-bc9f-5452754cb27c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:48.084889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:48.086576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:48.088742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 253/501] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:48.090105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc20ff-c608-415d-83fc-550934e9ca8b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.090470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c302e-f8d5-48c6-861f-56d525a1a417 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.090470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c302e-f8d5-48c6-861f-56d525a1a417 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.090470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c302e-f8d5-48c6-861f-56d525a1a417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.110181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ab2c302e-f8d5-48c6-861f-56d525a1a417 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:48.111487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ab2c302e-f8d5-48c6-861f-56d525a1a417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:48.146792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60dea2-f52c-44e3-aa8e-900b34e59ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.148542 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60dea2-f52c-44e3-aa8e-900b34e59ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.149002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60dea2-f52c-44e3-aa8e-900b34e59ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.149356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60dea2-f52c-44e3-aa8e-900b34e59ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.151080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60dea2-f52c-44e3-aa8e-900b34e59ad3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:48.151452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60dea2-f52c-44e3-aa8e-900b34e59ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.153553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60dea2-f52c-44e3-aa8e-900b34e59ad3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.162921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 249/502] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:48.163863 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60dea2-f52c-44e3-aa8e-900b34e59ad3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.206047 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 254/503] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:48.207101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c302e-f8d5-48c6-861f-56d525a1a417 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.255098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:48.340911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c302e-f8d5-48c6-861f-56d525a1a417 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.351156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:48.358164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60dea2-f52c-44e3-aa8e-900b34e59ad3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.398884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091295e-dadb-488f-889c-6fa8702b7d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.401618 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091295e-dadb-488f-889c-6fa8702b7d36 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.402910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091295e-dadb-488f-889c-6fa8702b7d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.403409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091295e-dadb-488f-889c-6fa8702b7d36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.419632 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091295e-dadb-488f-889c-6fa8702b7d36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.421414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b317ea0-74cf-4a1e-af66-41f51ee2a34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.422478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b317ea0-74cf-4a1e-af66-41f51ee2a34d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.422609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091295e-dadb-488f-889c-6fa8702b7d36 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.422950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b317ea0-74cf-4a1e-af66-41f51ee2a34d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.423422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b317ea0-74cf-4a1e-af66-41f51ee2a34d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-9091295e-dadb-488f-889c-6fa8702b7d36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:07:48.450282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:48.451329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:48.452228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:48.452228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:48.452228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:07:48.452228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:07:48.452228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:07:48.452228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:07:48.452228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:07:48.452228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:07:48.452228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:07:48.452228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:48.452786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 255/504] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:48.454054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091295e-dadb-488f-889c-6fa8702b7d36 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.550533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b317ea0-74cf-4a1e-af66-41f51ee2a34d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.552970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b317ea0-74cf-4a1e-af66-41f51ee2a34d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.617957 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:48.627663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091295e-dadb-488f-889c-6fa8702b7d36 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.677897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d14256-2c29-4810-9974-40b2924a6c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.678938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d14256-2c29-4810-9974-40b2924a6c61 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.679425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d14256-2c29-4810-9974-40b2924a6c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.679887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d14256-2c29-4810-9974-40b2924a6c61 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.680740 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d14256-2c29-4810-9974-40b2924a6c61 None admin] RBAC: Adding query filter params (name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:48.681046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d14256-2c29-4810-9974-40b2924a6c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.683856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d14256-2c29-4810-9974-40b2924a6c61 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.687739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:48.692367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 250/505] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:48.693240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b317ea0-74cf-4a1e-af66-41f51ee2a34d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.703074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 256/506] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:48.704342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d14256-2c29-4810-9974-40b2924a6c61 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.828922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b317ea0-74cf-4a1e-af66-41f51ee2a34d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.856699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d14256-2c29-4810-9974-40b2924a6c61 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.891043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d0561-55bb-42ae-842e-e789e0eb5527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.891824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d0561-55bb-42ae-842e-e789e0eb5527 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.892105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d0561-55bb-42ae-842e-e789e0eb5527 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.892404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d0561-55bb-42ae-842e-e789e0eb5527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.904666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b357936-9739-4021-80a3-f75752abe0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.905642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d0561-55bb-42ae-842e-e789e0eb5527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.905810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357936-9739-4021-80a3-f75752abe0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.906138 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357936-9739-4021-80a3-f75752abe0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.906650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357936-9739-4021-80a3-f75752abe0d7 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.907279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d0561-55bb-42ae-842e-e789e0eb5527 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.907970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b357936-9739-4021-80a3-f75752abe0d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:48.908504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b357936-9739-4021-80a3-f75752abe0d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.911209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b357936-9739-4021-80a3-f75752abe0d7 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-ad5d0561-55bb-42ae-842e-e789e0eb5527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:48.924737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:48.926441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:48.928114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:48.928114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:48.928114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:48.928114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 251/507] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:48.928114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d0561-55bb-42ae-842e-e789e0eb5527 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.954549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 257/508] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:48.955905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b357936-9739-4021-80a3-f75752abe0d7 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.991002 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:49.009117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:49.073070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d0561-55bb-42ae-842e-e789e0eb5527 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:49.114411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b357936-9739-4021-80a3-f75752abe0d7 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:49.114658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972500c-2828-4b32-a39e-4fc7f5755a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:49.115631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972500c-2828-4b32-a39e-4fc7f5755a08 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:49.116112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972500c-2828-4b32-a39e-4fc7f5755a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:49.116577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972500c-2828-4b32-a39e-4fc7f5755a08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:49.137049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972500c-2828-4b32-a39e-4fc7f5755a08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:49.138741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972500c-2828-4b32-a39e-4fc7f5755a08 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2972500c-2828-4b32-a39e-4fc7f5755a08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:49.156140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:49.157231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:49.158060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:49.158060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:49.158060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:49.158244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd128d1-b280-4eaf-bcfd-f7ae631ba6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:49.158352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 252/509] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:49.158423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd128d1-b280-4eaf-bcfd-f7ae631ba6df None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:49.158489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972500c-2828-4b32-a39e-4fc7f5755a08 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:49.158923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd128d1-b280-4eaf-bcfd-f7ae631ba6df None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:49.159322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd128d1-b280-4eaf-bcfd-f7ae631ba6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:49.179246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd128d1-b280-4eaf-bcfd-f7ae631ba6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:49.182089 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd128d1-b280-4eaf-bcfd-f7ae631ba6df None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-5fd128d1-b280-4eaf-bcfd-f7ae631ba6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:49.212800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:49.213780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:49.214925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:49.214925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:49.214925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:49.214925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 258/510] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:49.216531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd128d1-b280-4eaf-bcfd-f7ae631ba6df None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:49.305231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972500c-2828-4b32-a39e-4fc7f5755a08 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:49.308760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:49.315948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:49.358686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2d9ec-5d9b-4af8-bb00-26f1a448a2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:49.360077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2d9ec-5d9b-4af8-bb00-26f1a448a2fa None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:49.360550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2d9ec-5d9b-4af8-bb00-26f1a448a2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:49.360987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2d9ec-5d9b-4af8-bb00-26f1a448a2fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:49.371877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd128d1-b280-4eaf-bcfd-f7ae631ba6df None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:49.381593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2d9ec-5d9b-4af8-bb00-26f1a448a2fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:49.385954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2d9ec-5d9b-4af8-bb00-26f1a448a2fa None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-27e2d9ec-5d9b-4af8-bb00-26f1a448a2fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:49.412326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:49.423915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:49.425654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:49.425654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:49.425654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:49.425654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 253/511] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:49.425654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2d9ec-5d9b-4af8-bb00-26f1a448a2fa None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:49.427907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95873d-d4d5-4795-9038-b87ae65cb44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:49.428537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95873d-d4d5-4795-9038-b87ae65cb44d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:49.428808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95873d-d4d5-4795-9038-b87ae65cb44d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:49.429071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95873d-d4d5-4795-9038-b87ae65cb44d None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:49.429742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95873d-d4d5-4795-9038-b87ae65cb44d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:49.430044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95873d-d4d5-4795-9038-b87ae65cb44d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:49.431563 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95873d-d4d5-4795-9038-b87ae65cb44d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:49.445818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 259/512] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:49.446805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95873d-d4d5-4795-9038-b87ae65cb44d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:49.569145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2d9ec-5d9b-4af8-bb00-26f1a448a2fa None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:49.600353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95873d-d4d5-4795-9038-b87ae65cb44d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:49.610097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d120be-5d8b-497c-9794-721789fb1316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:49.610832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d120be-5d8b-497c-9794-721789fb1316 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:49.611099 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d120be-5d8b-497c-9794-721789fb1316 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:49.611366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d120be-5d8b-497c-9794-721789fb1316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:49.635420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:49.642186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:49.645640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5440bc-b06c-4573-ac1e-69d462d6fb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:49.646303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5440bc-b06c-4573-ac1e-69d462d6fb0a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:49.660761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5440bc-b06c-4573-ac1e-69d462d6fb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:49.660761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5440bc-b06c-4573-ac1e-69d462d6fb0a None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:49.660761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5440bc-b06c-4573-ac1e-69d462d6fb0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:49.660761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5440bc-b06c-4573-ac1e-69d462d6fb0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:49.660761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5440bc-b06c-4573-ac1e-69d462d6fb0a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:49.663525 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 260/513] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:49.664489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5440bc-b06c-4573-ac1e-69d462d6fb0a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:49.699954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d120be-5d8b-497c-9794-721789fb1316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:49.701457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d120be-5d8b-497c-9794-721789fb1316 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:49.784799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5440bc-b06c-4573-ac1e-69d462d6fb0a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:49.821433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 254/514] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:49.823041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d120be-5d8b-497c-9794-721789fb1316 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:49.824325 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f79f8-4a00-4881-9e1c-3434f2fcf125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:49.824957 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f79f8-4a00-4881-9e1c-3434f2fcf125 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:49.825237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f79f8-4a00-4881-9e1c-3434f2fcf125 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:49.825513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f79f8-4a00-4881-9e1c-3434f2fcf125 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:49.826190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f79f8-4a00-4881-9e1c-3434f2fcf125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:49.826526 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f79f8-4a00-4881-9e1c-3434f2fcf125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:49.828092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f79f8-4a00-4881-9e1c-3434f2fcf125 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:49.842474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 261/515] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:49.843370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f79f8-4a00-4881-9e1c-3434f2fcf125 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:49.897864 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:49.908570 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:49.953881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d120be-5d8b-497c-9794-721789fb1316 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:49.968675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f79f8-4a00-4881-9e1c-3434f2fcf125 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:49.993902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c06d73-aefe-46aa-b2c3-a20a5fa16bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:49.995331 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06d73-aefe-46aa-b2c3-a20a5fa16bdd None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:49.995616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06d73-aefe-46aa-b2c3-a20a5fa16bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:49.995882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06d73-aefe-46aa-b2c3-a20a5fa16bdd None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:49.996548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06d73-aefe-46aa-b2c3-a20a5fa16bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:49.996853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06d73-aefe-46aa-b2c3-a20a5fa16bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:49.998351 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06d73-aefe-46aa-b2c3-a20a5fa16bdd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:50.011729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 255/516] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:50.012615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c06d73-aefe-46aa-b2c3-a20a5fa16bdd None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:50.023452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cb68e-0fba-48da-baa5-1ba024c60f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:50.024112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cb68e-0fba-48da-baa5-1ba024c60f36 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:50.024386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cb68e-0fba-48da-baa5-1ba024c60f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:50.024653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cb68e-0fba-48da-baa5-1ba024c60f36 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:50.033733 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cb68e-0fba-48da-baa5-1ba024c60f36 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:50.035349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cb68e-0fba-48da-baa5-1ba024c60f36 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-572cb68e-0fba-48da-baa5-1ba024c60f36 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:07:50.049113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:50.050785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:50.051875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:50.051875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:50.051875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:07:50.051875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:07:50.051875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:07:50.051875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:07:50.051875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:07:50.051875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:07:50.051875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:07:50.051875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:50.051875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 262/517] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:50.051875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cb68e-0fba-48da-baa5-1ba024c60f36 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:50.162818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cb68e-0fba-48da-baa5-1ba024c60f36 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:50.173670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c06d73-aefe-46aa-b2c3-a20a5fa16bdd None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:50.175737 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:50.195655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:50.207664 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984c6c1-6126-43de-bd7e-b12aa51225a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:50.208663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984c6c1-6126-43de-bd7e-b12aa51225a7 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:50.209228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984c6c1-6126-43de-bd7e-b12aa51225a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:50.209848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984c6c1-6126-43de-bd7e-b12aa51225a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:50.223011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b6393-9d81-44d4-9294-7e5a71f31bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:50.223709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b6393-9d81-44d4-9294-7e5a71f31bcc None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:50.227727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b6393-9d81-44d4-9294-7e5a71f31bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:50.227727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b6393-9d81-44d4-9294-7e5a71f31bcc None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:50.228009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984c6c1-6126-43de-bd7e-b12aa51225a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:50.228143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b6393-9d81-44d4-9294-7e5a71f31bcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:50.229455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984c6c1-6126-43de-bd7e-b12aa51225a7 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:50.229649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b6393-9d81-44d4-9294-7e5a71f31bcc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-4984c6c1-6126-43de-bd7e-b12aa51225a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:50.244646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:50.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:50.247428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:50.247428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:50.247428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:50.247428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 263/518] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:50.247428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984c6c1-6126-43de-bd7e-b12aa51225a7 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:50.315522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 256/519] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:50 2022] POST /identity/v3/users => generated 247 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:50.316722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b6393-9d81-44d4-9294-7e5a71f31bcc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:50.382052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984c6c1-6126-43de-bd7e-b12aa51225a7 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:50.444105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c535ba-0d8d-40db-b9f2-6f3b54d13738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:50.445129 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c535ba-0d8d-40db-b9f2-6f3b54d13738 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:50.445588 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c535ba-0d8d-40db-b9f2-6f3b54d13738 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:50.446048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c535ba-0d8d-40db-b9f2-6f3b54d13738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:50.458680 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c535ba-0d8d-40db-b9f2-6f3b54d13738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:50.460989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c535ba-0d8d-40db-b9f2-6f3b54d13738 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-86c535ba-0d8d-40db-b9f2-6f3b54d13738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:07:50.484656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:50.486507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:50.488196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:07:50.488196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:07:50.488196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:07:50.488196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:07:50.488196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:07:50.488196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:07:50.488196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:07:50.488196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:50.491955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 264/520] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:50.493648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c535ba-0d8d-40db-b9f2-6f3b54d13738 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:50.514569 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b6393-9d81-44d4-9294-7e5a71f31bcc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:50.533575 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:50.569726 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14461a0a-645c-451c-ac17-05b625631307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:50.570422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14461a0a-645c-451c-ac17-05b625631307 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:50.570697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14461a0a-645c-451c-ac17-05b625631307 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:50.571702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14461a0a-645c-451c-ac17-05b625631307 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:50.580476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14461a0a-645c-451c-ac17-05b625631307 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:50.582144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14461a0a-645c-451c-ac17-05b625631307 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-14461a0a-645c-451c-ac17-05b625631307 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:07:50.596239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:50.598153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:50.600257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:50.600257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:50.600257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:07:50.600257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:07:50.600257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:07:50.600257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:07:50.600257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:07:50.600257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:07:50.600257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:07:50.600257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:50.600257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 257/521] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:50.600257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14461a0a-645c-451c-ac17-05b625631307 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:50.652564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:50.673944 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c535ba-0d8d-40db-b9f2-6f3b54d13738 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:50.733429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cef9e3-f335-42f6-9046-362424551587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:50.735099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cef9e3-f335-42f6-9046-362424551587 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:50.735547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cef9e3-f335-42f6-9046-362424551587 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:50.735998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cef9e3-f335-42f6-9046-362424551587 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:50.737262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cef9e3-f335-42f6-9046-362424551587 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:50.737885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cef9e3-f335-42f6-9046-362424551587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:50.742086 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cef9e3-f335-42f6-9046-362424551587 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:50.782714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 265/522] 10.222.0.81 () {56 vars in 1137 bytes} [Mon Aug 29 20:07:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:50.785034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cef9e3-f335-42f6-9046-362424551587 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:50.789715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14461a0a-645c-451c-ac17-05b625631307 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:50.841556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46059f4-df82-48ad-b94e-ae0822e44d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:50.842573 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46059f4-df82-48ad-b94e-ae0822e44d0b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:50.843069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46059f4-df82-48ad-b94e-ae0822e44d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:50.843560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46059f4-df82-48ad-b94e-ae0822e44d0b None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:50.844776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46059f4-df82-48ad-b94e-ae0822e44d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:50.845324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46059f4-df82-48ad-b94e-ae0822e44d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:50.848015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46059f4-df82-48ad-b94e-ae0822e44d0b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:50.870988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 258/523] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:50.872493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46059f4-df82-48ad-b94e-ae0822e44d0b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:50.949198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:50.989373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cef9e3-f335-42f6-9046-362424551587 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:51.037952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:51.050150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46059f4-df82-48ad-b94e-ae0822e44d0b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:51.059296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b73b7-e4e2-4822-a443-0e718815cb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:51.060327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b73b7-e4e2-4822-a443-0e718815cb33 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:51.060806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b73b7-e4e2-4822-a443-0e718815cb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:51.061274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b73b7-e4e2-4822-a443-0e718815cb33 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:51.062613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b73b7-e4e2-4822-a443-0e718815cb33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:51.063140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b73b7-e4e2-4822-a443-0e718815cb33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:51.065865 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b73b7-e4e2-4822-a443-0e718815cb33 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:51.098059 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17019b3e-086a-4f81-a2b3-bc47767ab1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:51.099003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17019b3e-086a-4f81-a2b3-bc47767ab1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:51.099433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17019b3e-086a-4f81-a2b3-bc47767ab1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:51.099848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 266/524] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:51.100017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17019b3e-086a-4f81-a2b3-bc47767ab1b3 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:51.100920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17019b3e-086a-4f81-a2b3-bc47767ab1b3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:51.101375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17019b3e-086a-4f81-a2b3-bc47767ab1b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:51.101475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b73b7-e4e2-4822-a443-0e718815cb33 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:51.103121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17019b3e-086a-4f81-a2b3-bc47767ab1b3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:51.173196 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 259/525] 10.222.0.81 () {56 vars in 1139 bytes} [Mon Aug 29 20:07:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:51.174099 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17019b3e-086a-4f81-a2b3-bc47767ab1b3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:51.299676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b73b7-e4e2-4822-a443-0e718815cb33 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:51.324915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17019b3e-086a-4f81-a2b3-bc47767ab1b3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:51.367293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044288d-6dd7-4692-9c7f-6d68747c761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:51.368103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044288d-6dd7-4692-9c7f-6d68747c761e None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:51.369552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044288d-6dd7-4692-9c7f-6d68747c761e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:51.370003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044288d-6dd7-4692-9c7f-6d68747c761e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:51.387964 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:51.397014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f8a5-e99d-41e7-b829-76c619d740ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:51.403996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f8a5-e99d-41e7-b829-76c619d740ef None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:51.403996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f8a5-e99d-41e7-b829-76c619d740ef None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:51.403996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f8a5-e99d-41e7-b829-76c619d740ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:51.414631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4f8a5-e99d-41e7-b829-76c619d740ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:51.418112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4f8a5-e99d-41e7-b829-76c619d740ef None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-add4f8a5-e99d-41e7-b829-76c619d740ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:07:51.442774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:51.443680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:51.444514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:07:51.444514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:07:51.444514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:07:51.444514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:07:51.444514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:07:51.444514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:07:51.444514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:07:51.444514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:51.450702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 260/526] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:51.452094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f8a5-e99d-41e7-b829-76c619d740ef None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:51.469995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:51.482605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044288d-6dd7-4692-9c7f-6d68747c761e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:51.485648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044288d-6dd7-4692-9c7f-6d68747c761e None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:51.611533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f8a5-e99d-41e7-b829-76c619d740ef None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:51.676056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808db45d-9534-4985-9d0e-417695b89e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:51.677004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808db45d-9534-4985-9d0e-417695b89e7c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:51.677454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808db45d-9534-4985-9d0e-417695b89e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:51.677902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808db45d-9534-4985-9d0e-417695b89e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:51.679208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808db45d-9534-4985-9d0e-417695b89e7c None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=7c841f03880c4fb1b402bac6ecce25fd) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:51.679696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808db45d-9534-4985-9d0e-417695b89e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:51.680788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 267/527] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:51.682716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044288d-6dd7-4692-9c7f-6d68747c761e None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:51.688512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808db45d-9534-4985-9d0e-417695b89e7c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:51.699081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 261/528] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:51 2022] GET /identity/v3/role_assignments?user.id=7c841f03880c4fb1b402bac6ecce25fd&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:51.700541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808db45d-9534-4985-9d0e-417695b89e7c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:51.770077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:51.882277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:51.909696 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044288d-6dd7-4692-9c7f-6d68747c761e None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:51.943667 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808db45d-9534-4985-9d0e-417695b89e7c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:51.972364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214e4bb-61c4-49e1-a6e9-f056093a4065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:51.972983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214e4bb-61c4-49e1-a6e9-f056093a4065 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:51.973260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214e4bb-61c4-49e1-a6e9-f056093a4065 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:51.973535 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214e4bb-61c4-49e1-a6e9-f056093a4065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.019057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef21c45-529e-478a-9de7-cdbabe881364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:52.020840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef21c45-529e-478a-9de7-cdbabe881364 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.021651 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef21c45-529e-478a-9de7-cdbabe881364 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.022487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef21c45-529e-478a-9de7-cdbabe881364 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.024440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef21c45-529e-478a-9de7-cdbabe881364 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:52.025995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef21c45-529e-478a-9de7-cdbabe881364 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:52.029305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef21c45-529e-478a-9de7-cdbabe881364 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:52.055716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214e4bb-61c4-49e1-a6e9-f056093a4065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:52.057723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214e4bb-61c4-49e1-a6e9-f056093a4065 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:52.074855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 262/529] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:52.077096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef21c45-529e-478a-9de7-cdbabe881364 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:52.104540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:52.182567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 268/530] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:52.183098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214e4bb-61c4-49e1-a6e9-f056093a4065 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:52.291995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef21c45-529e-478a-9de7-cdbabe881364 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:52.334879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a6934-86bd-4c15-a0bb-4b58a34ced97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:52.336000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a6934-86bd-4c15-a0bb-4b58a34ced97 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.336481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a6934-86bd-4c15-a0bb-4b58a34ced97 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.336954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a6934-86bd-4c15-a0bb-4b58a34ced97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.341140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:52.357041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a6934-86bd-4c15-a0bb-4b58a34ced97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:52.359016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a6934-86bd-4c15-a0bb-4b58a34ced97 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-3a2a6934-86bd-4c15-a0bb-4b58a34ced97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:52.378564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:52.379526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:52.380331 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:52.380331 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:52.380331 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:52.382822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 263/531] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:52.384043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a6934-86bd-4c15-a0bb-4b58a34ced97 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:52.388586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214e4bb-61c4-49e1-a6e9-f056093a4065 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:52.458045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbdd9b-b092-4b52-8fca-469cb1dd5fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:52.459308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbdd9b-b092-4b52-8fca-469cb1dd5fdb None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.459516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbdd9b-b092-4b52-8fca-469cb1dd5fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.460003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbdd9b-b092-4b52-8fca-469cb1dd5fdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.461388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbdd9b-b092-4b52-8fca-469cb1dd5fdb None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=30946d3b3f0f4a81b2ae5aa6e84f3920) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:52.461934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbdd9b-b092-4b52-8fca-469cb1dd5fdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:52.465662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbdd9b-b092-4b52-8fca-469cb1dd5fdb None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:52.477149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 269/532] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:52 2022] GET /identity/v3/role_assignments?user.id=30946d3b3f0f4a81b2ae5aa6e84f3920&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:52.482262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbdd9b-b092-4b52-8fca-469cb1dd5fdb None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:52.514650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:52.586154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a6934-86bd-4c15-a0bb-4b58a34ced97 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:52.665017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812a0dc-ba75-4320-9560-f33592c0cf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:52.667549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812a0dc-ba75-4320-9560-f33592c0cf6e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.668101 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812a0dc-ba75-4320-9560-f33592c0cf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.668597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812a0dc-ba75-4320-9560-f33592c0cf6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.708978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812a0dc-ba75-4320-9560-f33592c0cf6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:52.711008 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812a0dc-ba75-4320-9560-f33592c0cf6e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-e812a0dc-ba75-4320-9560-f33592c0cf6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:52.745354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:52.746432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:52.747322 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:52.747322 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:52.747322 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:52.753591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbdd9b-b092-4b52-8fca-469cb1dd5fdb None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:52.755724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 264/533] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:52.764607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812a0dc-ba75-4320-9560-f33592c0cf6e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:52.823418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ff05-4568-44b5-bd17-d7abf23b0e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:52.826254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ff05-4568-44b5-bd17-d7abf23b0e8f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.826254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ff05-4568-44b5-bd17-d7abf23b0e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.826254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ff05-4568-44b5-bd17-d7abf23b0e8f None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.826629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4ff05-4568-44b5-bd17-d7abf23b0e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:52.826844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4ff05-4568-44b5-bd17-d7abf23b0e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:52.829405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4ff05-4568-44b5-bd17-d7abf23b0e8f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:52.852540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 270/534] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:52.855597 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1d31a-4f80-4529-a5f0-44b496968de7 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.856049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1d31a-4f80-4529-a5f0-44b496968de7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.856407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1d31a-4f80-4529-a5f0-44b496968de7 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.856612 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:52.865176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 271/535] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:52.865176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1d31a-4f80-4529-a5f0-44b496968de7 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:53.004130 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812a0dc-ba75-4320-9560-f33592c0cf6e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:53.007756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:53.073943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334bdd5-06b0-4a6b-8763-ebe1ca871210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:53.075100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334bdd5-06b0-4a6b-8763-ebe1ca871210 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.075576 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334bdd5-06b0-4a6b-8763-ebe1ca871210 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.076055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334bdd5-06b0-4a6b-8763-ebe1ca871210 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.077259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334bdd5-06b0-4a6b-8763-ebe1ca871210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:53.077787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334bdd5-06b0-4a6b-8763-ebe1ca871210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.080437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334bdd5-06b0-4a6b-8763-ebe1ca871210 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.095999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1d31a-4f80-4529-a5f0-44b496968de7 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:53.105468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 265/536] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:53.107851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a3c85-ca86-45b2-b378-72867eb9a862 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.108327 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a3c85-ca86-45b2-b378-72867eb9a862 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.108798 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a3c85-ca86-45b2-b378-72867eb9a862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.140605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-588a3c85-ca86-45b2-b378-72867eb9a862 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:53.142833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-588a3c85-ca86-45b2-b378-72867eb9a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:53.171567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55a99a-35f4-440a-8a1d-9291b5bf9e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:53.172832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55a99a-35f4-440a-8a1d-9291b5bf9e2f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.173314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55a99a-35f4-440a-8a1d-9291b5bf9e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.173781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55a99a-35f4-440a-8a1d-9291b5bf9e2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.188183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55a99a-35f4-440a-8a1d-9291b5bf9e2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.191429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55a99a-35f4-440a-8a1d-9291b5bf9e2f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-5a55a99a-35f4-440a-8a1d-9291b5bf9e2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:07:53.217352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:53.223579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:53.226897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:07:53.226897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:07:53.226897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:07:53.226897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:07:53.226897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:07:53.226897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:07:53.226897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:07:53.226897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:53.226897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 272/537] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:53.228650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55a99a-35f4-440a-8a1d-9291b5bf9e2f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:53.277526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 266/538] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:53.279138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a3c85-ca86-45b2-b378-72867eb9a862 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:53.332704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:53.506445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55a99a-35f4-440a-8a1d-9291b5bf9e2f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:53.532089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a3c85-ca86-45b2-b378-72867eb9a862 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:53.582325 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:53.624548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d91213-b55b-489d-bf0e-632389a92a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:53.625586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d91213-b55b-489d-bf0e-632389a92a49 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.626065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d91213-b55b-489d-bf0e-632389a92a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.626574 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d91213-b55b-489d-bf0e-632389a92a49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.653289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d91213-b55b-489d-bf0e-632389a92a49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.660083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d91213-b55b-489d-bf0e-632389a92a49 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.660277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60016d23-b328-4cc7-a7ea-36dd495174d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:53.660277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60016d23-b328-4cc7-a7ea-36dd495174d8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.660277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60016d23-b328-4cc7-a7ea-36dd495174d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.660689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60016d23-b328-4cc7-a7ea-36dd495174d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.661923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60016d23-b328-4cc7-a7ea-36dd495174d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:53.662480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60016d23-b328-4cc7-a7ea-36dd495174d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.665192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60016d23-b328-4cc7-a7ea-36dd495174d8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-01d91213-b55b-489d-bf0e-632389a92a49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:07:53.699215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:53.700909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:53.703299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:07:53.703299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:07:53.703299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:07:53.703299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:07:53.703299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:07:53.703299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:07:53.703299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:07:53.703299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:53.706439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 273/539] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:53.717285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 267/540] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:07:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:53.719553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d91213-b55b-489d-bf0e-632389a92a49 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:53.731480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60016d23-b328-4cc7-a7ea-36dd495174d8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:53.892918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:53.907511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60016d23-b328-4cc7-a7ea-36dd495174d8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:53.948281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942726d2-72b3-459c-8388-606e05119a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:53.948914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942726d2-72b3-459c-8388-606e05119a11 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.949200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942726d2-72b3-459c-8388-606e05119a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.949476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942726d2-72b3-459c-8388-606e05119a11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.950243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942726d2-72b3-459c-8388-606e05119a11 None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=e128651197d840bd87220d8f5b246688) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:53.950567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942726d2-72b3-459c-8388-606e05119a11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.952075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942726d2-72b3-459c-8388-606e05119a11 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.958975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 268/541] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:53 2022] GET /identity/v3/role_assignments?user.id=e128651197d840bd87220d8f5b246688&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:54.000818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942726d2-72b3-459c-8388-606e05119a11 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:54.026369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d91213-b55b-489d-bf0e-632389a92a49 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:54.114877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0e499-dda5-4e59-8aaf-23a8e0007912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:54.116073 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e499-dda5-4e59-8aaf-23a8e0007912 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:54.116584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e499-dda5-4e59-8aaf-23a8e0007912 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:54.117101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e499-dda5-4e59-8aaf-23a8e0007912 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:54.119200 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0e499-dda5-4e59-8aaf-23a8e0007912 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:54.119788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0e499-dda5-4e59-8aaf-23a8e0007912 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:54.122767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0e499-dda5-4e59-8aaf-23a8e0007912 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:54.149415 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 274/542] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:07:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:54.153880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942726d2-72b3-459c-8388-606e05119a11 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:54.169806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0e499-dda5-4e59-8aaf-23a8e0007912 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:54.202204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43897e-009a-41c5-ba3b-b2e4e4948809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:54.202923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43897e-009a-41c5-ba3b-b2e4e4948809 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:54.203256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43897e-009a-41c5-ba3b-b2e4e4948809 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:54.203533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43897e-009a-41c5-ba3b-b2e4e4948809 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:54.218341 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43897e-009a-41c5-ba3b-b2e4e4948809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-8f43897e-009a-41c5-ba3b-b2e4e4948809 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:54.226007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:54.230755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:54.232580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 269/543] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:54.235478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43897e-009a-41c5-ba3b-b2e4e4948809 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:54.254449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:54.308033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:54.479608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0e499-dda5-4e59-8aaf-23a8e0007912 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:54.489075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43897e-009a-41c5-ba3b-b2e4e4948809 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:54.582598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1fef6-83d6-4cef-8279-ef7be96dfecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:54.583503 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1fef6-83d6-4cef-8279-ef7be96dfecb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:54.583897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1fef6-83d6-4cef-8279-ef7be96dfecb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:54.584292 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1fef6-83d6-4cef-8279-ef7be96dfecb None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:54.585310 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1fef6-83d6-4cef-8279-ef7be96dfecb None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:54.585755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1fef6-83d6-4cef-8279-ef7be96dfecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:54.591601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1fef6-83d6-4cef-8279-ef7be96dfecb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:54.614868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 270/544] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:54.619687 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ab73e-a0f0-49dd-9f88-455e5670437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:54.620855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ab73e-a0f0-49dd-9f88-455e5670437c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:54.621266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ab73e-a0f0-49dd-9f88-455e5670437c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:54.621674 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ab73e-a0f0-49dd-9f88-455e5670437c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:54.622958 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ab73e-a0f0-49dd-9f88-455e5670437c None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=241e34a86aba4c3a92ed9d469e6a205e) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:54.623431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ab73e-a0f0-49dd-9f88-455e5670437c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:54.625608 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1fef6-83d6-4cef-8279-ef7be96dfecb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:54.629173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ab73e-a0f0-49dd-9f88-455e5670437c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:54.642038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 275/545] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:54 2022] GET /identity/v3/role_assignments?user.id=241e34a86aba4c3a92ed9d469e6a205e&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 259 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:54.839721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:54.887451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1fef6-83d6-4cef-8279-ef7be96dfecb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:54.935387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538d1d6-7507-4fec-869b-672974536cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:54.936087 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d1d6-7507-4fec-869b-672974536cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:54.936370 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d1d6-7507-4fec-869b-672974536cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:54.936640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d1d6-7507-4fec-869b-672974536cc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:54.953211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538d1d6-7507-4fec-869b-672974536cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:54.954766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538d1d6-7507-4fec-869b-672974536cc4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-e538d1d6-7507-4fec-869b-672974536cc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:54.972394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:54.974976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:54.976915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:54.976915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:54.976915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:54.976915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 271/546] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:54.983743 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ab73e-a0f0-49dd-9f88-455e5670437c None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:55.141338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ab73e-a0f0-49dd-9f88-455e5670437c None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:55.151361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:55.190055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa20d3-21f4-4325-b20c-81e03ca0367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:55.190746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa20d3-21f4-4325-b20c-81e03ca0367f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:55.191015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa20d3-21f4-4325-b20c-81e03ca0367f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:55.191305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa20d3-21f4-4325-b20c-81e03ca0367f None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:55.192452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa20d3-21f4-4325-b20c-81e03ca0367f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:55.192868 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa20d3-21f4-4325-b20c-81e03ca0367f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:55.194621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa20d3-21f4-4325-b20c-81e03ca0367f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:55.211508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 276/547] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:55.220636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538d1d6-7507-4fec-869b-672974536cc4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:55.353081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a631293-b3d5-4781-8b08-eed909717d50 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:55.353081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a631293-b3d5-4781-8b08-eed909717d50 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:55.353081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a631293-b3d5-4781-8b08-eed909717d50 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:55.353081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 277/548] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:55.374172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfdf85-4476-4ae4-827e-fe82a0d8e2aa None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:55.374172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfdf85-4476-4ae4-827e-fe82a0d8e2aa None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:55.374172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfdf85-4476-4ae4-827e-fe82a0d8e2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:55.401369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-1bdfdf85-4476-4ae4-827e-fe82a0d8e2aa None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:55.403591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-1bdfdf85-4476-4ae4-827e-fe82a0d8e2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:55.412443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538d1d6-7507-4fec-869b-672974536cc4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:55.454368 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:55.480257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3baf067-4e3f-4c36-bb30-c0f713efe84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:55.480912 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baf067-4e3f-4c36-bb30-c0f713efe84d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:55.481186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baf067-4e3f-4c36-bb30-c0f713efe84d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:55.481455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baf067-4e3f-4c36-bb30-c0f713efe84d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:55.499181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3baf067-4e3f-4c36-bb30-c0f713efe84d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:55.500680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3baf067-4e3f-4c36-bb30-c0f713efe84d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-e3baf067-4e3f-4c36-bb30-c0f713efe84d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:07:55.536367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:55.538337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:55.540255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:55.540255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:55.540255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:07:55.540255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:07:55.540255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:07:55.540255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:07:55.540255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:07:55.540255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:07:55.540255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:07:55.540255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:55.540255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 272/549] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:07:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:55.550283 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3baf067-4e3f-4c36-bb30-c0f713efe84d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:55.606366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 278/550] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:55.751754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3baf067-4e3f-4c36-bb30-c0f713efe84d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:55.844905 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8996dea-78a3-450a-8cea-c70ce824f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:55.845932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8996dea-78a3-450a-8cea-c70ce824f96e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:55.846449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8996dea-78a3-450a-8cea-c70ce824f96e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:55.846923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8996dea-78a3-450a-8cea-c70ce824f96e None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:55.848282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8996dea-78a3-450a-8cea-c70ce824f96e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:55.848824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8996dea-78a3-450a-8cea-c70ce824f96e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:55.851605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8996dea-78a3-450a-8cea-c70ce824f96e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:55.897168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 273/551] 10.222.0.81 () {56 vars in 1135 bytes} [Mon Aug 29 20:07:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:55.906738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfdf85-4476-4ae4-827e-fe82a0d8e2aa None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:56.159942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:56.173115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfdf85-4476-4ae4-827e-fe82a0d8e2aa None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:56.251551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8996dea-78a3-450a-8cea-c70ce824f96e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:56.253285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8acbf8-e146-4fd8-a3f6-e72577cbfc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:56.254439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8acbf8-e146-4fd8-a3f6-e72577cbfc57 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:56.254924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8acbf8-e146-4fd8-a3f6-e72577cbfc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:56.255408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8acbf8-e146-4fd8-a3f6-e72577cbfc57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:56.362281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:56.424833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8acbf8-e146-4fd8-a3f6-e72577cbfc57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:56.428017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8acbf8-e146-4fd8-a3f6-e72577cbfc57 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:56.470406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8996dea-78a3-450a-8cea-c70ce824f96e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:56.547350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec21a7-d890-4a4e-a240-82dce1e52ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:56.548601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec21a7-d890-4a4e-a240-82dce1e52ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:56.549136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec21a7-d890-4a4e-a240-82dce1e52ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:56.549598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec21a7-d890-4a4e-a240-82dce1e52ad7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:56.572611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec21a7-d890-4a4e-a240-82dce1e52ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-eaec21a7-d890-4a4e-a240-82dce1e52ad7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:56.583137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:56.584972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:56.587193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 274/552] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:56.590427 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3876e4-ac2b-4b8f-bfd6-9d6e10a31565 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:56.590427 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3876e4-ac2b-4b8f-bfd6-9d6e10a31565 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:56.590427 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3876e4-ac2b-4b8f-bfd6-9d6e10a31565 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:56.594433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 275/553] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:56.596386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3876e4-ac2b-4b8f-bfd6-9d6e10a31565 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:56.631254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:56.650690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 279/554] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:56.653800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ace9-c8a3-48d6-ab15-7e2e0f8677e2 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:56.657949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ace9-c8a3-48d6-ab15-7e2e0f8677e2 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:56.658941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ace9-c8a3-48d6-ab15-7e2e0f8677e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:56.695306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6937ace9-c8a3-48d6-ab15-7e2e0f8677e2 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:56.698745 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6937ace9-c8a3-48d6-ab15-7e2e0f8677e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:56.812494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3876e4-ac2b-4b8f-bfd6-9d6e10a31565 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:56.817649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:56.849446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 280/555] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:56.851229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937ace9-c8a3-48d6-ab15-7e2e0f8677e2 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:56.887566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cb761-ec77-4d4c-adeb-c45bf09bf28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:56.889596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cb761-ec77-4d4c-adeb-c45bf09bf28c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:56.890509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cb761-ec77-4d4c-adeb-c45bf09bf28c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:56.891273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cb761-ec77-4d4c-adeb-c45bf09bf28c None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:56.892711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cb761-ec77-4d4c-adeb-c45bf09bf28c None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:56.893669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cb761-ec77-4d4c-adeb-c45bf09bf28c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:56.903998 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cb761-ec77-4d4c-adeb-c45bf09bf28c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:56.934878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 276/556] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:56.936980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cb761-ec77-4d4c-adeb-c45bf09bf28c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.127351 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937ace9-c8a3-48d6-ab15-7e2e0f8677e2 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.156830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cb761-ec77-4d4c-adeb-c45bf09bf28c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.186963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:57.205624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b06c43-2eb1-480b-bfaa-12a7add86f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.207897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b06c43-2eb1-480b-bfaa-12a7add86f7c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.208434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b06c43-2eb1-480b-bfaa-12a7add86f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.208959 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b06c43-2eb1-480b-bfaa-12a7add86f7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.213642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21dff3-c5c7-47c2-8ea8-255bcd670a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.214601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21dff3-c5c7-47c2-8ea8-255bcd670a90 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.215084 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21dff3-c5c7-47c2-8ea8-255bcd670a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.215497 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21dff3-c5c7-47c2-8ea8-255bcd670a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.235306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b06c43-2eb1-480b-bfaa-12a7add86f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:57.237750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21dff3-c5c7-47c2-8ea8-255bcd670a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:57.238627 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b06c43-2eb1-480b-bfaa-12a7add86f7c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:57.239909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21dff3-c5c7-47c2-8ea8-255bcd670a90 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2a21dff3-c5c7-47c2-8ea8-255bcd670a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:57.266717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:57.268207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:57.269312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:57.269312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:57.269312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:57.271257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 277/557] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:57.272876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fb284-af2c-4bfa-80d7-1b2adf043948 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.273573 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fb284-af2c-4bfa-80d7-1b2adf043948 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.281292 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fb284-af2c-4bfa-80d7-1b2adf043948 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-46b06c43-2eb1-480b-bfaa-12a7add86f7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:57.281468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:57.282857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:57.283886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:57.283886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:57.283886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:57.284229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 278/558] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:57.284363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 281/559] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:57.284363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b06c43-2eb1-480b-bfaa-12a7add86f7c None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.285293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f750f5-c322-4e71-9f45-22b8dca9673c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.285460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f750f5-c322-4e71-9f45-22b8dca9673c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.287385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f750f5-c322-4e71-9f45-22b8dca9673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.319969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-54f750f5-c322-4e71-9f45-22b8dca9673c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:57.321219 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-54f750f5-c322-4e71-9f45-22b8dca9673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:57.342414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:57.422390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 279/560] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:57.422390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f750f5-c322-4e71-9f45-22b8dca9673c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.515928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b06c43-2eb1-480b-bfaa-12a7add86f7c None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.569837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f750f5-c322-4e71-9f45-22b8dca9673c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.609183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1de7f-414b-4012-8a23-dd609902f054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.611243 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1de7f-414b-4012-8a23-dd609902f054 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.612052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1de7f-414b-4012-8a23-dd609902f054 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.612767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1de7f-414b-4012-8a23-dd609902f054 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.614175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1de7f-414b-4012-8a23-dd609902f054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:57.615025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1de7f-414b-4012-8a23-dd609902f054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:57.617728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1de7f-414b-4012-8a23-dd609902f054 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:57.639809 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e64873-4e62-40d9-8815-17bb5353ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.639809 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e64873-4e62-40d9-8815-17bb5353ff61 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.639809 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e64873-4e62-40d9-8815-17bb5353ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.643943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e64873-4e62-40d9-8815-17bb5353ff61 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.643943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e64873-4e62-40d9-8815-17bb5353ff61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:57.643943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e64873-4e62-40d9-8815-17bb5353ff61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:57.645334 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e64873-4e62-40d9-8815-17bb5353ff61 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:57.658356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 282/561] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:57.660262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1de7f-414b-4012-8a23-dd609902f054 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.670260 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 280/562] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:57.670260 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e64873-4e62-40d9-8815-17bb5353ff61 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.708006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:57.746901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:57.870562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1de7f-414b-4012-8a23-dd609902f054 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.879942 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e64873-4e62-40d9-8815-17bb5353ff61 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.923452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79225975-1274-40e2-88d3-288543cae740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.924156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79225975-1274-40e2-88d3-288543cae740 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.924371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79225975-1274-40e2-88d3-288543cae740 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.924643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79225975-1274-40e2-88d3-288543cae740 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.933994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b7020-0948-4091-8d4f-a4ba1e40f2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.934370 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79225975-1274-40e2-88d3-288543cae740 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:57.934704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b7020-0948-4091-8d4f-a4ba1e40f2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.934986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b7020-0948-4091-8d4f-a4ba1e40f2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.935254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b7020-0948-4091-8d4f-a4ba1e40f2c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.935906 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79225975-1274-40e2-88d3-288543cae740 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-79225975-1274-40e2-88d3-288543cae740 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:07:57.949357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:57.950897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:57.952857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:57.952857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:57.952857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:07:57.952857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:07:57.952857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:07:57.952857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:07:57.952857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:07:57.952857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:07:57.952857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:07:57.952857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:57.952857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 281/563] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:57.954030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b7020-0948-4091-8d4f-a4ba1e40f2c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:57.954167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79225975-1274-40e2-88d3-288543cae740 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-e13b7020-0948-4091-8d4f-a4ba1e40f2c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:57.957834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:57.960516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 283/564] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:57.963016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b7020-0948-4091-8d4f-a4ba1e40f2c8 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.051931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:58.096466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79225975-1274-40e2-88d3-288543cae740 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.102376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:58.108232 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b7020-0948-4091-8d4f-a4ba1e40f2c8 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.141961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53405b2a-fac9-4e53-9b7c-5258fdbb1b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.143105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53405b2a-fac9-4e53-9b7c-5258fdbb1b54 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.143607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53405b2a-fac9-4e53-9b7c-5258fdbb1b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.144102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53405b2a-fac9-4e53-9b7c-5258fdbb1b54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.152973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53405b2a-fac9-4e53-9b7c-5258fdbb1b54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.154505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53405b2a-fac9-4e53-9b7c-5258fdbb1b54 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.157606 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4194866-75cd-40a9-ba7d-28dbd461bc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.158322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194866-75cd-40a9-ba7d-28dbd461bc34 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.158572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194866-75cd-40a9-ba7d-28dbd461bc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.158850 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194866-75cd-40a9-ba7d-28dbd461bc34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-53405b2a-fac9-4e53-9b7c-5258fdbb1b54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:07:58.169030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:58.177349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:58.179415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:07:58.179415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:07:58.179415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:07:58.179415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:07:58.179415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:07:58.179415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:07:58.179415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:07:58.179415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:58.179415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 282/565] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:58.179415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc32832-999c-4627-a746-4e9efa158de2 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.179415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc32832-999c-4627-a746-4e9efa158de2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.180626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc32832-999c-4627-a746-4e9efa158de2 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.180626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 283/566] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:58.180860 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4194866-75cd-40a9-ba7d-28dbd461bc34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:58.180997 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc32832-999c-4627-a746-4e9efa158de2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-c4194866-75cd-40a9-ba7d-28dbd461bc34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:58.181206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:58.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:58.184363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:58.184363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:58.184363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:58.184363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:58.184363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:58.184363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:58.184363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:58.184363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:58.184363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:58.184363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:58.184363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:58.184363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:58.187999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 284/567] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:58.187999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4194866-75cd-40a9-ba7d-28dbd461bc34 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.318523 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4194866-75cd-40a9-ba7d-28dbd461bc34 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.329380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc32832-999c-4627-a746-4e9efa158de2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.362945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb1ffc-e8ae-4516-b6cf-c18a548a2190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.363577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1ffc-e8ae-4516-b6cf-c18a548a2190 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.363859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1ffc-e8ae-4516-b6cf-c18a548a2190 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.364233 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1ffc-e8ae-4516-b6cf-c18a548a2190 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.364999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb1ffc-e8ae-4516-b6cf-c18a548a2190 None admin] RBAC: Adding query filter params (name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:58.365339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb1ffc-e8ae-4516-b6cf-c18a548a2190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.366739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:58.366871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb1ffc-e8ae-4516-b6cf-c18a548a2190 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.375603 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a835b2c-f973-44c3-bf92-c3d22baedaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.380039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a835b2c-f973-44c3-bf92-c3d22baedaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.380039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a835b2c-f973-44c3-bf92-c3d22baedaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.380039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a835b2c-f973-44c3-bf92-c3d22baedaf5 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.380318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 285/568] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:58.380396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a835b2c-f973-44c3-bf92-c3d22baedaf5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:58.380396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a835b2c-f973-44c3-bf92-c3d22baedaf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.380532 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb1ffc-e8ae-4516-b6cf-c18a548a2190 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.380602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a835b2c-f973-44c3-bf92-c3d22baedaf5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.408227 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 284/569] 10.222.0.81 () {56 vars in 1137 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:58.408227 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859e4c7-d3dd-4abf-957c-638989762f52 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.408500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859e4c7-d3dd-4abf-957c-638989762f52 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.408883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859e4c7-d3dd-4abf-957c-638989762f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.414768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:58.434703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5859e4c7-d3dd-4abf-957c-638989762f52 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:58.436174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5859e4c7-d3dd-4abf-957c-638989762f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:58.522806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb1ffc-e8ae-4516-b6cf-c18a548a2190 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.526746 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 285/570] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:58.527620 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859e4c7-d3dd-4abf-957c-638989762f52 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.602433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aee54-3979-44fc-86b9-c6425f38da12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.603499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aee54-3979-44fc-86b9-c6425f38da12 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.603986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aee54-3979-44fc-86b9-c6425f38da12 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.604464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aee54-3979-44fc-86b9-c6425f38da12 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.605708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317aee54-3979-44fc-86b9-c6425f38da12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:58.606266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317aee54-3979-44fc-86b9-c6425f38da12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.608995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317aee54-3979-44fc-86b9-c6425f38da12 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.630475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 286/571] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:58.631965 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aee54-3979-44fc-86b9-c6425f38da12 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.692344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859e4c7-d3dd-4abf-957c-638989762f52 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.716897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:58.740733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060c1ed-00df-4865-9a1e-2c152abefc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.741366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060c1ed-00df-4865-9a1e-2c152abefc4b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.741686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060c1ed-00df-4865-9a1e-2c152abefc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.741970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060c1ed-00df-4865-9a1e-2c152abefc4b None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.742631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060c1ed-00df-4865-9a1e-2c152abefc4b None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:58.742929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060c1ed-00df-4865-9a1e-2c152abefc4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.745453 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060c1ed-00df-4865-9a1e-2c152abefc4b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.756287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 286/572] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:58.758034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060c1ed-00df-4865-9a1e-2c152abefc4b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.805773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:58.833123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aee54-3979-44fc-86b9-c6425f38da12 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.881624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f67dc-1a3d-4b9c-90d4-685a7f254eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.882435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f67dc-1a3d-4b9c-90d4-685a7f254eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.882818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f67dc-1a3d-4b9c-90d4-685a7f254eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.883101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f67dc-1a3d-4b9c-90d4-685a7f254eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.896066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f67dc-1a3d-4b9c-90d4-685a7f254eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.897976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f67dc-1a3d-4b9c-90d4-685a7f254eb6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-3b9f67dc-1a3d-4b9c-90d4-685a7f254eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:58.917694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:58.919826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:58.921661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:58.921661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:58.921661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:58.921661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 287/573] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:58.921661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f67dc-1a3d-4b9c-90d4-685a7f254eb6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.957840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060c1ed-00df-4865-9a1e-2c152abefc4b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.013611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dc8b1-19bd-4163-a4cc-7eaf7f981a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.014763 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dc8b1-19bd-4163-a4cc-7eaf7f981a4a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.015237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dc8b1-19bd-4163-a4cc-7eaf7f981a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.015718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dc8b1-19bd-4163-a4cc-7eaf7f981a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.034135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dc8b1-19bd-4163-a4cc-7eaf7f981a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.035682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dc8b1-19bd-4163-a4cc-7eaf7f981a4a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-c82dc8b1-19bd-4163-a4cc-7eaf7f981a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:59.055332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:59.057459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:59.059454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:59.059454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:59.059454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:59.059827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f67dc-1a3d-4b9c-90d4-685a7f254eb6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.062258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 287/574] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:59.062538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dc8b1-19bd-4163-a4cc-7eaf7f981a4a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.095144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.101174 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2a675-ccc3-4ea9-85cc-138f9cc65757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.101899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2a675-ccc3-4ea9-85cc-138f9cc65757 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.114724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.114884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2a675-ccc3-4ea9-85cc-138f9cc65757 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.114884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2a675-ccc3-4ea9-85cc-138f9cc65757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.114884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2a675-ccc3-4ea9-85cc-138f9cc65757 None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=829ac711e3d84e018404cf6dabeb3845) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:59.114884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2a675-ccc3-4ea9-85cc-138f9cc65757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.114884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2a675-ccc3-4ea9-85cc-138f9cc65757 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.115248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 288/575] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/role_assignments?user.id=829ac711e3d84e018404cf6dabeb3845&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:59.115248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2a675-ccc3-4ea9-85cc-138f9cc65757 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.201869 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dc8b1-19bd-4163-a4cc-7eaf7f981a4a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.245002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1676b-d53d-4c5d-99b7-d4dec7d4dbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.245664 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1676b-d53d-4c5d-99b7-d4dec7d4dbcd None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.246004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1676b-d53d-4c5d-99b7-d4dec7d4dbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.246304 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1676b-d53d-4c5d-99b7-d4dec7d4dbcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.262157 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1676b-d53d-4c5d-99b7-d4dec7d4dbcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.263734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1676b-d53d-4c5d-99b7-d4dec7d4dbcd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.267376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2a675-ccc3-4ea9-85cc-138f9cc65757 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-6af1676b-d53d-4c5d-99b7-d4dec7d4dbcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:59.285037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:59.287418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:59.287418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:59.287418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:07:59.288986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 288/576] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:59.290089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1676b-d53d-4c5d-99b7-d4dec7d4dbcd None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.318601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ba9db-8948-4ed9-b6f1-02ead553c3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.319257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ba9db-8948-4ed9-b6f1-02ead553c3ba None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.319531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ba9db-8948-4ed9-b6f1-02ead553c3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.319873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ba9db-8948-4ed9-b6f1-02ead553c3ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.333921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ba9db-8948-4ed9-b6f1-02ead553c3ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-178ba9db-8948-4ed9-b6f1-02ead553c3ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:59.342665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:59.343668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:59.344504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:59.344504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:59.344504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:59.344504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:59.344504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:59.344504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:59.344504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:59.344504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:59.344504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:59.344504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:59.344504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:59.344504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:07:59.345956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 289/577] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:59.347229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ba9db-8948-4ed9-b6f1-02ead553c3ba None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.429564 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.445557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.481716 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1676b-d53d-4c5d-99b7-d4dec7d4dbcd None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.499801 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ba9db-8948-4ed9-b6f1-02ead553c3ba None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.552097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c098d-e706-4323-8fed-a155a3031282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.553187 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c098d-e706-4323-8fed-a155a3031282 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.553680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c098d-e706-4323-8fed-a155a3031282 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.554153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c098d-e706-4323-8fed-a155a3031282 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.555380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c098d-e706-4323-8fed-a155a3031282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:59.555912 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c098d-e706-4323-8fed-a155a3031282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.559520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c098d-e706-4323-8fed-a155a3031282 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.560948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1c8f2-99c7-47b3-b7c8-f0680cb5948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.561990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1c8f2-99c7-47b3-b7c8-f0680cb5948b None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.562543 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1c8f2-99c7-47b3-b7c8-f0680cb5948b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.563054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1c8f2-99c7-47b3-b7c8-f0680cb5948b None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.564475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1c8f2-99c7-47b3-b7c8-f0680cb5948b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:59.565033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1c8f2-99c7-47b3-b7c8-f0680cb5948b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.567757 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1c8f2-99c7-47b3-b7c8-f0680cb5948b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.586641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 289/578] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:59.589222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c098d-e706-4323-8fed-a155a3031282 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.593692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 290/579] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:59.595401 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1c8f2-99c7-47b3-b7c8-f0680cb5948b None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.756996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c098d-e706-4323-8fed-a155a3031282 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.760348 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1c8f2-99c7-47b3-b7c8-f0680cb5948b None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.783241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.804164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d1466-c3d9-40c1-81e5-8d1f70fb0ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.804971 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d1466-c3d9-40c1-81e5-8d1f70fb0ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.805338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d1466-c3d9-40c1-81e5-8d1f70fb0ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.805619 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d1466-c3d9-40c1-81e5-8d1f70fb0ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.806519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d1466-c3d9-40c1-81e5-8d1f70fb0ce2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:59.806829 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d1466-c3d9-40c1-81e5-8d1f70fb0ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.808250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d1466-c3d9-40c1-81e5-8d1f70fb0ce2 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.824467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 291/580] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:59.824467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d1466-c3d9-40c1-81e5-8d1f70fb0ce2 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.830469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ed9de-51d9-4fc1-b755-31686b217e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.831367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ed9de-51d9-4fc1-b755-31686b217e89 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.831743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ed9de-51d9-4fc1-b755-31686b217e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.832133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ed9de-51d9-4fc1-b755-31686b217e89 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.832897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ed9de-51d9-4fc1-b755-31686b217e89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:59.833327 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ed9de-51d9-4fc1-b755-31686b217e89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.834933 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ed9de-51d9-4fc1-b755-31686b217e89 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.847647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 290/581] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:59.848674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ed9de-51d9-4fc1-b755-31686b217e89 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.853462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.977992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ed9de-51d9-4fc1-b755-31686b217e89 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.981406 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d1466-c3d9-40c1-81e5-8d1f70fb0ce2 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.035973 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91800a2-68a9-41fc-bb8e-7090f6c241c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.036612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91800a2-68a9-41fc-bb8e-7090f6c241c7 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.036961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91800a2-68a9-41fc-bb8e-7090f6c241c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.037303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91800a2-68a9-41fc-bb8e-7090f6c241c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.043328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9fc7a-d507-4bcb-9942-cbf5ce12b64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.044542 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9fc7a-d507-4bcb-9942-cbf5ce12b64f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.045111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9fc7a-d507-4bcb-9942-cbf5ce12b64f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.045664 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9fc7a-d507-4bcb-9942-cbf5ce12b64f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.048620 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91800a2-68a9-41fc-bb8e-7090f6c241c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.050208 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91800a2-68a9-41fc-bb8e-7090f6c241c7 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.059604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9fc7a-d507-4bcb-9942-cbf5ce12b64f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.062386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9fc7a-d507-4bcb-9942-cbf5ce12b64f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-a91800a2-68a9-41fc-bb8e-7090f6c241c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:00.063910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:00.065908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:00.068180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:00.068180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:00.068180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:00.068180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:00.068180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:00.068180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:00.068180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:00.068180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:00.068180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:00.068180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:00.068180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 292/582] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:00.068180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91800a2-68a9-41fc-bb8e-7090f6c241c7 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-c6e9fc7a-d507-4bcb-9942-cbf5ce12b64f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:00.085120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:00.087810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:00.089943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:00.089943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:00.089943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:00.089943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:00.089943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:00.089943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:00.089943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:00.089943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:00.092090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 291/583] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:00.092934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9fc7a-d507-4bcb-9942-cbf5ce12b64f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.137099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.175905 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.224912 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9fc7a-d507-4bcb-9942-cbf5ce12b64f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.249695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91800a2-68a9-41fc-bb8e-7090f6c241c7 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.266017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0f071-fdfa-435a-9cb8-d54f4d70f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.266707 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0f071-fdfa-435a-9cb8-d54f4d70f9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.268365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0f071-fdfa-435a-9cb8-d54f4d70f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.268365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0f071-fdfa-435a-9cb8-d54f4d70f9f2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.278249 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0f071-fdfa-435a-9cb8-d54f4d70f9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.279748 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0f071-fdfa-435a-9cb8-d54f4d70f9f2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-dba0f071-fdfa-435a-9cb8-d54f4d70f9f2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:00.295328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:00.296439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:00.297559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:00.297559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:00.297559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:00.297559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:00.297559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:00.297559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:00.297559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:00.297559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:00.297559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:08:00.297559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:00.301299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 292/584] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:00.302315 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0f071-fdfa-435a-9cb8-d54f4d70f9f2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.305643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1d189-ad38-4b48-81ac-e906a71215e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.307627 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1d189-ad38-4b48-81ac-e906a71215e8 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.307915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1d189-ad38-4b48-81ac-e906a71215e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.308197 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1d189-ad38-4b48-81ac-e906a71215e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.323049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1d189-ad38-4b48-81ac-e906a71215e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.324761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1d189-ad38-4b48-81ac-e906a71215e8 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-1dc1d189-ad38-4b48-81ac-e906a71215e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:00.358594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:00.360494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:00.371188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:00.371188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:00.371188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:00.371188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 293/585] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:00.371188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1d189-ad38-4b48-81ac-e906a71215e8 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.467699 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0f071-fdfa-435a-9cb8-d54f4d70f9f2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.509132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.528552 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c0bcc-4da9-456a-bd9d-ef78748e660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.529502 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c0bcc-4da9-456a-bd9d-ef78748e660c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.529966 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c0bcc-4da9-456a-bd9d-ef78748e660c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.530463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c0bcc-4da9-456a-bd9d-ef78748e660c None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.531731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c0bcc-4da9-456a-bd9d-ef78748e660c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:00.532245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c0bcc-4da9-456a-bd9d-ef78748e660c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.534544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c0bcc-4da9-456a-bd9d-ef78748e660c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.557994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.576792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 293/586] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:00.577058 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1d189-ad38-4b48-81ac-e906a71215e8 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.577219 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c0bcc-4da9-456a-bd9d-ef78748e660c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.634216 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61ade3-1a26-4501-a019-3f04e63420b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.636134 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61ade3-1a26-4501-a019-3f04e63420b0 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.636432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61ade3-1a26-4501-a019-3f04e63420b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.636725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61ade3-1a26-4501-a019-3f04e63420b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.637529 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61ade3-1a26-4501-a019-3f04e63420b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:00.637970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61ade3-1a26-4501-a019-3f04e63420b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.639517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61ade3-1a26-4501-a019-3f04e63420b0 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.659531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 294/587] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:00.661039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61ade3-1a26-4501-a019-3f04e63420b0 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.750743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c0bcc-4da9-456a-bd9d-ef78748e660c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.803522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7b0e0-c3cc-4fff-aabd-1aac23ba829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.804153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7b0e0-c3cc-4fff-aabd-1aac23ba829e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.804431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7b0e0-c3cc-4fff-aabd-1aac23ba829e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.804702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7b0e0-c3cc-4fff-aabd-1aac23ba829e None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.805630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7b0e0-c3cc-4fff-aabd-1aac23ba829e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:00.807139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7b0e0-c3cc-4fff-aabd-1aac23ba829e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.808744 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7b0e0-c3cc-4fff-aabd-1aac23ba829e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.837064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61ade3-1a26-4501-a019-3f04e63420b0 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.840922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 294/588] 10.222.0.81 () {56 vars in 1137 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:00.841825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7b0e0-c3cc-4fff-aabd-1aac23ba829e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.881937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4fa1-1b42-4704-afce-01d6797f652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.882606 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4fa1-1b42-4704-afce-01d6797f652c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.882925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4fa1-1b42-4704-afce-01d6797f652c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.883206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4fa1-1b42-4704-afce-01d6797f652c None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.883875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde4fa1-1b42-4704-afce-01d6797f652c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:00.884335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde4fa1-1b42-4704-afce-01d6797f652c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.886109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde4fa1-1b42-4704-afce-01d6797f652c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.904287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 295/589] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:00.904287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4fa1-1b42-4704-afce-01d6797f652c None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.918888 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.925767 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:01.025594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4fa1-1b42-4704-afce-01d6797f652c None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.035340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7b0e0-c3cc-4fff-aabd-1aac23ba829e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.066534 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17b112-54a6-4849-87c1-3f37ac97ccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.067199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17b112-54a6-4849-87c1-3f37ac97ccca None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.067485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17b112-54a6-4849-87c1-3f37ac97ccca None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.067766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17b112-54a6-4849-87c1-3f37ac97ccca None admin] PATH_INFO: `/v3/projects/8e86d23a023e4db497277d055b604ebe/users/7c841f03880c4fb1b402bac6ecce25fd/roles/f9bdecb8ab28491cac0078d1452a3bef` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.096282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9c2dd-7306-4bdc-a174-8d4a45978161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.097190 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9c2dd-7306-4bdc-a174-8d4a45978161 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.097492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9c2dd-7306-4bdc-a174-8d4a45978161 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.097814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9c2dd-7306-4bdc-a174-8d4a45978161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.103729 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17b112-54a6-4849-87c1-3f37ac97ccca None admin] RBAC: Authorizing `identity:create_grant(project_id=8e86d23a023e4db497277d055b604ebe, user_id=7c841f03880c4fb1b402bac6ecce25fd, role_id=f9bdecb8ab28491cac0078d1452a3bef)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.107531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17b112-54a6-4849-87c1-3f37ac97ccca None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.110930 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9c2dd-7306-4bdc-a174-8d4a45978161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.112564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9c2dd-7306-4bdc-a174-8d4a45978161 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-fcb9c2dd-7306-4bdc-a174-8d4a45978161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:01.129952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:01.138010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:01.140037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:01.140037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:01.140037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:01.140037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 295/590] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:01.140037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9c2dd-7306-4bdc-a174-8d4a45978161 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:01.258007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:01.273594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9c2dd-7306-4bdc-a174-8d4a45978161 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.313900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 296/591] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:00 2022] PUT /identity/v3/projects/8e86d23a023e4db497277d055b604ebe/users/7c841f03880c4fb1b402bac6ecce25fd/roles/f9bdecb8ab28491cac0078d1452a3bef => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:01.313900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17b112-54a6-4849-87c1-3f37ac97ccca None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:01.350904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352030f5-928c-441a-b0fe-752af388363b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.350904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352030f5-928c-441a-b0fe-752af388363b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.350904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352030f5-928c-441a-b0fe-752af388363b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.350904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352030f5-928c-441a-b0fe-752af388363b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.379607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352030f5-928c-441a-b0fe-752af388363b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.382333 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352030f5-928c-441a-b0fe-752af388363b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-352030f5-928c-441a-b0fe-752af388363b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:01.413478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:01.416035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:01.419853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:01.419853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:01.419853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:01.419853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 296/592] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:01.419853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352030f5-928c-441a-b0fe-752af388363b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:01.445698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:01.534518 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17b112-54a6-4849-87c1-3f37ac97ccca None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.598419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7acaea-b797-4e90-8e07-bf124710b97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.599853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7acaea-b797-4e90-8e07-bf124710b97c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.600569 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7acaea-b797-4e90-8e07-bf124710b97c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.601023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7acaea-b797-4e90-8e07-bf124710b97c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.613644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7acaea-b797-4e90-8e07-bf124710b97c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.616012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7acaea-b797-4e90-8e07-bf124710b97c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-1d7acaea-b797-4e90-8e07-bf124710b97c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:01.635616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:01.636763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:01.638843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:01.638843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:01.638843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:01.638843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:01.638843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:01.638843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:01.638843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:01.638843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:01.638843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:08:01.638843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:01.638843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 297/593] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:01.641496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7acaea-b797-4e90-8e07-bf124710b97c None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:01.647035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352030f5-928c-441a-b0fe-752af388363b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.705114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b91cb-9d8d-45e5-b7e0-f726fc8da774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.705845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b91cb-9d8d-45e5-b7e0-f726fc8da774 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.706192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b91cb-9d8d-45e5-b7e0-f726fc8da774 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.706561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b91cb-9d8d-45e5-b7e0-f726fc8da774 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.707303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b91cb-9d8d-45e5-b7e0-f726fc8da774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:01.707680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b91cb-9d8d-45e5-b7e0-f726fc8da774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.709178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b91cb-9d8d-45e5-b7e0-f726fc8da774 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.725351 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 297/594] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:01.726838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed313d9-b3e2-4843-8cc0-c05193c17022 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.727193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed313d9-b3e2-4843-8cc0-c05193c17022 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.727527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed313d9-b3e2-4843-8cc0-c05193c17022 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.737176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 298/595] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:01.737176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed313d9-b3e2-4843-8cc0-c05193c17022 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:01.737176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:01.844782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7acaea-b797-4e90-8e07-bf124710b97c None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.873623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:01.897550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5abcf7-f9e1-4cea-bf4b-6407f230c034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.899111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5abcf7-f9e1-4cea-bf4b-6407f230c034 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.899553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5abcf7-f9e1-4cea-bf4b-6407f230c034 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.900972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5abcf7-f9e1-4cea-bf4b-6407f230c034 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.902781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5abcf7-f9e1-4cea-bf4b-6407f230c034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:01.903439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5abcf7-f9e1-4cea-bf4b-6407f230c034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.906091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5abcf7-f9e1-4cea-bf4b-6407f230c034 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.906469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed313d9-b3e2-4843-8cc0-c05193c17022 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.928377 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 298/596] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:01.929767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41d33-4dd0-450c-9c38-a681da6e1b61 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.930080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41d33-4dd0-450c-9c38-a681da6e1b61 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.930316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41d33-4dd0-450c-9c38-a681da6e1b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.953350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-38f41d33-4dd0-450c-9c38-a681da6e1b61 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:01.953858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97fdb-a8ce-45b9-9f60-84400e2bb0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.954521 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97fdb-a8ce-45b9-9f60-84400e2bb0aa None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.954695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-38f41d33-4dd0-450c-9c38-a681da6e1b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:01.954879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97fdb-a8ce-45b9-9f60-84400e2bb0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.955121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97fdb-a8ce-45b9-9f60-84400e2bb0aa None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.955860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a97fdb-a8ce-45b9-9f60-84400e2bb0aa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:01.956164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a97fdb-a8ce-45b9-9f60-84400e2bb0aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.957633 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a97fdb-a8ce-45b9-9f60-84400e2bb0aa None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.978423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 299/597] 10.222.0.81 () {56 vars in 1139 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:01.979472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97fdb-a8ce-45b9-9f60-84400e2bb0aa None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.048624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 299/598] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:02.049806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f41d33-4dd0-450c-9c38-a681da6e1b61 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.075945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:02.133452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97fdb-a8ce-45b9-9f60-84400e2bb0aa None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.181631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754fadf-a7bc-4f74-b42c-08765f8b78da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.182736 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754fadf-a7bc-4f74-b42c-08765f8b78da None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.183174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754fadf-a7bc-4f74-b42c-08765f8b78da None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.183626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754fadf-a7bc-4f74-b42c-08765f8b78da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.191862 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754fadf-a7bc-4f74-b42c-08765f8b78da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:02.193802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754fadf-a7bc-4f74-b42c-08765f8b78da None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:02.197790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f41d33-4dd0-450c-9c38-a681da6e1b61 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-1754fadf-a7bc-4f74-b42c-08765f8b78da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:02.210037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:02.211213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:02.212376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:02.212376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:02.212376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:02.212376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:02.212376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:02.212376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:02.212376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:02.212376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:02.214400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:02.221671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 300/599] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:02.221671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754fadf-a7bc-4f74-b42c-08765f8b78da None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.254811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56028860-b924-4cb7-a526-10bda01d6997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.255652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56028860-b924-4cb7-a526-10bda01d6997 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.256635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56028860-b924-4cb7-a526-10bda01d6997 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.257022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56028860-b924-4cb7-a526-10bda01d6997 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.267727 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56028860-b924-4cb7-a526-10bda01d6997 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:02.270361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56028860-b924-4cb7-a526-10bda01d6997 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-56028860-b924-4cb7-a526-10bda01d6997 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:02.290084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:02.291843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:02.292923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:02.292923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:02.292923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:02.292923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:02.292923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:02.292923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:02.292923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:02.292923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:02.295572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 300/600] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:02.296917 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56028860-b924-4cb7-a526-10bda01d6997 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.396161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754fadf-a7bc-4f74-b42c-08765f8b78da None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.423056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:02.438913 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56028860-b924-4cb7-a526-10bda01d6997 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.446188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3516e4-f292-4467-9c09-80e23fa91278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.447300 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3516e4-f292-4467-9c09-80e23fa91278 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.447995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3516e4-f292-4467-9c09-80e23fa91278 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.448419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3516e4-f292-4467-9c09-80e23fa91278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.470138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3516e4-f292-4467-9c09-80e23fa91278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:02.472960 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3516e4-f292-4467-9c09-80e23fa91278 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:02.488277 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598107d-651e-4dee-af54-9e76887b70cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.489663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598107d-651e-4dee-af54-9e76887b70cc None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.490471 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598107d-651e-4dee-af54-9e76887b70cc None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.490969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598107d-651e-4dee-af54-9e76887b70cc None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.491884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598107d-651e-4dee-af54-9e76887b70cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:02.492343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598107d-651e-4dee-af54-9e76887b70cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:02.494276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598107d-651e-4dee-af54-9e76887b70cc None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-0c3516e4-f292-4467-9c09-80e23fa91278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:02.500165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:02.501356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:02.502468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:02.502468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:02.502468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:02.506883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 301/601] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:02.508797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3516e4-f292-4467-9c09-80e23fa91278 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.516692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 301/602] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:02.516692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598107d-651e-4dee-af54-9e76887b70cc None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.555355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:02.662331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598107d-651e-4dee-af54-9e76887b70cc None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.672480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3516e4-f292-4467-9c09-80e23fa91278 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.724346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd265d4-478f-43ca-9b13-e6c15e04fb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.725350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd265d4-478f-43ca-9b13-e6c15e04fb5f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.725826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd265d4-478f-43ca-9b13-e6c15e04fb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.726328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd265d4-478f-43ca-9b13-e6c15e04fb5f None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.727600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd265d4-478f-43ca-9b13-e6c15e04fb5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:02.729153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd265d4-478f-43ca-9b13-e6c15e04fb5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:02.731541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd265d4-478f-43ca-9b13-e6c15e04fb5f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:02.733188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264456cd-8045-4561-bb0b-75f1851ec50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.734457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264456cd-8045-4561-bb0b-75f1851ec50f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.735077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264456cd-8045-4561-bb0b-75f1851ec50f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.735681 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264456cd-8045-4561-bb0b-75f1851ec50f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.754544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 302/603] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:02.756442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd265d4-478f-43ca-9b13-e6c15e04fb5f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.763217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264456cd-8045-4561-bb0b-75f1851ec50f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-264456cd-8045-4561-bb0b-75f1851ec50f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:02.769014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:02.771048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:02.772903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:02.772903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:02.772903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:02.772903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:02.772903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:02.772903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:02.772903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:02.772903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:02.772903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:02.772903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:02.772903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:02.772903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:02.775498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 302/604] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:02.776586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264456cd-8045-4561-bb0b-75f1851ec50f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.816345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:02.927706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:02.932834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd265d4-478f-43ca-9b13-e6c15e04fb5f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.942896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264456cd-8045-4561-bb0b-75f1851ec50f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.982207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044bbaf-4146-4a1b-be29-60abe64bacac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.983029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044bbaf-4146-4a1b-be29-60abe64bacac None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.983491 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044bbaf-4146-4a1b-be29-60abe64bacac None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.983929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044bbaf-4146-4a1b-be29-60abe64bacac None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.984876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044bbaf-4146-4a1b-be29-60abe64bacac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:02.985340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044bbaf-4146-4a1b-be29-60abe64bacac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:02.985909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b61bc-0cb0-4ce7-9a2c-8dd727b5b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.986624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b61bc-0cb0-4ce7-9a2c-8dd727b5b28a None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.986930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b61bc-0cb0-4ce7-9a2c-8dd727b5b28a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.987214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b61bc-0cb0-4ce7-9a2c-8dd727b5b28a None admin] PATH_INFO: `/v3/projects/8e86d23a023e4db497277d055b604ebe/users/30946d3b3f0f4a81b2ae5aa6e84f3920/roles/f9bdecb8ab28491cac0078d1452a3bef` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.987375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044bbaf-4146-4a1b-be29-60abe64bacac None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.009852 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 303/605] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:03.009852 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044bbaf-4146-4a1b-be29-60abe64bacac None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.011346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b61bc-0cb0-4ce7-9a2c-8dd727b5b28a None admin] RBAC: Authorizing `identity:create_grant(project_id=8e86d23a023e4db497277d055b604ebe, user_id=30946d3b3f0f4a81b2ae5aa6e84f3920, role_id=f9bdecb8ab28491cac0078d1452a3bef)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:03.012928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b61bc-0cb0-4ce7-9a2c-8dd727b5b28a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.130314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:03.146090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044bbaf-4146-4a1b-be29-60abe64bacac None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:03.154270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 303/606] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:02 2022] PUT /identity/v3/projects/8e86d23a023e4db497277d055b604ebe/users/30946d3b3f0f4a81b2ae5aa6e84f3920/roles/f9bdecb8ab28491cac0078d1452a3bef => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:03.162634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b61bc-0cb0-4ce7-9a2c-8dd727b5b28a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.218959 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de408e-db5a-4c69-b96b-ccf98f76947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:03.220664 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de408e-db5a-4c69-b96b-ccf98f76947d None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.221127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de408e-db5a-4c69-b96b-ccf98f76947d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.221899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de408e-db5a-4c69-b96b-ccf98f76947d None admin] PATH_INFO: `/v3/projects/8e86d23a023e4db497277d055b604ebe/users/e128651197d840bd87220d8f5b246688/roles/f9bdecb8ab28491cac0078d1452a3bef` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de408e-db5a-4c69-b96b-ccf98f76947d None admin] RBAC: Authorizing `identity:create_grant(project_id=8e86d23a023e4db497277d055b604ebe, user_id=e128651197d840bd87220d8f5b246688, role_id=f9bdecb8ab28491cac0078d1452a3bef)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:03.263434 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de408e-db5a-4c69-b96b-ccf98f76947d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.334248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b61bc-0cb0-4ce7-9a2c-8dd727b5b28a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:03.407754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcdbf9-272b-4191-9215-7e85182a2c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:03.408567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcdbf9-272b-4191-9215-7e85182a2c38 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.408845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcdbf9-272b-4191-9215-7e85182a2c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.411204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcdbf9-272b-4191-9215-7e85182a2c38 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.411204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcdbf9-272b-4191-9215-7e85182a2c38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:03.411204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcdbf9-272b-4191-9215-7e85182a2c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:03.411670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcdbf9-272b-4191-9215-7e85182a2c38 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.417781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 304/607] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:03 2022] PUT /identity/v3/projects/8e86d23a023e4db497277d055b604ebe/users/e128651197d840bd87220d8f5b246688/roles/f9bdecb8ab28491cac0078d1452a3bef => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:03.420007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de408e-db5a-4c69-b96b-ccf98f76947d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.428564 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 304/608] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:03.430507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcdbf9-272b-4191-9215-7e85182a2c38 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.444147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:03.604133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcdbf9-272b-4191-9215-7e85182a2c38 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:03.625079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de408e-db5a-4c69-b96b-ccf98f76947d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:03.674056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9024-d1c4-4233-9e2a-5460ca07bc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:03.674759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9024-d1c4-4233-9e2a-5460ca07bc81 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.675721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9024-d1c4-4233-9e2a-5460ca07bc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.676022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9024-d1c4-4233-9e2a-5460ca07bc81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.692554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd9024-d1c4-4233-9e2a-5460ca07bc81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:03.695120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd9024-d1c4-4233-9e2a-5460ca07bc81 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.696156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a273a-5d13-4252-8b72-b85253a5c773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:03.697588 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a273a-5d13-4252-8b72-b85253a5c773 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.697818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a273a-5d13-4252-8b72-b85253a5c773 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.698109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a273a-5d13-4252-8b72-b85253a5c773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.707502 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a273a-5d13-4252-8b72-b85253a5c773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:03.709875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a273a-5d13-4252-8b72-b85253a5c773 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-dbcd9024-d1c4-4233-9e2a-5460ca07bc81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:03.717770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:03.719707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:03.721736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:03.721736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:03.721736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:03.722961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 305/609] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:03.727360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9024-d1c4-4233-9e2a-5460ca07bc81 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-fa2a273a-5d13-4252-8b72-b85253a5c773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:03.736081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:03.737079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:03.737962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:03.737962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:03.737962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:03.737962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:03.737962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:03.737962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:03.737962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:03.737962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:03.738689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 305/610] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:03.740956 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c7d9b-7add-4cb0-ab72-71e69a9a8317 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.741468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c7d9b-7add-4cb0-ab72-71e69a9a8317 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.749584 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c7d9b-7add-4cb0-ab72-71e69a9a8317 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.754285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 306/611] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:03.754285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c7d9b-7add-4cb0-ab72-71e69a9a8317 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.755769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:03.809242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:03.872516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9024-d1c4-4233-9e2a-5460ca07bc81 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:03.882102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c7d9b-7add-4cb0-ab72-71e69a9a8317 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:03.937501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e3662-3523-449a-9666-439e6f657f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:03.938519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e3662-3523-449a-9666-439e6f657f1d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.938991 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e3662-3523-449a-9666-439e6f657f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.939445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e3662-3523-449a-9666-439e6f657f1d None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.940532 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e3662-3523-449a-9666-439e6f657f1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:03.941050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e3662-3523-449a-9666-439e6f657f1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:03.943349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e3662-3523-449a-9666-439e6f657f1d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.950251 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941498d-e241-4ea8-9791-80f1204ed594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:03.951400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941498d-e241-4ea8-9791-80f1204ed594 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.952041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941498d-e241-4ea8-9791-80f1204ed594 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.952640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941498d-e241-4ea8-9791-80f1204ed594 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.954062 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941498d-e241-4ea8-9791-80f1204ed594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:03.954729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941498d-e241-4ea8-9791-80f1204ed594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:03.957829 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941498d-e241-4ea8-9791-80f1204ed594 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.968497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 306/612] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:03.970759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352605a-f11a-43c4-8f17-90a0d53e4793 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.971246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352605a-f11a-43c4-8f17-90a0d53e4793 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.971703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352605a-f11a-43c4-8f17-90a0d53e4793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.985247 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 307/613] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:03.986216 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941498d-e241-4ea8-9791-80f1204ed594 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.009705 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-0352605a-f11a-43c4-8f17-90a0d53e4793 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:04.011974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-0352605a-f11a-43c4-8f17-90a0d53e4793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:04.069918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:04.122021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941498d-e241-4ea8-9791-80f1204ed594 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.154160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 307/614] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:04.156343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352605a-f11a-43c4-8f17-90a0d53e4793 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.168970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c412d2-0f08-4a70-8fcf-fc6d57f7a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.169783 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c412d2-0f08-4a70-8fcf-fc6d57f7a633 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.169979 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c412d2-0f08-4a70-8fcf-fc6d57f7a633 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.170174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c412d2-0f08-4a70-8fcf-fc6d57f7a633 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.180244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c412d2-0f08-4a70-8fcf-fc6d57f7a633 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:04.182893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c412d2-0f08-4a70-8fcf-fc6d57f7a633 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b6c412d2-0f08-4a70-8fcf-fc6d57f7a633 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:04.201544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:04.203665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:04.205526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:04.205526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:04.205526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:04.205526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:04.205526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:04.205526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:04.205526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:04.205526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:04.205526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:04.205526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:04.209517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 308/615] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:04.227072 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c412d2-0f08-4a70-8fcf-fc6d57f7a633 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.245611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:04.369510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352605a-f11a-43c4-8f17-90a0d53e4793 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.477824 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad947ecf-7a6c-4983-86a6-e65bfd8743bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.478579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad947ecf-7a6c-4983-86a6-e65bfd8743bf None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.479114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad947ecf-7a6c-4983-86a6-e65bfd8743bf None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.479114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad947ecf-7a6c-4983-86a6-e65bfd8743bf None admin] PATH_INFO: `/v3/projects/8e86d23a023e4db497277d055b604ebe/users/241e34a86aba4c3a92ed9d469e6a205e/roles/f9bdecb8ab28491cac0078d1452a3bef` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.504509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad947ecf-7a6c-4983-86a6-e65bfd8743bf None admin] RBAC: Authorizing `identity:create_grant(project_id=8e86d23a023e4db497277d055b604ebe, user_id=241e34a86aba4c3a92ed9d469e6a205e, role_id=f9bdecb8ab28491cac0078d1452a3bef)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:04.506022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad947ecf-7a6c-4983-86a6-e65bfd8743bf None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:04.508612 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c412d2-0f08-4a70-8fcf-fc6d57f7a633 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.551939 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:04.570621 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3baca0-374b-4b76-9cda-762e7ba47a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.571559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3baca0-374b-4b76-9cda-762e7ba47a0f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.572001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3baca0-374b-4b76-9cda-762e7ba47a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.572446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3baca0-374b-4b76-9cda-762e7ba47a0f None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.573778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3baca0-374b-4b76-9cda-762e7ba47a0f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:04.574345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3baca0-374b-4b76-9cda-762e7ba47a0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:04.576971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3baca0-374b-4b76-9cda-762e7ba47a0f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:04.597875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 308/616] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:04 2022] PUT /identity/v3/projects/8e86d23a023e4db497277d055b604ebe/users/241e34a86aba4c3a92ed9d469e6a205e/roles/f9bdecb8ab28491cac0078d1452a3bef => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:04.599029 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad947ecf-7a6c-4983-86a6-e65bfd8743bf None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.612541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 309/617] 10.222.0.81 () {56 vars in 1135 bytes} [Mon Aug 29 20:08:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:04.625249 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3baca0-374b-4b76-9cda-762e7ba47a0f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.853749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:04.875747 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad947ecf-7a6c-4983-86a6-e65bfd8743bf None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.905392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3baca0-374b-4b76-9cda-762e7ba47a0f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.970728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e503634-08bb-4f2a-b668-3e3484772e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.971418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e503634-08bb-4f2a-b668-3e3484772e38 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.971754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e503634-08bb-4f2a-b668-3e3484772e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.972028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e503634-08bb-4f2a-b668-3e3484772e38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.980680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ff91-d9e9-45a5-925e-8adfa74e5dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.981333 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ff91-d9e9-45a5-925e-8adfa74e5dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.981607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ff91-d9e9-45a5-925e-8adfa74e5dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.981873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ff91-d9e9-45a5-925e-8adfa74e5dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.001639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e503634-08bb-4f2a-b668-3e3484772e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-2e503634-08bb-4f2a-b668-3e3484772e38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:05.006768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:05.007772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:05.008703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:05.008703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:05.008703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:05.008703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:05.008703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:05.008703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:05.008703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:05.008703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:05.008703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:05.008703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:05.008703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:05.008703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:05.011673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22ff91-d9e9-45a5-925e-8adfa74e5dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.014026 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22ff91-d9e9-45a5-925e-8adfa74e5dc5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.014326 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 309/618] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:05.020346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e503634-08bb-4f2a-b668-3e3484772e38 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-ca22ff91-d9e9-45a5-925e-8adfa74e5dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:05.046256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:05.048685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:05.051002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:05.051002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:05.051002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:05.054282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 310/619] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:05.059812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ff91-d9e9-45a5-925e-8adfa74e5dc5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.137235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:05.245578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ff91-d9e9-45a5-925e-8adfa74e5dc5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.294330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e503634-08bb-4f2a-b668-3e3484772e38 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.297541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48933c95-4f78-424c-ba58-540b659ae380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.298718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48933c95-4f78-424c-ba58-540b659ae380 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.299241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48933c95-4f78-424c-ba58-540b659ae380 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.299735 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48933c95-4f78-424c-ba58-540b659ae380 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.300659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48933c95-4f78-424c-ba58-540b659ae380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:05.301227 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48933c95-4f78-424c-ba58-540b659ae380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.302923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48933c95-4f78-424c-ba58-540b659ae380 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.336318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 311/620] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:05.342675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48933c95-4f78-424c-ba58-540b659ae380 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.368222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0222a-27dd-4a49-b49d-f5a38652c2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.369727 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0222a-27dd-4a49-b49d-f5a38652c2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.370010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0222a-27dd-4a49-b49d-f5a38652c2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.370308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0222a-27dd-4a49-b49d-f5a38652c2e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.371039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0222a-27dd-4a49-b49d-f5a38652c2e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:05.371348 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0222a-27dd-4a49-b49d-f5a38652c2e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.372808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0222a-27dd-4a49-b49d-f5a38652c2e1 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.402612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 310/621] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:05.408363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0222a-27dd-4a49-b49d-f5a38652c2e1 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.550620 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:05.591128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:05.598353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0222a-27dd-4a49-b49d-f5a38652c2e1 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.605756 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48933c95-4f78-424c-ba58-540b659ae380 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.653057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02066b8f-38b2-4e8f-9368-83283921b9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.653622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02066b8f-38b2-4e8f-9368-83283921b9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.653906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02066b8f-38b2-4e8f-9368-83283921b9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.654176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02066b8f-38b2-4e8f-9368-83283921b9f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.663013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faaf60-88a3-4a49-ada6-9ba61031fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.663672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faaf60-88a3-4a49-ada6-9ba61031fc04 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.663994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faaf60-88a3-4a49-ada6-9ba61031fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.664352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faaf60-88a3-4a49-ada6-9ba61031fc04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.667734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02066b8f-38b2-4e8f-9368-83283921b9f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.669243 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02066b8f-38b2-4e8f-9368-83283921b9f6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.677390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faaf60-88a3-4a49-ada6-9ba61031fc04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.678913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faaf60-88a3-4a49-ada6-9ba61031fc04 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-02066b8f-38b2-4e8f-9368-83283921b9f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:05.685436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:05.686542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:05.687827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:05.687827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:05.687827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:05.687827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 311/622] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:05.700404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02066b8f-38b2-4e8f-9368-83283921b9f6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-26faaf60-88a3-4a49-ada6-9ba61031fc04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:05.705813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:05.708046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:05.710375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:05.710375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:05.710375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:05.710375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:05.710375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:05.710375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:05.710375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:05.710375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:05.710375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 312/623] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:05.719328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faaf60-88a3-4a49-ada6-9ba61031fc04 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.864587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:05.925807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faaf60-88a3-4a49-ada6-9ba61031fc04 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.940440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02066b8f-38b2-4e8f-9368-83283921b9f6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.976586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daad68-733b-43ed-a3ac-3e20002cc49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.977211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daad68-733b-43ed-a3ac-3e20002cc49e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.977574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daad68-733b-43ed-a3ac-3e20002cc49e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.978023 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daad68-733b-43ed-a3ac-3e20002cc49e None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.978885 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68daad68-733b-43ed-a3ac-3e20002cc49e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:05.979104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68daad68-733b-43ed-a3ac-3e20002cc49e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.980578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68daad68-733b-43ed-a3ac-3e20002cc49e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.984767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b82dd3-8009-4401-9ced-5cf1e9ea63ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.985497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82dd3-8009-4401-9ced-5cf1e9ea63ff None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.985847 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82dd3-8009-4401-9ced-5cf1e9ea63ff None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.986190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82dd3-8009-4401-9ced-5cf1e9ea63ff None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.986961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b82dd3-8009-4401-9ced-5cf1e9ea63ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:05.987337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b82dd3-8009-4401-9ced-5cf1e9ea63ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.988854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b82dd3-8009-4401-9ced-5cf1e9ea63ff None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.002273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 313/624] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:06.002273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015476c1-fb53-483c-ae8c-2f819f2c2bea None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.002273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015476c1-fb53-483c-ae8c-2f819f2c2bea None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.002273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015476c1-fb53-483c-ae8c-2f819f2c2bea None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.002273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 314/625] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:06.002273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f2723-f7e6-4c28-b6f5-3fcccee9bd7e None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.003183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f2723-f7e6-4c28-b6f5-3fcccee9bd7e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.003183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f2723-f7e6-4c28-b6f5-3fcccee9bd7e None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.003950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 315/627] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:06.004130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 312/627] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:06.007687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b7e46-6712-4302-8165-0b9ec8b2f95c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.007965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b7e46-6712-4302-8165-0b9ec8b2f95c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.008266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b7e46-6712-4302-8165-0b9ec8b2f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.011260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b82dd3-8009-4401-9ced-5cf1e9ea63ff None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.040310 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a53b7e46-6712-4302-8165-0b9ec8b2f95c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:06.042674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a53b7e46-6712-4302-8165-0b9ec8b2f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:06.064200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:06.169861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b82dd3-8009-4401-9ced-5cf1e9ea63ff None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.186772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 316/628] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:08:06.189159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b7e46-6712-4302-8165-0b9ec8b2f95c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.226360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:06.248338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02562b-6ac7-4971-aba9-15f4355a5599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.249762 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02562b-6ac7-4971-aba9-15f4355a5599 None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.250262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02562b-6ac7-4971-aba9-15f4355a5599 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.251371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02562b-6ac7-4971-aba9-15f4355a5599 None admin] PATH_INFO: `/v3/projects/8e86d23a023e4db497277d055b604ebe/users/829ac711e3d84e018404cf6dabeb3845/roles/f9bdecb8ab28491cac0078d1452a3bef` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.292187 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02562b-6ac7-4971-aba9-15f4355a5599 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e86d23a023e4db497277d055b604ebe, user_id=829ac711e3d84e018404cf6dabeb3845, role_id=f9bdecb8ab28491cac0078d1452a3bef)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:06.296307 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02562b-6ac7-4971-aba9-15f4355a5599 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.330820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b7e46-6712-4302-8165-0b9ec8b2f95c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.417908 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d67c0-4019-4495-8af4-0aab8499a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.419075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d67c0-4019-4495-8af4-0aab8499a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.419550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d67c0-4019-4495-8af4-0aab8499a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.420000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d67c0-4019-4495-8af4-0aab8499a6e8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.435410 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d67c0-4019-4495-8af4-0aab8499a6e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:06.438432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d67c0-4019-4495-8af4-0aab8499a6e8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.450113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 313/629] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:06 2022] PUT /identity/v3/projects/8e86d23a023e4db497277d055b604ebe/users/829ac711e3d84e018404cf6dabeb3845/roles/f9bdecb8ab28491cac0078d1452a3bef => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:06.453622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2199d8-b6bb-4a13-b845-f510d5f3a3d8 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.454621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2199d8-b6bb-4a13-b845-f510d5f3a3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.455444 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2199d8-b6bb-4a13-b845-f510d5f3a3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-373d67c0-4019-4495-8af4-0aab8499a6e8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:06.464599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:06.466823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:06.468724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:06.468724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:06.468724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:06.468724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:06.468724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:06.468724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:06.468724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:06.468724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:06.468724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:08:06.468724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:06.468724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 317/630] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:06.478445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d67c0-4019-4495-8af4-0aab8499a6e8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.483779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:06.504827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6b2199d8-b6bb-4a13-b845-f510d5f3a3d8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:06.507685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6b2199d8-b6bb-4a13-b845-f510d5f3a3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:06.630714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 314/631] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:06.631864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2199d8-b6bb-4a13-b845-f510d5f3a3d8 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.723984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d67c0-4019-4495-8af4-0aab8499a6e8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.789495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2199d8-b6bb-4a13-b845-f510d5f3a3d8 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.794082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104b948-6176-4148-9893-70248a520ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.795446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104b948-6176-4148-9893-70248a520ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.796227 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104b948-6176-4148-9893-70248a520ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.796978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104b948-6176-4148-9893-70248a520ba8 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.798712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104b948-6176-4148-9893-70248a520ba8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:06.799611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104b948-6176-4148-9893-70248a520ba8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:06.802605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104b948-6176-4148-9893-70248a520ba8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.805486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:06.831328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd43ba7-08c6-4f4f-a057-16a578e06cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.832002 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd43ba7-08c6-4f4f-a057-16a578e06cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.832328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd43ba7-08c6-4f4f-a057-16a578e06cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.832598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd43ba7-08c6-4f4f-a057-16a578e06cf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.842274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 318/632] 10.222.0.81 () {56 vars in 1137 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:06.847097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104b948-6176-4148-9893-70248a520ba8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.864800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd43ba7-08c6-4f4f-a057-16a578e06cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-5cd43ba7-08c6-4f4f-a057-16a578e06cf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:06.871571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:06.872653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:06.873702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:06.873702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:06.873702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:06.873702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:06.873702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:06.873702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:06.873702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:06.873702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:06.873702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:06.873702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:06.873702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:06.873702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:06.880058 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 315/633] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:06.887701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd43ba7-08c6-4f4f-a057-16a578e06cf0 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.984328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:07.048839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd43ba7-08c6-4f4f-a057-16a578e06cf0 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.105139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104b948-6176-4148-9893-70248a520ba8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.131828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c533f-ed15-4abe-a81c-9041ccf1f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.132882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c533f-ed15-4abe-a81c-9041ccf1f980 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.133386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c533f-ed15-4abe-a81c-9041ccf1f980 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.134394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c533f-ed15-4abe-a81c-9041ccf1f980 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.137139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c533f-ed15-4abe-a81c-9041ccf1f980 None admin] RBAC: Adding query filter params (name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:07.137873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c533f-ed15-4abe-a81c-9041ccf1f980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.141857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c533f-ed15-4abe-a81c-9041ccf1f980 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.159380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45dd16-21e8-43fc-871c-b81d64363a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.160293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45dd16-21e8-43fc-871c-b81d64363a19 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.160730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45dd16-21e8-43fc-871c-b81d64363a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.160920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 316/634] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:07.165728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c533f-ed15-4abe-a81c-9041ccf1f980 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.166426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45dd16-21e8-43fc-871c-b81d64363a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.243177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:07.270696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45dd16-21e8-43fc-871c-b81d64363a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.273122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45dd16-21e8-43fc-871c-b81d64363a19 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.371799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c533f-ed15-4abe-a81c-9041ccf1f980 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.373615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:07.427009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bce889-0b91-4dc0-b6f6-21f883f86279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.427927 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bce889-0b91-4dc0-b6f6-21f883f86279 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.428546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bce889-0b91-4dc0-b6f6-21f883f86279 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.428987 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bce889-0b91-4dc0-b6f6-21f883f86279 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.439606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 319/635] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:07.439606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45dd16-21e8-43fc-871c-b81d64363a19 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.450975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bce889-0b91-4dc0-b6f6-21f883f86279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-e6bce889-0b91-4dc0-b6f6-21f883f86279 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:07.460459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:07.462666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:07.464538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:07.464538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:07.464538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:07.464538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:07.464538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:07.464538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:07.464538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:07.464538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:07.464538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:07.464538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:07.464538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:07.464538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:07.469738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 317/636] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:07.471977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9977-a9ed-46b6-b84d-71053f527c95 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.472428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9977-a9ed-46b6-b84d-71053f527c95 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.472859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9977-a9ed-46b6-b84d-71053f527c95 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.474940 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 318/637] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:07.479614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9977-a9ed-46b6-b84d-71053f527c95 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.585116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45dd16-21e8-43fc-871c-b81d64363a19 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.610739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:07.627432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9977-a9ed-46b6-b84d-71053f527c95 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.629447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e69ae-b7c0-4d59-9238-3912f1bef921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.630455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e69ae-b7c0-4d59-9238-3912f1bef921 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.630901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e69ae-b7c0-4d59-9238-3912f1bef921 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.631428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e69ae-b7c0-4d59-9238-3912f1bef921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.645242 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e69ae-b7c0-4d59-9238-3912f1bef921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.646772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e69ae-b7c0-4d59-9238-3912f1bef921 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-0d8e69ae-b7c0-4d59-9238-3912f1bef921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:07.664021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:07.665107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:07.666001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:07.666001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:07.666001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:07.666001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 320/638] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:07.666578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e69ae-b7c0-4d59-9238-3912f1bef921 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.679249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b42d4-2294-45e9-98f2-6e93c5110ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.680613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b42d4-2294-45e9-98f2-6e93c5110ace None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.681791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b42d4-2294-45e9-98f2-6e93c5110ace None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.682344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b42d4-2294-45e9-98f2-6e93c5110ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.690609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:07.696139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b42d4-2294-45e9-98f2-6e93c5110ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.698840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b42d4-2294-45e9-98f2-6e93c5110ace None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-086b42d4-2294-45e9-98f2-6e93c5110ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:07.717509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:07.718828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:07.720670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:07.720670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:07.720670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:07.723395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 319/639] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:07.725148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece989c-f272-4bb7-85e7-ab8e54925884 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.725514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece989c-f272-4bb7-85e7-ab8e54925884 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.725676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece989c-f272-4bb7-85e7-ab8e54925884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.747926 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-eece989c-f272-4bb7-85e7-ab8e54925884 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:07.749261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-eece989c-f272-4bb7-85e7-ab8e54925884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:07.814329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e69ae-b7c0-4d59-9238-3912f1bef921 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.854510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 320/640] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:07.854510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece989c-f272-4bb7-85e7-ab8e54925884 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.881234 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6434-cf83-4caf-b06c-908e74641516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.882916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6434-cf83-4caf-b06c-908e74641516 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.883526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6434-cf83-4caf-b06c-908e74641516 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.884629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6434-cf83-4caf-b06c-908e74641516 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.886612 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee6434-cf83-4caf-b06c-908e74641516 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:07.887452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee6434-cf83-4caf-b06c-908e74641516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.890689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee6434-cf83-4caf-b06c-908e74641516 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.910614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 321/641] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:07.913373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6434-cf83-4caf-b06c-908e74641516 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.005059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.065252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece989c-f272-4bb7-85e7-ab8e54925884 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.082034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.132566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6434-cf83-4caf-b06c-908e74641516 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.133360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e2595-64dd-4e9b-a2cb-4cb863232f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.134684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e2595-64dd-4e9b-a2cb-4cb863232f46 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.135268 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e2595-64dd-4e9b-a2cb-4cb863232f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.135833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e2595-64dd-4e9b-a2cb-4cb863232f46 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.137069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e2595-64dd-4e9b-a2cb-4cb863232f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:08.137915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e2595-64dd-4e9b-a2cb-4cb863232f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.140818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e2595-64dd-4e9b-a2cb-4cb863232f46 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.168144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 321/642] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:08.168144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e2595-64dd-4e9b-a2cb-4cb863232f46 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.207488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d33293-8822-42f5-80f6-ce9c333dda95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.208299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d33293-8822-42f5-80f6-ce9c333dda95 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.208714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d33293-8822-42f5-80f6-ce9c333dda95 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.209171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d33293-8822-42f5-80f6-ce9c333dda95 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.209980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d33293-8822-42f5-80f6-ce9c333dda95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:08.210482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d33293-8822-42f5-80f6-ce9c333dda95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.212961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d33293-8822-42f5-80f6-ce9c333dda95 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.241490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 322/643] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:08.241490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d33293-8822-42f5-80f6-ce9c333dda95 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.329495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e2595-64dd-4e9b-a2cb-4cb863232f46 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.371926 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d33293-8822-42f5-80f6-ce9c333dda95 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.380365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.386080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da25d1-e137-4ad4-a814-b1b244da4f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.386583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da25d1-e137-4ad4-a814-b1b244da4f84 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.386862 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da25d1-e137-4ad4-a814-b1b244da4f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.387132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da25d1-e137-4ad4-a814-b1b244da4f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.399388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da25d1-e137-4ad4-a814-b1b244da4f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.402342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da25d1-e137-4ad4-a814-b1b244da4f84 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-d2da25d1-e137-4ad4-a814-b1b244da4f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:08.425521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:08.427716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:08.429211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:08.429211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:08.429211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:08.429211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 322/644] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:08.429211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da25d1-e137-4ad4-a814-b1b244da4f84 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.438793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa6230-cc7a-4622-98c2-70e4fbb72508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.439679 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa6230-cc7a-4622-98c2-70e4fbb72508 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.439938 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa6230-cc7a-4622-98c2-70e4fbb72508 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.440143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa6230-cc7a-4622-98c2-70e4fbb72508 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.442769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.451145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa6230-cc7a-4622-98c2-70e4fbb72508 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.453170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa6230-cc7a-4622-98c2-70e4fbb72508 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2caa6230-cc7a-4622-98c2-70e4fbb72508 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:08.468116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:08.470875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:08.473135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:08.473135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:08.473135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:08.473135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:08.473135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:08.473135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:08.473135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:08.473135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:08.473135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:08:08.473135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:08.473135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 323/645] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:08.473135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa6230-cc7a-4622-98c2-70e4fbb72508 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.612591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da25d1-e137-4ad4-a814-b1b244da4f84 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.643571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa6230-cc7a-4622-98c2-70e4fbb72508 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.655403 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e61cc-cd71-4ec3-a49e-8b98527fd704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.656045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e61cc-cd71-4ec3-a49e-8b98527fd704 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.656327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e61cc-cd71-4ec3-a49e-8b98527fd704 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.656598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e61cc-cd71-4ec3-a49e-8b98527fd704 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.677276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e61cc-cd71-4ec3-a49e-8b98527fd704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-b54e61cc-cd71-4ec3-a49e-8b98527fd704 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:08.688264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:08.689730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:08.690617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:08.690617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:08.690617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:08.690617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:08.690617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:08.690617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:08.690617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:08.690617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:08.690617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:08.690617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:08.690617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:08.690617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:08.691257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 323/646] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:08.692357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e61cc-cd71-4ec3-a49e-8b98527fd704 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.704393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e339c56-aa6d-4ffd-a3e8-86ee16e19547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.705041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e339c56-aa6d-4ffd-a3e8-86ee16e19547 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.705316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e339c56-aa6d-4ffd-a3e8-86ee16e19547 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.705587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e339c56-aa6d-4ffd-a3e8-86ee16e19547 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.716883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e339c56-aa6d-4ffd-a3e8-86ee16e19547 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.718445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e339c56-aa6d-4ffd-a3e8-86ee16e19547 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-3e339c56-aa6d-4ffd-a3e8-86ee16e19547 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:08.732305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:08.733288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:08.734165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:08.734165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:08.734165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:08.734165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:08.734165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:08.734165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:08.734165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:08.734165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:08.734165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 324/647] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:08.734676 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e339c56-aa6d-4ffd-a3e8-86ee16e19547 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.763592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.805508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.845280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e61cc-cd71-4ec3-a49e-8b98527fd704 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.870830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e339c56-aa6d-4ffd-a3e8-86ee16e19547 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.914150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cf221-7be7-492c-8600-c29e5c5e47c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.914490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987bb24-23b1-467d-a25c-07596493f70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.914986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987bb24-23b1-467d-a25c-07596493f70c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.915149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf221-7be7-492c-8600-c29e5c5e47c5 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.915284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987bb24-23b1-467d-a25c-07596493f70c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.915580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987bb24-23b1-467d-a25c-07596493f70c None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.915752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf221-7be7-492c-8600-c29e5c5e47c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.915893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf221-7be7-492c-8600-c29e5c5e47c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.916422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987bb24-23b1-467d-a25c-07596493f70c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:08.916734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987bb24-23b1-467d-a25c-07596493f70c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.916889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cf221-7be7-492c-8600-c29e5c5e47c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:08.917357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cf221-7be7-492c-8600-c29e5c5e47c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.918208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987bb24-23b1-467d-a25c-07596493f70c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.919809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cf221-7be7-492c-8600-c29e5c5e47c5 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.939202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 325/648] 10.222.0.81 () {56 vars in 1137 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:08.947853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 324/649] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:08.947853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cf221-7be7-492c-8600-c29e5c5e47c5 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.948269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987bb24-23b1-467d-a25c-07596493f70c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.061631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987bb24-23b1-467d-a25c-07596493f70c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.077029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.089196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cf221-7be7-492c-8600-c29e5c5e47c5 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.091975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.101994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54f472-c373-4cf6-b64f-6d847a88586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.102786 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f472-c373-4cf6-b64f-6d847a88586f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.103069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f472-c373-4cf6-b64f-6d847a88586f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.103396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f472-c373-4cf6-b64f-6d847a88586f None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.104218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54f472-c373-4cf6-b64f-6d847a88586f None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:09.104529 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54f472-c373-4cf6-b64f-6d847a88586f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.105927 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54f472-c373-4cf6-b64f-6d847a88586f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.120967 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 326/650] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:09.121842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54f472-c373-4cf6-b64f-6d847a88586f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.130447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f74f5-878d-4449-a92c-806b4a80026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.131832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f74f5-878d-4449-a92c-806b4a80026c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.131832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f74f5-878d-4449-a92c-806b4a80026c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.131832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f74f5-878d-4449-a92c-806b4a80026c None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.132970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f74f5-878d-4449-a92c-806b4a80026c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:09.133184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f74f5-878d-4449-a92c-806b4a80026c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.134834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f74f5-878d-4449-a92c-806b4a80026c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.148019 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 325/651] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:09.149193 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f74f5-878d-4449-a92c-806b4a80026c None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.239709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54f472-c373-4cf6-b64f-6d847a88586f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.259984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f74f5-878d-4449-a92c-806b4a80026c None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.282821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecb403-4c15-43f8-91ab-ecd01e3bb60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.282821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecb403-4c15-43f8-91ab-ecd01e3bb60a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.282821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecb403-4c15-43f8-91ab-ecd01e3bb60a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.283956 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecb403-4c15-43f8-91ab-ecd01e3bb60a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.298737 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b568b1-f222-4a46-ac62-79911f8a4b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.299382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b568b1-f222-4a46-ac62-79911f8a4b55 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.299661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b568b1-f222-4a46-ac62-79911f8a4b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.299933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b568b1-f222-4a46-ac62-79911f8a4b55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.309752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b568b1-f222-4a46-ac62-79911f8a4b55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.311245 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b568b1-f222-4a46-ac62-79911f8a4b55 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-67b568b1-f222-4a46-ac62-79911f8a4b55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:09.323972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:09.325137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 326/652] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979f31d-d477-4930-9d75-1b687b5563b0 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.331672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979f31d-d477-4930-9d75-1b687b5563b0 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.332734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979f31d-d477-4930-9d75-1b687b5563b0 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.332734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 327/653] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:09.332734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979f31d-d477-4930-9d75-1b687b5563b0 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.333305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.377152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecb403-4c15-43f8-91ab-ecd01e3bb60a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.378324 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.379641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecb403-4c15-43f8-91ab-ecd01e3bb60a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.491483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979f31d-d477-4930-9d75-1b687b5563b0 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.501402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 327/654] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:09.502288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecb403-4c15-43f8-91ab-ecd01e3bb60a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.535516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f827289-867e-49d9-bcb8-af7a79afb0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.536453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f827289-867e-49d9-bcb8-af7a79afb0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.536881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f827289-867e-49d9-bcb8-af7a79afb0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.537291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f827289-867e-49d9-bcb8-af7a79afb0b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.553587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f827289-867e-49d9-bcb8-af7a79afb0b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.555186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f827289-867e-49d9-bcb8-af7a79afb0b1 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-3f827289-867e-49d9-bcb8-af7a79afb0b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:09.576746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:09.577998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:09.578985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:09.578985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:09.578985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:09.578985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 328/655] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:09.578985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f827289-867e-49d9-bcb8-af7a79afb0b1 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.596406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.630167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecb403-4c15-43f8-91ab-ecd01e3bb60a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.672406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f16891-7b1f-477d-b99f-315260155dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.673197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f16891-7b1f-477d-b99f-315260155dee None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.673571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f16891-7b1f-477d-b99f-315260155dee None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.673949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f16891-7b1f-477d-b99f-315260155dee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.674831 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f16891-7b1f-477d-b99f-315260155dee None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=7c841f03880c4fb1b402bac6ecce25fd) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:09.675227 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f16891-7b1f-477d-b99f-315260155dee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.676830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f16891-7b1f-477d-b99f-315260155dee None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.684214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 328/656] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/role_assignments?user.id=7c841f03880c4fb1b402bac6ecce25fd&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:09.685504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062794ec-37a9-43c4-b3cc-49aa5aeaecc8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.685783 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062794ec-37a9-43c4-b3cc-49aa5aeaecc8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.686051 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062794ec-37a9-43c4-b3cc-49aa5aeaecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.699841 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.707039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-062794ec-37a9-43c4-b3cc-49aa5aeaecc8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:09.708481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-062794ec-37a9-43c4-b3cc-49aa5aeaecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:09.736420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f827289-867e-49d9-bcb8-af7a79afb0b1 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.789376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebefa3-32c9-485c-8147-879ff89f6cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.790337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebefa3-32c9-485c-8147-879ff89f6cdc None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.790826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebefa3-32c9-485c-8147-879ff89f6cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.791320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebefa3-32c9-485c-8147-879ff89f6cdc None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.792428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebefa3-32c9-485c-8147-879ff89f6cdc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:09.792918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebefa3-32c9-485c-8147-879ff89f6cdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.795519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebefa3-32c9-485c-8147-879ff89f6cdc None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.817788 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 329/657] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:09.819592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062794ec-37a9-43c4-b3cc-49aa5aeaecc8 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.834442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 329/658] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:09.835754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebefa3-32c9-485c-8147-879ff89f6cdc None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.934675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:10.000687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062794ec-37a9-43c4-b3cc-49aa5aeaecc8 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.044338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebefa3-32c9-485c-8147-879ff89f6cdc None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.056394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ed07a-4d25-4b10-965c-e0e1ade659fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.057623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ed07a-4d25-4b10-965c-e0e1ade659fa None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.058062 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ed07a-4d25-4b10-965c-e0e1ade659fa None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.058375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ed07a-4d25-4b10-965c-e0e1ade659fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.073598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ed07a-4d25-4b10-965c-e0e1ade659fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:10.076238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ed07a-4d25-4b10-965c-e0e1ade659fa None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:10.092005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab34f20-8984-47b2-be7d-ca90bbec0719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.092976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab34f20-8984-47b2-be7d-ca90bbec0719 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.093437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab34f20-8984-47b2-be7d-ca90bbec0719 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.094389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab34f20-8984-47b2-be7d-ca90bbec0719 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.095257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab34f20-8984-47b2-be7d-ca90bbec0719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:10.096023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab34f20-8984-47b2-be7d-ca90bbec0719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:10.097700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab34f20-8984-47b2-be7d-ca90bbec0719 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:10.099948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b72ed07a-4d25-4b10-965c-e0e1ade659fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:10.106865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:10.107883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:10.108814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:10.108814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:10.108814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:10.109223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 330/659] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:10.114859 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ed07a-4d25-4b10-965c-e0e1ade659fa None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.115701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 330/660] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:10.121688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab34f20-8984-47b2-be7d-ca90bbec0719 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.257494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab34f20-8984-47b2-be7d-ca90bbec0719 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.275983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ed07a-4d25-4b10-965c-e0e1ade659fa None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.297676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fc30b-2b80-4c98-8433-9cbddfef412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.298216 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fc30b-2b80-4c98-8433-9cbddfef412b None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.298547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fc30b-2b80-4c98-8433-9cbddfef412b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.299101 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:10.299788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fc30b-2b80-4c98-8433-9cbddfef412b None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.300518 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fc30b-2b80-4c98-8433-9cbddfef412b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:10.300832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fc30b-2b80-4c98-8433-9cbddfef412b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:10.302489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fc30b-2b80-4c98-8433-9cbddfef412b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:10.314505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae598a-dc54-4510-93a0-9f86662fdff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.319124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae598a-dc54-4510-93a0-9f86662fdff0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.319267 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 331/661] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:10.319361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae598a-dc54-4510-93a0-9f86662fdff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.319361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae598a-dc54-4510-93a0-9f86662fdff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.319550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fc30b-2b80-4c98-8433-9cbddfef412b None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.392432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:10.420390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae598a-dc54-4510-93a0-9f86662fdff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:10.421921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae598a-dc54-4510-93a0-9f86662fdff0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:10.449736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fc30b-2b80-4c98-8433-9cbddfef412b None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.489880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044934b5-c870-4d60-be79-fb6f3dbe76a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.490556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044934b5-c870-4d60-be79-fb6f3dbe76a6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.490836 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044934b5-c870-4d60-be79-fb6f3dbe76a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.491109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044934b5-c870-4d60-be79-fb6f3dbe76a6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.499261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044934b5-c870-4d60-be79-fb6f3dbe76a6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:10.500840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044934b5-c870-4d60-be79-fb6f3dbe76a6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-044934b5-c870-4d60-be79-fb6f3dbe76a6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:10.514275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:10.515611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:10.516556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:10.516556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:10.516556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:10.516556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:10.516556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:10.516556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:10.516556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:10.516556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:10.516556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:08:10.516556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:10.516556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 332/662] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:10.516556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044934b5-c870-4d60-be79-fb6f3dbe76a6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.553635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 331/663] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:10.555223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae598a-dc54-4510-93a0-9f86662fdff0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.583383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:10.650660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044934b5-c870-4d60-be79-fb6f3dbe76a6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.668579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:10.679970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae598a-dc54-4510-93a0-9f86662fdff0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.696643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21276f55-8b45-4070-92e5-274dd3d5bace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.697334 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21276f55-8b45-4070-92e5-274dd3d5bace None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.697700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21276f55-8b45-4070-92e5-274dd3d5bace None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.698030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21276f55-8b45-4070-92e5-274dd3d5bace None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.710914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21276f55-8b45-4070-92e5-274dd3d5bace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-21276f55-8b45-4070-92e5-274dd3d5bace None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:10.716961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:10.717930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 333/664] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:10.719136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21276f55-8b45-4070-92e5-274dd3d5bace None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.744330 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ac852-edf4-4028-a68a-f16033358f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.745380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ac852-edf4-4028-a68a-f16033358f63 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.745887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ac852-edf4-4028-a68a-f16033358f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.746411 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ac852-edf4-4028-a68a-f16033358f63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.756526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ac852-edf4-4028-a68a-f16033358f63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:10.758015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ac852-edf4-4028-a68a-f16033358f63 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-4a1ac852-edf4-4028-a68a-f16033358f63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:10.771266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:10.772228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:10.773447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:10.773447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:10.773447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:10.773447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:10.773447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:10.773447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:10.773447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:10.773447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:10.773447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 332/665] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:10.773932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ac852-edf4-4028-a68a-f16033358f63 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.873402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21276f55-8b45-4070-92e5-274dd3d5bace None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.895698 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:10.922722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934644c-b9f4-4a1b-a71a-3c8d8dfa0cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.923339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934644c-b9f4-4a1b-a71a-3c8d8dfa0cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.923621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934644c-b9f4-4a1b-a71a-3c8d8dfa0cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.923892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934644c-b9f4-4a1b-a71a-3c8d8dfa0cb6 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.924641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934644c-b9f4-4a1b-a71a-3c8d8dfa0cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:10.924941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934644c-b9f4-4a1b-a71a-3c8d8dfa0cb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:10.926428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934644c-b9f4-4a1b-a71a-3c8d8dfa0cb6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:10.934997 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ac852-edf4-4028-a68a-f16033358f63 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.949010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 334/666] 10.222.0.81 () {56 vars in 1139 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:10.950103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934644c-b9f4-4a1b-a71a-3c8d8dfa0cb6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.997604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:11.001688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16d5a-5536-4c92-a6f2-205a79a11012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.002355 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16d5a-5536-4c92-a6f2-205a79a11012 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.002632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16d5a-5536-4c92-a6f2-205a79a11012 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.002901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16d5a-5536-4c92-a6f2-205a79a11012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.017199 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c16d5a-5536-4c92-a6f2-205a79a11012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.020203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c16d5a-5536-4c92-a6f2-205a79a11012 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-95c16d5a-5536-4c92-a6f2-205a79a11012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:11.046846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:11.047874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:11.048886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:11.048886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:11.048886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:11.048886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 333/667] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:11.050518 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16d5a-5536-4c92-a6f2-205a79a11012 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.091920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934644c-b9f4-4a1b-a71a-3c8d8dfa0cb6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.135176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918da17c-0497-402f-a251-de9e4df0aecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.135909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918da17c-0497-402f-a251-de9e4df0aecd None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.136200 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918da17c-0497-402f-a251-de9e4df0aecd None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.136481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918da17c-0497-402f-a251-de9e4df0aecd None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.137192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918da17c-0497-402f-a251-de9e4df0aecd None admin] RBAC: Adding query filter params (name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:11.137499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918da17c-0497-402f-a251-de9e4df0aecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.139106 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918da17c-0497-402f-a251-de9e4df0aecd None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.150038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 335/668] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:11.151358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918da17c-0497-402f-a251-de9e4df0aecd None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.215267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16d5a-5536-4c92-a6f2-205a79a11012 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.256347 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:11.263821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc250147-6cfd-4e61-8059-28a1b2dbeda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.264499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc250147-6cfd-4e61-8059-28a1b2dbeda7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.264776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc250147-6cfd-4e61-8059-28a1b2dbeda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.265166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc250147-6cfd-4e61-8059-28a1b2dbeda7 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.265860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc250147-6cfd-4e61-8059-28a1b2dbeda7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:11.266475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc250147-6cfd-4e61-8059-28a1b2dbeda7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.267494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc250147-6cfd-4e61-8059-28a1b2dbeda7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.280701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 334/669] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:11.281378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc250147-6cfd-4e61-8059-28a1b2dbeda7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.287710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:11.298772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918da17c-0497-402f-a251-de9e4df0aecd None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.336172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb19b9-9ef4-41d6-8766-51dfe30b2656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.336838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb19b9-9ef4-41d6-8766-51dfe30b2656 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.337501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb19b9-9ef4-41d6-8766-51dfe30b2656 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.338003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb19b9-9ef4-41d6-8766-51dfe30b2656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.403776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc250147-6cfd-4e61-8059-28a1b2dbeda7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.416804 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb19b9-9ef4-41d6-8766-51dfe30b2656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.418292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb19b9-9ef4-41d6-8766-51dfe30b2656 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.443207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201292d-4ea5-4b61-9306-705e5704e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.443814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201292d-4ea5-4b61-9306-705e5704e676 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.444089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201292d-4ea5-4b61-9306-705e5704e676 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.444357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201292d-4ea5-4b61-9306-705e5704e676 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.444994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201292d-4ea5-4b61-9306-705e5704e676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:11.445300 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201292d-4ea5-4b61-9306-705e5704e676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.446805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201292d-4ea5-4b61-9306-705e5704e676 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.458425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 335/670] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:11.459306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201292d-4ea5-4b61-9306-705e5704e676 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.531101 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:11.532672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:11.540985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 336/671] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:11.543682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb19b9-9ef4-41d6-8766-51dfe30b2656 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.587803 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201292d-4ea5-4b61-9306-705e5704e676 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.626653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff11d48-1219-43a9-83af-ae678bb48de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.627283 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff11d48-1219-43a9-83af-ae678bb48de3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.627559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff11d48-1219-43a9-83af-ae678bb48de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.627822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff11d48-1219-43a9-83af-ae678bb48de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.649363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff11d48-1219-43a9-83af-ae678bb48de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.652696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff11d48-1219-43a9-83af-ae678bb48de3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.663466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb19b9-9ef4-41d6-8766-51dfe30b2656 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-4ff11d48-1219-43a9-83af-ae678bb48de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:11.682003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:11.683221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:11.684349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:11.684349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:11.684349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:11.684629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 336/672] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:11.686324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff11d48-1219-43a9-83af-ae678bb48de3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.715178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8724c14-56de-44b7-a8ea-9b06b10e034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.715995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8724c14-56de-44b7-a8ea-9b06b10e034b None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.716152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8724c14-56de-44b7-a8ea-9b06b10e034b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.716292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8724c14-56de-44b7-a8ea-9b06b10e034b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.717075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8724c14-56de-44b7-a8ea-9b06b10e034b None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=e128651197d840bd87220d8f5b246688) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:11.717384 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8724c14-56de-44b7-a8ea-9b06b10e034b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.718989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8724c14-56de-44b7-a8ea-9b06b10e034b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.727441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 337/673] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/role_assignments?user.id=e128651197d840bd87220d8f5b246688&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:11.728380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8724c14-56de-44b7-a8ea-9b06b10e034b None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.839396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:11.872013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff11d48-1219-43a9-83af-ae678bb48de3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.876002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:11.896704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8724c14-56de-44b7-a8ea-9b06b10e034b None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.916167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23045cbe-715c-4e6a-a3cb-90fdea33409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.916713 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23045cbe-715c-4e6a-a3cb-90fdea33409e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.916982 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23045cbe-715c-4e6a-a3cb-90fdea33409e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.917254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23045cbe-715c-4e6a-a3cb-90fdea33409e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.925045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23045cbe-715c-4e6a-a3cb-90fdea33409e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.926562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23045cbe-715c-4e6a-a3cb-90fdea33409e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.939044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb51d5-194a-4e34-9a93-a5bec9b1cc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-23045cbe-715c-4e6a-a3cb-90fdea33409e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:11.940276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:11.941180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:11.942058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:11.942058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:11.942058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:11.942058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:11.942058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:11.942058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:11.942058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:11.942058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:11.942498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb51d5-194a-4e34-9a93-a5bec9b1cc02 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.942498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb51d5-194a-4e34-9a93-a5bec9b1cc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.942498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb51d5-194a-4e34-9a93-a5bec9b1cc02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.942703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 337/674] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:11.942703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23045cbe-715c-4e6a-a3cb-90fdea33409e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.954786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb51d5-194a-4e34-9a93-a5bec9b1cc02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.956330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb51d5-194a-4e34-9a93-a5bec9b1cc02 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-cefb51d5-194a-4e34-9a93-a5bec9b1cc02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:11.972457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:11.973553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:11.974515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:11.974515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:11.974515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:11.974515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 338/675] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:11.975195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb51d5-194a-4e34-9a93-a5bec9b1cc02 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.075368 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23045cbe-715c-4e6a-a3cb-90fdea33409e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.111201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb51d5-194a-4e34-9a93-a5bec9b1cc02 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.125225 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:12.130149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d3702-35a3-4e2e-a8ba-c2ea65138bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.131396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d3702-35a3-4e2e-a8ba-c2ea65138bbc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.132001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d3702-35a3-4e2e-a8ba-c2ea65138bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.132753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d3702-35a3-4e2e-a8ba-c2ea65138bbc None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.134512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d3702-35a3-4e2e-a8ba-c2ea65138bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:12.135186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d3702-35a3-4e2e-a8ba-c2ea65138bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.141960 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d3702-35a3-4e2e-a8ba-c2ea65138bbc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.156431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fa3df-288a-42a0-bd8a-f4a5b2eb62a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.157161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa3df-288a-42a0-bd8a-f4a5b2eb62a9 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.157526 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa3df-288a-42a0-bd8a-f4a5b2eb62a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.157938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa3df-288a-42a0-bd8a-f4a5b2eb62a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.159074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fa3df-288a-42a0-bd8a-f4a5b2eb62a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:12.159541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fa3df-288a-42a0-bd8a-f4a5b2eb62a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.161474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fa3df-288a-42a0-bd8a-f4a5b2eb62a9 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.161854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 338/676] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:12.163622 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d3702-35a3-4e2e-a8ba-c2ea65138bbc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.185223 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 339/677] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:12.186903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b65c0-0be6-4741-90d2-faf61cff6e3a None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.187527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b65c0-0be6-4741-90d2-faf61cff6e3a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.187851 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b65c0-0be6-4741-90d2-faf61cff6e3a None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.189509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 340/678] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:12.190117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b65c0-0be6-4741-90d2-faf61cff6e3a None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.219309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:12.335958 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d3702-35a3-4e2e-a8ba-c2ea65138bbc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.378119 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b65c0-0be6-4741-90d2-faf61cff6e3a None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.397547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4771a-38c0-4f92-8748-080db27953e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.398824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4771a-38c0-4f92-8748-080db27953e5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.398952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4771a-38c0-4f92-8748-080db27953e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.399906 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4771a-38c0-4f92-8748-080db27953e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.401032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4771a-38c0-4f92-8748-080db27953e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:12.401501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4771a-38c0-4f92-8748-080db27953e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.403033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4771a-38c0-4f92-8748-080db27953e5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.419629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 339/679] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:12.421153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4771a-38c0-4f92-8748-080db27953e5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.437590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1105f-9a79-44c8-830e-6ba5c2db7eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.438270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1105f-9a79-44c8-830e-6ba5c2db7eca None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.438558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1105f-9a79-44c8-830e-6ba5c2db7eca None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.438832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1105f-9a79-44c8-830e-6ba5c2db7eca None admin] PATH_INFO: `/v3/users/swift` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.447101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1105f-9a79-44c8-830e-6ba5c2db7eca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.448552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1105f-9a79-44c8-830e-6ba5c2db7eca None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-6bf1105f-9a79-44c8-830e-6ba5c2db7eca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:12.461057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:12.462720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:12.463688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:12.463688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:12.463688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:12.463688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:12.463688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:12.463688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:12.463688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:12.463688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:12.463688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:12.463688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:12.463688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 341/680] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:12.464298 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15565433-ef9a-479e-a703-9e24cbd5cfb4 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.464298 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15565433-ef9a-479e-a703-9e24cbd5cfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.465854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15565433-ef9a-479e-a703-9e24cbd5cfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.484150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-15565433-ef9a-479e-a703-9e24cbd5cfb4 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:12.485318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-15565433-ef9a-479e-a703-9e24cbd5cfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:12.517705 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:12.526858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:12.547690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4771a-38c0-4f92-8748-080db27953e5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.571959 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 342/681] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:12.574140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15565433-ef9a-479e-a703-9e24cbd5cfb4 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.585752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5b703-ec13-4601-bb9f-aeb1cccbcdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.586541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5b703-ec13-4601-bb9f-aeb1cccbcdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.587515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5b703-ec13-4601-bb9f-aeb1cccbcdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.588097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5b703-ec13-4601-bb9f-aeb1cccbcdd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.589053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5b703-ec13-4601-bb9f-aeb1cccbcdd1 None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=30946d3b3f0f4a81b2ae5aa6e84f3920) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:12.589457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5b703-ec13-4601-bb9f-aeb1cccbcdd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.592001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5b703-ec13-4601-bb9f-aeb1cccbcdd1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.614840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 340/682] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/role_assignments?user.id=30946d3b3f0f4a81b2ae5aa6e84f3920&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:12.616617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5b703-ec13-4601-bb9f-aeb1cccbcdd1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.764374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15565433-ef9a-479e-a703-9e24cbd5cfb4 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.847029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5b703-ec13-4601-bb9f-aeb1cccbcdd1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.857205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8759668-1dad-41ae-970c-761d8ee8f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.858400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8759668-1dad-41ae-970c-761d8ee8f91c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.859321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8759668-1dad-41ae-970c-761d8ee8f91c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.859626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8759668-1dad-41ae-970c-761d8ee8f91c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.876299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8759668-1dad-41ae-970c-761d8ee8f91c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.880830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8759668-1dad-41ae-970c-761d8ee8f91c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.892035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba157b0e-62c9-421e-b364-c121a4acdda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.893009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157b0e-62c9-421e-b364-c121a4acdda0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.893441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157b0e-62c9-421e-b364-c121a4acdda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.893855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157b0e-62c9-421e-b364-c121a4acdda0 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.894833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba157b0e-62c9-421e-b364-c121a4acdda0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:12.895288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba157b0e-62c9-421e-b364-c121a4acdda0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.897509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba157b0e-62c9-421e-b364-c121a4acdda0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-b8759668-1dad-41ae-970c-761d8ee8f91c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:12.906064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:12.907764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:12.908690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:12.908690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:12.908690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:12.908690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:12.908690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:12.908690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:12.908690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:12.908690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:12.915116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 343/683] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:12.916420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8759668-1dad-41ae-970c-761d8ee8f91c None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.926869 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 341/684] 10.222.0.81 () {56 vars in 1135 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:12.928873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba157b0e-62c9-421e-b364-c121a4acdda0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.941892 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:12.960646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:13.063106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba157b0e-62c9-421e-b364-c121a4acdda0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.070160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8759668-1dad-41ae-970c-761d8ee8f91c None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.111368 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736fe4b-885a-4519-88df-893a05fc65f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.112105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736fe4b-885a-4519-88df-893a05fc65f8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.112387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736fe4b-885a-4519-88df-893a05fc65f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.112661 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736fe4b-885a-4519-88df-893a05fc65f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.113054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc581e-48d9-4a54-8743-615d6d7b0025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.113378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736fe4b-885a-4519-88df-893a05fc65f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:13.113732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736fe4b-885a-4519-88df-893a05fc65f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.114166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc581e-48d9-4a54-8743-615d6d7b0025 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.114603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc581e-48d9-4a54-8743-615d6d7b0025 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.115025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc581e-48d9-4a54-8743-615d6d7b0025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.115210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736fe4b-885a-4519-88df-893a05fc65f8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:13.130068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 342/685] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:13.131115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc581e-48d9-4a54-8743-615d6d7b0025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.132785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc581e-48d9-4a54-8743-615d6d7b0025 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:13.134501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736fe4b-885a-4519-88df-893a05fc65f8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-92dc581e-48d9-4a54-8743-615d6d7b0025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:13.162874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:13.164010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:13.164930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:13.164930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:13.164930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:13.167287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 344/686] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:13.173187 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc581e-48d9-4a54-8743-615d6d7b0025 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.280131 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:13.296103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:13.334852 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc581e-48d9-4a54-8743-615d6d7b0025 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.386444 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736fe4b-885a-4519-88df-893a05fc65f8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.407932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d9fd-1c77-489d-b81d-f6a21e161b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.413337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d9fd-1c77-489d-b81d-f6a21e161b6f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.413337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d9fd-1c77-489d-b81d-f6a21e161b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.413337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d9fd-1c77-489d-b81d-f6a21e161b6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.413337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d9fd-1c77-489d-b81d-f6a21e161b6f None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=241e34a86aba4c3a92ed9d469e6a205e) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:13.413337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d9fd-1c77-489d-b81d-f6a21e161b6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.413337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d9fd-1c77-489d-b81d-f6a21e161b6f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:13.430487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 345/687] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/role_assignments?user.id=241e34a86aba4c3a92ed9d469e6a205e&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:13.432993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d9fd-1c77-489d-b81d-f6a21e161b6f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.481418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e701f52-e003-417d-871c-7c67079f6100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.482489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e701f52-e003-417d-871c-7c67079f6100 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.482986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e701f52-e003-417d-871c-7c67079f6100 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.483927 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e701f52-e003-417d-871c-7c67079f6100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.643961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e701f52-e003-417d-871c-7c67079f6100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.645425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e701f52-e003-417d-871c-7c67079f6100 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:13.676316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d9fd-1c77-489d-b81d-f6a21e161b6f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.720845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad15adb-c258-4945-a1e1-0331d5e8bce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.721863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad15adb-c258-4945-a1e1-0331d5e8bce3 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.722413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad15adb-c258-4945-a1e1-0331d5e8bce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.722900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad15adb-c258-4945-a1e1-0331d5e8bce3 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.723810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad15adb-c258-4945-a1e1-0331d5e8bce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:13.724331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad15adb-c258-4945-a1e1-0331d5e8bce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.726015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad15adb-c258-4945-a1e1-0331d5e8bce3 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:13.733758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:13.741626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 346/688] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:13.746319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:13.748848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad15adb-c258-4945-a1e1-0331d5e8bce3 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.787238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 343/689] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:13.798607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e701f52-e003-417d-871c-7c67079f6100 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.897872 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad15adb-c258-4945-a1e1-0331d5e8bce3 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.958963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e701f52-e003-417d-871c-7c67079f6100 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.965213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebf0ae-d348-4b42-8a4f-1771859b7b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.965943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebf0ae-d348-4b42-8a4f-1771859b7b92 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.966330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebf0ae-d348-4b42-8a4f-1771859b7b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.966692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebf0ae-d348-4b42-8a4f-1771859b7b92 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.967420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebf0ae-d348-4b42-8a4f-1771859b7b92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.970095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebf0ae-d348-4b42-8a4f-1771859b7b92 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.010084 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7c233-eebc-4d1d-a606-f307d7f60843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.010758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7c233-eebc-4d1d-a606-f307d7f60843 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.011032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7c233-eebc-4d1d-a606-f307d7f60843 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.011303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7c233-eebc-4d1d-a606-f307d7f60843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.023932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7c233-eebc-4d1d-a606-f307d7f60843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.027085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7c233-eebc-4d1d-a606-f307d7f60843 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-29f7c233-eebc-4d1d-a606-f307d7f60843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:14.057041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:14.059177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:14.060161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:14.060161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:14.060161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:14.060161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 344/690] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:14.065662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c8dcf-81d2-4313-b39a-39e96168b022 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.065662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c8dcf-81d2-4313-b39a-39e96168b022 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.065662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c8dcf-81d2-4313-b39a-39e96168b022 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.066544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 345/691] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:14.067725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c8dcf-81d2-4313-b39a-39e96168b022 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.091947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:14.142274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 347/692] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:08:13 2022] POST /identity/v3/users => generated 254 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:08:14.142274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4aaec-6fa3-4916-b6cb-bb84ebe573ab None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.142274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4aaec-6fa3-4916-b6cb-bb84ebe573ab None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.142274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4aaec-6fa3-4916-b6cb-bb84ebe573ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.179944 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-23b4aaec-6fa3-4916-b6cb-bb84ebe573ab None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:14.181218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-23b4aaec-6fa3-4916-b6cb-bb84ebe573ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:14.263856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c8dcf-81d2-4313-b39a-39e96168b022 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.280566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:14.310417 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 348/693] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:14.344592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9579af-773b-4fea-baf8-9f4701aa0a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.345549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9579af-773b-4fea-baf8-9f4701aa0a23 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.346060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9579af-773b-4fea-baf8-9f4701aa0a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.346566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9579af-773b-4fea-baf8-9f4701aa0a23 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.347379 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9579af-773b-4fea-baf8-9f4701aa0a23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:14.347923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9579af-773b-4fea-baf8-9f4701aa0a23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.349537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9579af-773b-4fea-baf8-9f4701aa0a23 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.367714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 346/694] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:14.374434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4aaec-6fa3-4916-b6cb-bb84ebe573ab None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.500660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4aaec-6fa3-4916-b6cb-bb84ebe573ab None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.553763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163a5e3-a597-4a28-aaaf-7d66260b26f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.555296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163a5e3-a597-4a28-aaaf-7d66260b26f6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.556949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163a5e3-a597-4a28-aaaf-7d66260b26f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.558151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163a5e3-a597-4a28-aaaf-7d66260b26f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.572540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163a5e3-a597-4a28-aaaf-7d66260b26f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.575834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163a5e3-a597-4a28-aaaf-7d66260b26f6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-5163a5e3-a597-4a28-aaaf-7d66260b26f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:14.600354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:14.602160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:14.604122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:14.604122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:14.604122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:14.604122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:14.604122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:14.604122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:14.604122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:14.604122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:14.607953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 349/695] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:14.617855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9579af-773b-4fea-baf8-9f4701aa0a23 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.644383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163a5e3-a597-4a28-aaaf-7d66260b26f6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.711068 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:14.728052 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:14.754546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9579af-773b-4fea-baf8-9f4701aa0a23 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.797973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841baf68-4df7-4a7c-a79d-11ee4dfa1e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.798643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841baf68-4df7-4a7c-a79d-11ee4dfa1e9a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.798918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841baf68-4df7-4a7c-a79d-11ee4dfa1e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.799189 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841baf68-4df7-4a7c-a79d-11ee4dfa1e9a None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.799899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841baf68-4df7-4a7c-a79d-11ee4dfa1e9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:14.800202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841baf68-4df7-4a7c-a79d-11ee4dfa1e9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.801754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841baf68-4df7-4a7c-a79d-11ee4dfa1e9a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.814436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163a5e3-a597-4a28-aaaf-7d66260b26f6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.817042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 347/696] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:14.827487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841baf68-4df7-4a7c-a79d-11ee4dfa1e9a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.910937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04e495-323c-4732-bf00-a0279236381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.911999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04e495-323c-4732-bf00-a0279236381a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.912474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04e495-323c-4732-bf00-a0279236381a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.912950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04e495-323c-4732-bf00-a0279236381a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.914042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04e495-323c-4732-bf00-a0279236381a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.917212 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04e495-323c-4732-bf00-a0279236381a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-8e04e495-323c-4732-bf00-a0279236381a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:14.929726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:14.931470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:14.932366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 350/697] 10.222.0.81 () {56 vars in 1129 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:14.946016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04e495-323c-4732-bf00-a0279236381a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:15.041187 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841baf68-4df7-4a7c-a79d-11ee4dfa1e9a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:15.114555 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596f3ab-c955-433f-9116-23ae5c44ca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:15.115609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596f3ab-c955-433f-9116-23ae5c44ca50 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.116339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596f3ab-c955-433f-9116-23ae5c44ca50 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.117669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596f3ab-c955-433f-9116-23ae5c44ca50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.120169 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596f3ab-c955-433f-9116-23ae5c44ca50 None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=829ac711e3d84e018404cf6dabeb3845) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:15.120655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596f3ab-c955-433f-9116-23ae5c44ca50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:15.122319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596f3ab-c955-433f-9116-23ae5c44ca50 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:15.131276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 348/698] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/role_assignments?user.id=829ac711e3d84e018404cf6dabeb3845&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:15.177654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04e495-323c-4732-bf00-a0279236381a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:15.189379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:15.257050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac436-bdbf-4a09-8f23-f46bfebc6fb4 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.257050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac436-bdbf-4a09-8f23-f46bfebc6fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.257050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac436-bdbf-4a09-8f23-f46bfebc6fb4 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.260486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 349/699] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:15.270254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bb0cd-d4f6-46dc-84b4-d4eeba563546 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.270254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bb0cd-d4f6-46dc-84b4-d4eeba563546 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.270254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bb0cd-d4f6-46dc-84b4-d4eeba563546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.275511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:15.293275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f22bb0cd-d4f6-46dc-84b4-d4eeba563546 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:15.296655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f22bb0cd-d4f6-46dc-84b4-d4eeba563546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:15.308304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb19d-4226-4c20-b10c-f6971ac798c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:15.308304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb19d-4226-4c20-b10c-f6971ac798c8 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.308304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb19d-4226-4c20-b10c-f6971ac798c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.308304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb19d-4226-4c20-b10c-f6971ac798c8 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.308986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb19d-4226-4c20-b10c-f6971ac798c8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:15.308986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb19d-4226-4c20-b10c-f6971ac798c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:15.312642 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb19d-4226-4c20-b10c-f6971ac798c8 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:15.326815 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 351/700] 10.222.0.81 () {56 vars in 1124 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:15.328516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb19d-4226-4c20-b10c-f6971ac798c8 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:15.439165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 350/701] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:15.514479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb19d-4226-4c20-b10c-f6971ac798c8 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:15.557087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23287f60-0e66-4465-b92b-960a6a3193cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:15.558037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23287f60-0e66-4465-b92b-960a6a3193cc None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.558346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23287f60-0e66-4465-b92b-960a6a3193cc None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.558618 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23287f60-0e66-4465-b92b-960a6a3193cc None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.559309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23287f60-0e66-4465-b92b-960a6a3193cc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:15.559688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23287f60-0e66-4465-b92b-960a6a3193cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:15.561111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23287f60-0e66-4465-b92b-960a6a3193cc None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:15.570795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 352/702] 10.222.0.81 () {56 vars in 1124 bytes} [Mon Aug 29 20:08:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:15.869745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bb0cd-d4f6-46dc-84b4-d4eeba563546 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.012206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bb0cd-d4f6-46dc-84b4-d4eeba563546 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:16.047266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:16.052775 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa189b-1683-4f9f-97df-23e2d3febf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:16.053564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa189b-1683-4f9f-97df-23e2d3febf00 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.053902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa189b-1683-4f9f-97df-23e2d3febf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.054176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa189b-1683-4f9f-97df-23e2d3febf00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.067211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa189b-1683-4f9f-97df-23e2d3febf00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-e4aa189b-1683-4f9f-97df-23e2d3febf00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:16.073504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:16.075392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:16.077082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 351/703] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:16.088669 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23287f60-0e66-4465-b92b-960a6a3193cc None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.146093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:16.188453 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d1119-6b68-4de3-a355-eb104dfad08f None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.188902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d1119-6b68-4de3-a355-eb104dfad08f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.189370 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d1119-6b68-4de3-a355-eb104dfad08f None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.193480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 352/704] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:16.204064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ade51-ddbf-4e80-9994-75ff9d5d1219 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.204501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ade51-ddbf-4e80-9994-75ff9d5d1219 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.204961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ade51-ddbf-4e80-9994-75ff9d5d1219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.261888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-df8ade51-ddbf-4e80-9994-75ff9d5d1219 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:16.263913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-df8ade51-ddbf-4e80-9994-75ff9d5d1219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:16.299530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23287f60-0e66-4465-b92b-960a6a3193cc None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:16.366701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7649a5f-4ee4-439f-aef7-520f9c62e58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:16.368017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7649a5f-4ee4-439f-aef7-520f9c62e58f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.368634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7649a5f-4ee4-439f-aef7-520f9c62e58f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.369103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7649a5f-4ee4-439f-aef7-520f9c62e58f None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.370368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7649a5f-4ee4-439f-aef7-520f9c62e58f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:16.370905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7649a5f-4ee4-439f-aef7-520f9c62e58f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:16.374303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7649a5f-4ee4-439f-aef7-520f9c62e58f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:16.391308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 353/705] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:16.401359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7649a5f-4ee4-439f-aef7-520f9c62e58f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.414172 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 353/706] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:16.656143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:16.664052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7649a5f-4ee4-439f-aef7-520f9c62e58f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:16.738563 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022136d0-ab61-4bc1-9402-fb20da6b646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:16.739673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022136d0-ab61-4bc1-9402-fb20da6b646e None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.740420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022136d0-ab61-4bc1-9402-fb20da6b646e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.740913 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022136d0-ab61-4bc1-9402-fb20da6b646e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.770389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022136d0-ab61-4bc1-9402-fb20da6b646e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:16.773558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022136d0-ab61-4bc1-9402-fb20da6b646e None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-022136d0-ab61-4bc1-9402-fb20da6b646e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:16.807709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:16.808763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:16.809709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:16.809709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:16.809709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:16.809893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 354/707] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:16.819276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ade51-ddbf-4e80-9994-75ff9d5d1219 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.933274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022136d0-ab61-4bc1-9402-fb20da6b646e None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.992060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ade51-ddbf-4e80-9994-75ff9d5d1219 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.023074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:17.044519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa396-48ea-40d5-809f-c22d7a130a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.045341 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa396-48ea-40d5-809f-c22d7a130a9b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.045719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa396-48ea-40d5-809f-c22d7a130a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.046361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa396-48ea-40d5-809f-c22d7a130a9b None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.047994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa396-48ea-40d5-809f-c22d7a130a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:17.048382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa396-48ea-40d5-809f-c22d7a130a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.050252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa396-48ea-40d5-809f-c22d7a130a9b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.070385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 354/708] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:17.072735 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350186f2-8296-4268-b172-1ed60556ce51 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.073084 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350186f2-8296-4268-b172-1ed60556ce51 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.073366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350186f2-8296-4268-b172-1ed60556ce51 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.079349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 355/709] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:17.080495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350186f2-8296-4268-b172-1ed60556ce51 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.091790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022136d0-ab61-4bc1-9402-fb20da6b646e None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.135755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd60fc2-b668-4d0a-a421-d34071e20014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.136459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd60fc2-b668-4d0a-a421-d34071e20014 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.136741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd60fc2-b668-4d0a-a421-d34071e20014 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.137010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd60fc2-b668-4d0a-a421-d34071e20014 None admin] PATH_INFO: `/v3/services/network` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.137612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd60fc2-b668-4d0a-a421-d34071e20014 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.139070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd60fc2-b668-4d0a-a421-d34071e20014 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-fcd60fc2-b668-4d0a-a421-d34071e20014 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:17.150261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:17.152739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:17.154845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 355/710] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:16 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:17.156789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb39b6f-ba6e-49ac-b770-8ee0d1bf880b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.156789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb39b6f-ba6e-49ac-b770-8ee0d1bf880b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.156789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb39b6f-ba6e-49ac-b770-8ee0d1bf880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.176110 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-eeb39b6f-ba6e-49ac-b770-8ee0d1bf880b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:17.177438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-eeb39b6f-ba6e-49ac-b770-8ee0d1bf880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:17.189256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:17.249501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350186f2-8296-4268-b172-1ed60556ce51 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.305919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 356/711] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:17.307819 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb39b6f-ba6e-49ac-b770-8ee0d1bf880b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.320512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b2c90-4943-47d1-90f2-29c0f5a73310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.321714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b2c90-4943-47d1-90f2-29c0f5a73310 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.322327 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b2c90-4943-47d1-90f2-29c0f5a73310 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.322822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b2c90-4943-47d1-90f2-29c0f5a73310 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.339468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b2c90-4943-47d1-90f2-29c0f5a73310 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.342577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b2c90-4943-47d1-90f2-29c0f5a73310 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-fb1b2c90-4943-47d1-90f2-29c0f5a73310 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:17.371456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:17.373628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:17.375964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:17.375964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:17.375964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:17.375964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:17.375964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:17.375964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:17.375964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:17.375964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:17.375964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:17.375964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:17.383214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 356/712] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:17.391154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b2c90-4943-47d1-90f2-29c0f5a73310 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.503673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:17.589673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb39b6f-ba6e-49ac-b770-8ee0d1bf880b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.613357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b2c90-4943-47d1-90f2-29c0f5a73310 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.635335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ac60f-278c-4692-9fe5-2cd6c8740973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.635977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ac60f-278c-4692-9fe5-2cd6c8740973 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.636253 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ac60f-278c-4692-9fe5-2cd6c8740973 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.636519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ac60f-278c-4692-9fe5-2cd6c8740973 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.637170 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ac60f-278c-4692-9fe5-2cd6c8740973 None admin] RBAC: Adding query filter params (name=network) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:17.637472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ac60f-278c-4692-9fe5-2cd6c8740973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.639052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ac60f-278c-4692-9fe5-2cd6c8740973 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.644888 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 357/713] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:17.645971 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ac60f-278c-4692-9fe5-2cd6c8740973 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.657393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:17.688531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff2e61-f5e2-4ca9-89e6-1aba827e2e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.689593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff2e61-f5e2-4ca9-89e6-1aba827e2e75 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.690104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff2e61-f5e2-4ca9-89e6-1aba827e2e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.690639 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff2e61-f5e2-4ca9-89e6-1aba827e2e75 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.692032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff2e61-f5e2-4ca9-89e6-1aba827e2e75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:17.692587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff2e61-f5e2-4ca9-89e6-1aba827e2e75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.695655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff2e61-f5e2-4ca9-89e6-1aba827e2e75 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.742629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 357/714] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:17.744272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff2e61-f5e2-4ca9-89e6-1aba827e2e75 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.769175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ac60f-278c-4692-9fe5-2cd6c8740973 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.811746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d0e5b-7558-47eb-aab9-546eba77a9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.812432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d0e5b-7558-47eb-aab9-546eba77a9cf None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.812710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d0e5b-7558-47eb-aab9-546eba77a9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.812976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d0e5b-7558-47eb-aab9-546eba77a9cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.826200 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d0e5b-7558-47eb-aab9-546eba77a9cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-d18d0e5b-7558-47eb-aab9-546eba77a9cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:17.831760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:17.833984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:17.836116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:17.836116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:17.836116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:17.836116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:17.836116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:17.836116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:17.836116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:17.836116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:17.836116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:17.836116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:17.836116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:17.836116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:17.844674 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 358/715] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:17.844674 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d0e5b-7558-47eb-aab9-546eba77a9cf None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.914447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:17.920578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:17.922900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff2e61-f5e2-4ca9-89e6-1aba827e2e75 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.963314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d0e5b-7558-47eb-aab9-546eba77a9cf None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.970050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb2993-84d6-46db-a7ec-5f3a026053e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.970751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb2993-84d6-46db-a7ec-5f3a026053e6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.971617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb2993-84d6-46db-a7ec-5f3a026053e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.971617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb2993-84d6-46db-a7ec-5f3a026053e6 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.971918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb2993-84d6-46db-a7ec-5f3a026053e6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:17.972221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb2993-84d6-46db-a7ec-5f3a026053e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.974056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb2993-84d6-46db-a7ec-5f3a026053e6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.980547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 358/716] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:17.981437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb2993-84d6-46db-a7ec-5f3a026053e6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:18.026400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d8d30-d483-4bd1-835a-ef0ebd6cee34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:18.027380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d8d30-d483-4bd1-835a-ef0ebd6cee34 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.027841 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d8d30-d483-4bd1-835a-ef0ebd6cee34 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.028313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d8d30-d483-4bd1-835a-ef0ebd6cee34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.142166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d8d30-d483-4bd1-835a-ef0ebd6cee34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.144515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d8d30-d483-4bd1-835a-ef0ebd6cee34 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.145692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb2993-84d6-46db-a7ec-5f3a026053e6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:18.229413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:18.238520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07ef90-8422-40e9-bba3-1054abe3eb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:18.239279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07ef90-8422-40e9-bba3-1054abe3eb36 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.239636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07ef90-8422-40e9-bba3-1054abe3eb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.239983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07ef90-8422-40e9-bba3-1054abe3eb36 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.240805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07ef90-8422-40e9-bba3-1054abe3eb36 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:18.241177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07ef90-8422-40e9-bba3-1054abe3eb36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.242731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07ef90-8422-40e9-bba3-1054abe3eb36 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.262146 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 359/717] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:18.264241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07ef90-8422-40e9-bba3-1054abe3eb36 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:18.284237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 359/718] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:18.289489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d8d30-d483-4bd1-835a-ef0ebd6cee34 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:18.319180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:18.431091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07ef90-8422-40e9-bba3-1054abe3eb36 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:18.441316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d8d30-d483-4bd1-835a-ef0ebd6cee34 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:18.472256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5382f-940a-42e7-8d70-4d6264640e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:18.472898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5382f-940a-42e7-8d70-4d6264640e70 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.473217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5382f-940a-42e7-8d70-4d6264640e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.473506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5382f-940a-42e7-8d70-4d6264640e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.486727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5382f-940a-42e7-8d70-4d6264640e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.488135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5382f-940a-42e7-8d70-4d6264640e70 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.489192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf79cfc-993c-45ef-81da-9a4b4b47f97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:18.489835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf79cfc-993c-45ef-81da-9a4b4b47f97b None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.490109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf79cfc-993c-45ef-81da-9a4b4b47f97b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.490598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf79cfc-993c-45ef-81da-9a4b4b47f97b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-9da5382f-940a-42e7-8d70-4d6264640e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:18.504539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:18.505589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:18.506511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:18.506511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:18.506511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:18.506698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf79cfc-993c-45ef-81da-9a4b4b47f97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.508155 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf79cfc-993c-45ef-81da-9a4b4b47f97b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.511446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 360/719] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:18.512796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314b075-df98-41b5-9f1b-ba08f2d16a42 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.513078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314b075-df98-41b5-9f1b-ba08f2d16a42 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.513351 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314b075-df98-41b5-9f1b-ba08f2d16a42 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.519132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 361/720] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:18.519132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91f4ad-e9be-41a1-91ef-5539bd61ed84 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.519132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91f4ad-e9be-41a1-91ef-5539bd61ed84 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.519132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91f4ad-e9be-41a1-91ef-5539bd61ed84 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.519521 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 362/721] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:18.520186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91f4ad-e9be-41a1-91ef-5539bd61ed84 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-9cf79cfc-993c-45ef-81da-9a4b4b47f97b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:18.535374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:18.536341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:18.537240 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:18.537240 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:18.537240 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:18.545023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 360/722] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:18.545023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624ed3f-ccd2-4bba-86eb-90b013b1799f None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.545023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624ed3f-ccd2-4bba-86eb-90b013b1799f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.545023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624ed3f-ccd2-4bba-86eb-90b013b1799f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.577448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-9624ed3f-ccd2-4bba-86eb-90b013b1799f None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:18.579710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9624ed3f-ccd2-4bba-86eb-90b013b1799f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:18.609719 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:18.630257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:18.673232 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91f4ad-e9be-41a1-91ef-5539bd61ed84 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:18.708645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 361/723] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:18.711198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179b3d7-bec0-4780-9ade-d9772878d438 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.712484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179b3d7-bec0-4780-9ade-d9772878d438 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.713758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179b3d7-bec0-4780-9ade-d9772878d438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.742732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d621df5-8b7e-41f8-8884-3e1687028d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:18.744823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d621df5-8b7e-41f8-8884-3e1687028d07 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.745373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d621df5-8b7e-41f8-8884-3e1687028d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.745593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a179b3d7-bec0-4780-9ade-d9772878d438 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:18.746044 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d621df5-8b7e-41f8-8884-3e1687028d07 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.747117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d621df5-8b7e-41f8-8884-3e1687028d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:18.747733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d621df5-8b7e-41f8-8884-3e1687028d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.748241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a179b3d7-bec0-4780-9ade-d9772878d438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:18.749655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d621df5-8b7e-41f8-8884-3e1687028d07 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.782849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 363/724] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:18.784579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d621df5-8b7e-41f8-8884-3e1687028d07 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:18.846039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 362/725] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:18.847554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179b3d7-bec0-4780-9ade-d9772878d438 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:18.968714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d621df5-8b7e-41f8-8884-3e1687028d07 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:19.017527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4b7eb-3298-4acd-8327-52d8f80c891e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:19.018548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4b7eb-3298-4acd-8327-52d8f80c891e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:19.020695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4b7eb-3298-4acd-8327-52d8f80c891e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:19.021200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4b7eb-3298-4acd-8327-52d8f80c891e None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:19.022075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4b7eb-3298-4acd-8327-52d8f80c891e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:19.024647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4b7eb-3298-4acd-8327-52d8f80c891e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:19.028456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4b7eb-3298-4acd-8327-52d8f80c891e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:19.046658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:19.052695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:19.064434 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 364/726] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:19.065436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4b7eb-3298-4acd-8327-52d8f80c891e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:19.110766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179b3d7-bec0-4780-9ade-d9772878d438 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:19.186267 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56a59e-a773-427b-8b45-6f98d09a5097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:19.187048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56a59e-a773-427b-8b45-6f98d09a5097 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:19.187301 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56a59e-a773-427b-8b45-6f98d09a5097 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:19.187467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56a59e-a773-427b-8b45-6f98d09a5097 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:19.198675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56a59e-a773-427b-8b45-6f98d09a5097 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:19.200190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56a59e-a773-427b-8b45-6f98d09a5097 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-bc56a59e-a773-427b-8b45-6f98d09a5097 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:19.214795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:19.215788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:19.216728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:19.216728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:19.216728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:19.216728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:19.216728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:19.216728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:19.216728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:19.216728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:19.216728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:19.216728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:19.216728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 363/727] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Aug 29 20:08:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:19.217325 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56a59e-a773-427b-8b45-6f98d09a5097 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:19.237265 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4b7eb-3298-4acd-8327-52d8f80c891e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:19.289283 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2f16f-dafe-4022-ad93-ca8ed6720624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:19.290506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2f16f-dafe-4022-ad93-ca8ed6720624 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:19.290782 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2f16f-dafe-4022-ad93-ca8ed6720624 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:19.291050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2f16f-dafe-4022-ad93-ca8ed6720624 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:19.299975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2f16f-dafe-4022-ad93-ca8ed6720624 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:19.301758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2f16f-dafe-4022-ad93-ca8ed6720624 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-c0a2f16f-dafe-4022-ad93-ca8ed6720624 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:19.318097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:19.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:19.320011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:19.320011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:19.320011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:19.320011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:19.320011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:19.320011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:19.320011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:19.320011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:19.320011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 365/728] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:19.320800 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2f16f-dafe-4022-ad93-ca8ed6720624 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:19.393794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56a59e-a773-427b-8b45-6f98d09a5097 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:19.424880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:19.439914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89756a4f-fb5d-490f-b89c-7a5eebd0e118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:19.442054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89756a4f-fb5d-490f-b89c-7a5eebd0e118 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:19.442054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89756a4f-fb5d-490f-b89c-7a5eebd0e118 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:19.442054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89756a4f-fb5d-490f-b89c-7a5eebd0e118 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:19.442054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89756a4f-fb5d-490f-b89c-7a5eebd0e118 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:19.443358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89756a4f-fb5d-490f-b89c-7a5eebd0e118 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:19.479767 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2f16f-dafe-4022-ad93-ca8ed6720624 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:19.527400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad3939-6ac9-4f3e-9d22-7e8fa5ed96b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:19.527950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad3939-6ac9-4f3e-9d22-7e8fa5ed96b1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:19.528230 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad3939-6ac9-4f3e-9d22-7e8fa5ed96b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:19.528498 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad3939-6ac9-4f3e-9d22-7e8fa5ed96b1 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:19.529245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad3939-6ac9-4f3e-9d22-7e8fa5ed96b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:19.529558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad3939-6ac9-4f3e-9d22-7e8fa5ed96b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:19.531078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad3939-6ac9-4f3e-9d22-7e8fa5ed96b1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:19.551316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 366/729] 10.222.0.81 () {56 vars in 1149 bytes} [Mon Aug 29 20:08:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:19.552184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad3939-6ac9-4f3e-9d22-7e8fa5ed96b1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:19.560400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:19.573173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 364/730] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:08:19 2022] POST /identity/v3/services => generated 251 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:19.574320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89756a4f-fb5d-490f-b89c-7a5eebd0e118 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:19.709610 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad3939-6ac9-4f3e-9d22-7e8fa5ed96b1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:19.732339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89756a4f-fb5d-490f-b89c-7a5eebd0e118 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:19.734202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:19.766617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cb824-598e-4412-9840-a9ffd8734a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:19.768167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cb824-598e-4412-9840-a9ffd8734a53 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:19.768167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cb824-598e-4412-9840-a9ffd8734a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:19.768375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cb824-598e-4412-9840-a9ffd8734a53 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:19.768969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cb824-598e-4412-9840-a9ffd8734a53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:19.769308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cb824-598e-4412-9840-a9ffd8734a53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:19.771401 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cb824-598e-4412-9840-a9ffd8734a53 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:19.787730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 367/731] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:19.788048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de28e8-cfed-490f-89c6-e984462e5b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:19.788603 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cb824-598e-4412-9840-a9ffd8734a53 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:19.788708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de28e8-cfed-490f-89c6-e984462e5b07 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:19.788979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de28e8-cfed-490f-89c6-e984462e5b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:19.789255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de28e8-cfed-490f-89c6-e984462e5b07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:19.810450 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de28e8-cfed-490f-89c6-e984462e5b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-a1de28e8-cfed-490f-89c6-e984462e5b07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:19.817154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:19.818141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:19.819943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 365/732] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:19.821847 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de28e8-cfed-490f-89c6-e984462e5b07 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:19.901332 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:19.960789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cb824-598e-4412-9840-a9ffd8734a53 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:19.969813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de28e8-cfed-490f-89c6-e984462e5b07 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:20.010337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507011b3-c18e-4cf0-bad2-aea70eb5dec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:20.011266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507011b3-c18e-4cf0-bad2-aea70eb5dec8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:20.011784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507011b3-c18e-4cf0-bad2-aea70eb5dec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:20.012272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507011b3-c18e-4cf0-bad2-aea70eb5dec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:20.034893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44368b-38cc-4782-9f41-9a540519b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:20.035521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44368b-38cc-4782-9f41-9a540519b7ba None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:20.035799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44368b-38cc-4782-9f41-9a540519b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:20.036689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44368b-38cc-4782-9f41-9a540519b7ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:20.037738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44368b-38cc-4782-9f41-9a540519b7ba None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=30946d3b3f0f4a81b2ae5aa6e84f3920) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:20.038262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44368b-38cc-4782-9f41-9a540519b7ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:20.040551 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44368b-38cc-4782-9f41-9a540519b7ba None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:20.051650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 366/733] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:19 2022] GET /identity/v3/role_assignments?user.id=30946d3b3f0f4a81b2ae5aa6e84f3920&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:20.052555 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44368b-38cc-4782-9f41-9a540519b7ba None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:20.091157 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:20.141087 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507011b3-c18e-4cf0-bad2-aea70eb5dec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:20.145235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507011b3-c18e-4cf0-bad2-aea70eb5dec8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:20.211401 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44368b-38cc-4782-9f41-9a540519b7ba None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:20.258184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:20.293394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bd4cc-a353-4d72-b5b0-acec5f2a0254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:20.294989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bd4cc-a353-4d72-b5b0-acec5f2a0254 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:20.295874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bd4cc-a353-4d72-b5b0-acec5f2a0254 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:20.297447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bd4cc-a353-4d72-b5b0-acec5f2a0254 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:20.300012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bd4cc-a353-4d72-b5b0-acec5f2a0254 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:20.301805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bd4cc-a353-4d72-b5b0-acec5f2a0254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:20.305077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bd4cc-a353-4d72-b5b0-acec5f2a0254 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:20.326017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 367/734] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:20.328881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b120d1-239b-4281-870d-79bd8190c510 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:20.329575 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b120d1-239b-4281-870d-79bd8190c510 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:20.330242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b120d1-239b-4281-870d-79bd8190c510 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:20.333587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 368/735] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:20.335166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b120d1-239b-4281-870d-79bd8190c510 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:20.359546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 368/736] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:19 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:20.361929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47a63d-9a6a-4a0c-b691-d65f05e5d27d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:20.362607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47a63d-9a6a-4a0c-b691-d65f05e5d27d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:20.363295 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47a63d-9a6a-4a0c-b691-d65f05e5d27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:20.394002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0c47a63d-9a6a-4a0c-b691-d65f05e5d27d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:20.395833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0c47a63d-9a6a-4a0c-b691-d65f05e5d27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:20.505077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 369/737] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:20.506029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47a63d-9a6a-4a0c-b691-d65f05e5d27d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:20.516797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:20.543681 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b120d1-239b-4281-870d-79bd8190c510 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:20.635173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a147a-7657-4792-977b-9ded8bc649cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:20.636281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a147a-7657-4792-977b-9ded8bc649cf None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:20.637969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a147a-7657-4792-977b-9ded8bc649cf None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:20.638553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a147a-7657-4792-977b-9ded8bc649cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:20.682027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a147a-7657-4792-977b-9ded8bc649cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:20.686650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a147a-7657-4792-977b-9ded8bc649cf None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-f40a147a-7657-4792-977b-9ded8bc649cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:20.729782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:20.731710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:20.733521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:20.733521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:20.733521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:20.738371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 369/738] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:20.740310 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a147a-7657-4792-977b-9ded8bc649cf None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:20.811097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47a63d-9a6a-4a0c-b691-d65f05e5d27d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:20.847282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:20.920030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fd0bf-f7e9-4bce-b193-f7b0d6623654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:20.920693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fd0bf-f7e9-4bce-b193-f7b0d6623654 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:20.920973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fd0bf-f7e9-4bce-b193-f7b0d6623654 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:20.921250 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fd0bf-f7e9-4bce-b193-f7b0d6623654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:20.943192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fd0bf-f7e9-4bce-b193-f7b0d6623654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:20.944689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fd0bf-f7e9-4bce-b193-f7b0d6623654 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-220fd0bf-f7e9-4bce-b193-f7b0d6623654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:20.966079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:20.968013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:20.969834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:20.969834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:20.969834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:20.972108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 370/739] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:20.973526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fd0bf-f7e9-4bce-b193-f7b0d6623654 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:21.018092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a147a-7657-4792-977b-9ded8bc649cf None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:21.093374 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:21.117069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505aa89-a2c6-4501-87d0-8cbd65134136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:21.118724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505aa89-a2c6-4501-87d0-8cbd65134136 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.119370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505aa89-a2c6-4501-87d0-8cbd65134136 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.119713 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505aa89-a2c6-4501-87d0-8cbd65134136 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.120883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505aa89-a2c6-4501-87d0-8cbd65134136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:21.121424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505aa89-a2c6-4501-87d0-8cbd65134136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:21.125237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505aa89-a2c6-4501-87d0-8cbd65134136 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:21.150402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 370/740] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:21.151716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505aa89-a2c6-4501-87d0-8cbd65134136 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:21.201760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fd0bf-f7e9-4bce-b193-f7b0d6623654 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:21.266049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ee99-5a5e-4ccc-9522-5b96fc310667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:21.266700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ee99-5a5e-4ccc-9522-5b96fc310667 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.267053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ee99-5a5e-4ccc-9522-5b96fc310667 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.267305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ee99-5a5e-4ccc-9522-5b96fc310667 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.267901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635ee99-5a5e-4ccc-9522-5b96fc310667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:21.268206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635ee99-5a5e-4ccc-9522-5b96fc310667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:21.269574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635ee99-5a5e-4ccc-9522-5b96fc310667 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:21.288631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 371/741] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:21.290311 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ee99-5a5e-4ccc-9522-5b96fc310667 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:21.341978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:21.374172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505aa89-a2c6-4501-87d0-8cbd65134136 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:21.451870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48fd21-d734-4694-9684-cdb394a39302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:21.452778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48fd21-d734-4694-9684-cdb394a39302 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.453201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48fd21-d734-4694-9684-cdb394a39302 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.453558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ee99-5a5e-4ccc-9522-5b96fc310667 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:21.454100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48fd21-d734-4694-9684-cdb394a39302 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.454946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48fd21-d734-4694-9684-cdb394a39302 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:21.456502 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48fd21-d734-4694-9684-cdb394a39302 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:21.480061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:21.499674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aabcbb-faba-4477-8030-c99bf22747be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:21.500383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aabcbb-faba-4477-8030-c99bf22747be None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.500668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aabcbb-faba-4477-8030-c99bf22747be None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.500944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aabcbb-faba-4477-8030-c99bf22747be None admin] PATH_INFO: `/v3/users/swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.509388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aabcbb-faba-4477-8030-c99bf22747be None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:21.510972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aabcbb-faba-4477-8030-c99bf22747be None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-95aabcbb-faba-4477-8030-c99bf22747be None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:21.526440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:21.527978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:21.529097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:21.529097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:21.529097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:21.529097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:21.529097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:21.529097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:21.529097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:21.529097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:21.529097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:21.529097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:21.532616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 372/742] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:21.533537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aabcbb-faba-4477-8030-c99bf22747be None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:21.558829 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 371/743] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:08:21 2022] POST /identity/v3/services => generated 240 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:21.560153 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48fd21-d734-4694-9684-cdb394a39302 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:21.713696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aabcbb-faba-4477-8030-c99bf22747be None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:21.771752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a08a1-afa0-4c97-babb-9fdeb91cbfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:21.772774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a08a1-afa0-4c97-babb-9fdeb91cbfaf None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.773519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a08a1-afa0-4c97-babb-9fdeb91cbfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.774565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a08a1-afa0-4c97-babb-9fdeb91cbfaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.787922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a08a1-afa0-4c97-babb-9fdeb91cbfaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:21.790411 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a08a1-afa0-4c97-babb-9fdeb91cbfaf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-f12a08a1-afa0-4c97-babb-9fdeb91cbfaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:21.802769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:21.803760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:21.804628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:21.804628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:21.804628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:21.804628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:21.804628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:21.804628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:21.804628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:21.804628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:21.805051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48fd21-d734-4694-9684-cdb394a39302 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:21.807981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 373/744] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:21.813903 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a08a1-afa0-4c97-babb-9fdeb91cbfaf None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:21.861166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:21.864235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004548d-822e-4bd9-86d5-e04b52496e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:21.865066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004548d-822e-4bd9-86d5-e04b52496e6d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.865416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004548d-822e-4bd9-86d5-e04b52496e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.865757 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004548d-822e-4bd9-86d5-e04b52496e6d None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.866628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004548d-822e-4bd9-86d5-e04b52496e6d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:21.867004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004548d-822e-4bd9-86d5-e04b52496e6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:21.870569 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004548d-822e-4bd9-86d5-e04b52496e6d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:21.902276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 372/745] 10.222.0.81 () {56 vars in 1135 bytes} [Mon Aug 29 20:08:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:21.905408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004548d-822e-4bd9-86d5-e04b52496e6d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:21.922775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:21.967646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a08a1-afa0-4c97-babb-9fdeb91cbfaf None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:22.015578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65224c6-41bf-4183-a582-bb4a4645e6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:22.016456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65224c6-41bf-4183-a582-bb4a4645e6ef None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.016749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65224c6-41bf-4183-a582-bb4a4645e6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.017018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65224c6-41bf-4183-a582-bb4a4645e6ef None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.017747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65224c6-41bf-4183-a582-bb4a4645e6ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:22.018046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65224c6-41bf-4183-a582-bb4a4645e6ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:22.020259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65224c6-41bf-4183-a582-bb4a4645e6ef None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:22.042131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 374/746] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:22.043707 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65224c6-41bf-4183-a582-bb4a4645e6ef None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:22.129851 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004548d-822e-4bd9-86d5-e04b52496e6d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:22.204682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:22.208266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991f83-e427-4c8f-b56b-7cbbb7f52abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:22.209818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991f83-e427-4c8f-b56b-7cbbb7f52abe None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.210790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991f83-e427-4c8f-b56b-7cbbb7f52abe None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.211861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991f83-e427-4c8f-b56b-7cbbb7f52abe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.212987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65224c6-41bf-4183-a582-bb4a4645e6ef None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:22.259023 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e70cc-ce6c-4e2f-9a86-6221cc2fb0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:22.259842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e70cc-ce6c-4e2f-9a86-6221cc2fb0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.260123 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e70cc-ce6c-4e2f-9a86-6221cc2fb0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.260385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e70cc-ce6c-4e2f-9a86-6221cc2fb0f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.261140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e70cc-ce6c-4e2f-9a86-6221cc2fb0f4 None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=2a96ca7980a54be5bee6aae4bb54b664) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:22.261448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e70cc-ce6c-4e2f-9a86-6221cc2fb0f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:22.263774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e70cc-ce6c-4e2f-9a86-6221cc2fb0f4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:22.274638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 375/747] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:22 2022] GET /identity/v3/role_assignments?user.id=2a96ca7980a54be5bee6aae4bb54b664&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:22.278465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38048d4-19bc-499b-bd90-adde698b5da3 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.284017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38048d4-19bc-499b-bd90-adde698b5da3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.285124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38048d4-19bc-499b-bd90-adde698b5da3 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.288463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 376/748] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:22.301129 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658a0d-7d4e-4e85-93c3-25347a680dc3 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.302079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658a0d-7d4e-4e85-93c3-25347a680dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.303157 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658a0d-7d4e-4e85-93c3-25347a680dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.360116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4a658a0d-7d4e-4e85-93c3-25347a680dc3 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:22.365672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4a658a0d-7d4e-4e85-93c3-25347a680dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:22.455300 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84991f83-e427-4c8f-b56b-7cbbb7f52abe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:22.457968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84991f83-e427-4c8f-b56b-7cbbb7f52abe None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:22.483354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:22.572691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 377/749] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:22.605480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309eb60-7601-4f6e-883f-ca13d9bfb4bb None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.605743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309eb60-7601-4f6e-883f-ca13d9bfb4bb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.606045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309eb60-7601-4f6e-883f-ca13d9bfb4bb None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.607791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 378/750] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:22.615768 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd1e71-d3e2-4e8f-af28-007845d60e63 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.616030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd1e71-d3e2-4e8f-af28-007845d60e63 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.616350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd1e71-d3e2-4e8f-af28-007845d60e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.662774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-75bd1e71-d3e2-4e8f-af28-007845d60e63 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:22.664080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-75bd1e71-d3e2-4e8f-af28-007845d60e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:22.689812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 373/751] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 785 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:08:22.696302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991f83-e427-4c8f-b56b-7cbbb7f52abe None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:22.874926 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 379/752] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:22.876125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd1e71-d3e2-4e8f-af28-007845d60e63 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:22.899116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:22.934698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991f83-e427-4c8f-b56b-7cbbb7f52abe None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:22.954970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:23.027164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd1e71-d3e2-4e8f-af28-007845d60e63 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.031699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74f972-2d18-4894-be14-c774e26466a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.035011 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74f972-2d18-4894-be14-c774e26466a2 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.035514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74f972-2d18-4894-be14-c774e26466a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.037503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74f972-2d18-4894-be14-c774e26466a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.059690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74f972-2d18-4894-be14-c774e26466a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:23.062572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74f972-2d18-4894-be14-c774e26466a2 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-1b74f972-2d18-4894-be14-c774e26466a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:23.092082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:23.093100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:23.093981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:23.093981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:23.093981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:23.093981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 374/753] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:23.101425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74f972-2d18-4894-be14-c774e26466a2 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:23.118506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8051f-b439-4ee6-bc00-d5299cceea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.119341 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8051f-b439-4ee6-bc00-d5299cceea07 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.119430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8051f-b439-4ee6-bc00-d5299cceea07 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.119683 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8051f-b439-4ee6-bc00-d5299cceea07 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.120284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8051f-b439-4ee6-bc00-d5299cceea07 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:23.121690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8051f-b439-4ee6-bc00-d5299cceea07 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-87a8051f-b439-4ee6-bc00-d5299cceea07 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:23.143091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:23.144085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:23.144916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 380/754] 10.222.0.81 () {56 vars in 1129 bytes} [Mon Aug 29 20:08:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:23.166362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8051f-b439-4ee6-bc00-d5299cceea07 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:23.369976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74f972-2d18-4894-be14-c774e26466a2 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.371070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:23.410442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8051f-b439-4ee6-bc00-d5299cceea07 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d50cbd-42d4-4c28-8eae-fbe8d0d26143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.475068 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d50cbd-42d4-4c28-8eae-fbe8d0d26143 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.475526 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d50cbd-42d4-4c28-8eae-fbe8d0d26143 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.475968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d50cbd-42d4-4c28-8eae-fbe8d0d26143 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.480145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d50cbd-42d4-4c28-8eae-fbe8d0d26143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:23.480145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d50cbd-42d4-4c28-8eae-fbe8d0d26143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:23.481228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d50cbd-42d4-4c28-8eae-fbe8d0d26143 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:23.487210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65eebf-5700-40b2-a4d8-dfdc2fefdab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.488158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65eebf-5700-40b2-a4d8-dfdc2fefdab7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.488600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65eebf-5700-40b2-a4d8-dfdc2fefdab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.489042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65eebf-5700-40b2-a4d8-dfdc2fefdab7 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.490124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65eebf-5700-40b2-a4d8-dfdc2fefdab7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:23.490666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65eebf-5700-40b2-a4d8-dfdc2fefdab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:23.494078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65eebf-5700-40b2-a4d8-dfdc2fefdab7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:23.504446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 381/755] 10.222.0.81 () {56 vars in 1124 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:23.505528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 375/756] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:23.505838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65eebf-5700-40b2-a4d8-dfdc2fefdab7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:23.515092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d50cbd-42d4-4c28-8eae-fbe8d0d26143 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:23.568872 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:23.725037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d50cbd-42d4-4c28-8eae-fbe8d0d26143 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.728389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65eebf-5700-40b2-a4d8-dfdc2fefdab7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.771350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd4186-7145-4774-805e-4b6924ff30e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.772129 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd4186-7145-4774-805e-4b6924ff30e0 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.772412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd4186-7145-4774-805e-4b6924ff30e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.772678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd4186-7145-4774-805e-4b6924ff30e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.782072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd4186-7145-4774-805e-4b6924ff30e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:23.783626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd4186-7145-4774-805e-4b6924ff30e0 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-80dd4186-7145-4774-805e-4b6924ff30e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:23.798098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:23.800552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:23.804329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:23.804329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:23.804329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:23.804329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:23.804329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:23.804329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:23.804329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:23.804329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:23.804329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 376/757] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:23.806301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f7059-fee7-4775-8e42-8660029787c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.807376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd4186-7145-4774-805e-4b6924ff30e0 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:23.807668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f7059-fee7-4775-8e42-8660029787c8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.807668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f7059-fee7-4775-8e42-8660029787c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.807668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f7059-fee7-4775-8e42-8660029787c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.824896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f7059-fee7-4775-8e42-8660029787c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-5d9f7059-fee7-4775-8e42-8660029787c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:23.836708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:23.840623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 382/758] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:23.843844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f7059-fee7-4775-8e42-8660029787c8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:23.860100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:23.913036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:23.937328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd4186-7145-4774-805e-4b6924ff30e0 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.981587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278423f-31a7-4728-bbbe-fbbef43587eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.982254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278423f-31a7-4728-bbbe-fbbef43587eb None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.982513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278423f-31a7-4728-bbbe-fbbef43587eb None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.982795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278423f-31a7-4728-bbbe-fbbef43587eb None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.983456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278423f-31a7-4728-bbbe-fbbef43587eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:23.983864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278423f-31a7-4728-bbbe-fbbef43587eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:23.985337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278423f-31a7-4728-bbbe-fbbef43587eb None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:23.991685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 377/759] 10.222.0.81 () {56 vars in 1124 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:23.994083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278423f-31a7-4728-bbbe-fbbef43587eb None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:24.065526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f7059-fee7-4775-8e42-8660029787c8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:24.121033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278423f-31a7-4728-bbbe-fbbef43587eb None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:24.138587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ec6ef-8cea-4268-a805-bd0a45b993d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:24.139967 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ec6ef-8cea-4268-a805-bd0a45b993d2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.140557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ec6ef-8cea-4268-a805-bd0a45b993d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.141133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ec6ef-8cea-4268-a805-bd0a45b993d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.142627 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ec6ef-8cea-4268-a805-bd0a45b993d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:24.143362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ec6ef-8cea-4268-a805-bd0a45b993d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:24.146581 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ec6ef-8cea-4268-a805-bd0a45b993d2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:24.168355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0320f-f3de-424d-907a-9fce6b1e7282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:24.169054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0320f-f3de-424d-907a-9fce6b1e7282 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.169330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0320f-f3de-424d-907a-9fce6b1e7282 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.169592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0320f-f3de-424d-907a-9fce6b1e7282 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.170616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0320f-f3de-424d-907a-9fce6b1e7282 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:24.170919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0320f-f3de-424d-907a-9fce6b1e7282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:24.172330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0320f-f3de-424d-907a-9fce6b1e7282 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:24.174832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 383/760] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:24.176653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ec6ef-8cea-4268-a805-bd0a45b993d2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:24.183915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 378/761] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:24.186970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0320f-f3de-424d-907a-9fce6b1e7282 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:24.203538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:24.323253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:24.372776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0320f-f3de-424d-907a-9fce6b1e7282 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:24.416578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ec6ef-8cea-4268-a805-bd0a45b993d2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:24.453788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67f0f3-28d1-444c-97d2-50d3eef368e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:24.454830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67f0f3-28d1-444c-97d2-50d3eef368e6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.455326 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67f0f3-28d1-444c-97d2-50d3eef368e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.455801 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67f0f3-28d1-444c-97d2-50d3eef368e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.457188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67f0f3-28d1-444c-97d2-50d3eef368e6 None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=829ac711e3d84e018404cf6dabeb3845) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:24.457751 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67f0f3-28d1-444c-97d2-50d3eef368e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:24.460537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67f0f3-28d1-444c-97d2-50d3eef368e6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:24.472483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 379/762] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:24 2022] GET /identity/v3/role_assignments?user.id=829ac711e3d84e018404cf6dabeb3845&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:24.478347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67f0f3-28d1-444c-97d2-50d3eef368e6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:24.499523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb49794-6367-4845-ade0-e8cf560874e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:24.500861 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb49794-6367-4845-ade0-e8cf560874e1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.501479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb49794-6367-4845-ade0-e8cf560874e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.502096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb49794-6367-4845-ade0-e8cf560874e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.503734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb49794-6367-4845-ade0-e8cf560874e1 None admin] RBAC: Adding query filter params (interface=public, service_id=b4bcc0f6f20f443e8be77ee8556fae93, region_id=RegionOne) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:24.504435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb49794-6367-4845-ade0-e8cf560874e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:24.507456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb49794-6367-4845-ade0-e8cf560874e1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:24.535689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 384/763] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Aug 29 20:08:24 2022] GET /identity/v3/endpoints?service_id=b4bcc0f6f20f443e8be77ee8556fae93&interface=public®ion_id=RegionOne => generated 194 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:24.535689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1992-ab70-4380-9d31-c1ed54eacee9 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.536405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1992-ab70-4380-9d31-c1ed54eacee9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.537051 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1992-ab70-4380-9d31-c1ed54eacee9 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.542000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 385/764] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:24.542571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c1992-ab70-4380-9d31-c1ed54eacee9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:24.655435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:24.694635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67f0f3-28d1-444c-97d2-50d3eef368e6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:24.769048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90467a02-81f0-476e-ab04-ead4f25b966d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:24.770441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90467a02-81f0-476e-ab04-ead4f25b966d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.771006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90467a02-81f0-476e-ab04-ead4f25b966d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.771512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90467a02-81f0-476e-ab04-ead4f25b966d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.794432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90467a02-81f0-476e-ab04-ead4f25b966d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:24.795041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c1992-ab70-4380-9d31-c1ed54eacee9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:24.798516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90467a02-81f0-476e-ab04-ead4f25b966d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-90467a02-81f0-476e-ab04-ead4f25b966d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:24.828346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:24.830538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:24.832622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:24.832622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:24.832622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:24.838812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 380/765] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:24.841186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e4739-b5bb-4c03-9347-ffa848d7cfa5 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.841685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e4739-b5bb-4c03-9347-ffa848d7cfa5 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.842178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e4739-b5bb-4c03-9347-ffa848d7cfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.864491 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:24.876022 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e705d49-9440-4474-9a6b-ec0788d4a4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:24.877130 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e705d49-9440-4474-9a6b-ec0788d4a4fc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.877636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e705d49-9440-4474-9a6b-ec0788d4a4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.878122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e705d49-9440-4474-9a6b-ec0788d4a4fc None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.879362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e705d49-9440-4474-9a6b-ec0788d4a4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:24.879661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-430e4739-b5bb-4c03-9347-ffa848d7cfa5 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:24.881783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-430e4739-b5bb-4c03-9347-ffa848d7cfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:24.882045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e705d49-9440-4474-9a6b-ec0788d4a4fc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:24.898402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 386/766] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Aug 29 20:08:24 2022] GET /identity/v3/services => generated 772 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:24.898402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e705d49-9440-4474-9a6b-ec0788d4a4fc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:25.160432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 381/767] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:25.188740 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e705d49-9440-4474-9a6b-ec0788d4a4fc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:25.259824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca4894-31c4-476b-bb1a-7d46a021b4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:25.260968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca4894-31c4-476b-bb1a-7d46a021b4fb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:25.261444 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca4894-31c4-476b-bb1a-7d46a021b4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:25.261919 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca4894-31c4-476b-bb1a-7d46a021b4fb None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:25.263134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca4894-31c4-476b-bb1a-7d46a021b4fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:25.263665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca4894-31c4-476b-bb1a-7d46a021b4fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:25.266325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca4894-31c4-476b-bb1a-7d46a021b4fb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:25.276291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f984e0f-97ac-4850-85c1-3ceafe0b1787 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:25.276600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f984e0f-97ac-4850-85c1-3ceafe0b1787 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:25.276923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f984e0f-97ac-4850-85c1-3ceafe0b1787 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:25.282427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 382/768] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:25.285436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d52aa8-09eb-4c69-aa57-3ad4ea8a16f8 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:25.285816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d52aa8-09eb-4c69-aa57-3ad4ea8a16f8 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:25.285999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d52aa8-09eb-4c69-aa57-3ad4ea8a16f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:25.291380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 387/769] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:25.302180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca4894-31c4-476b-bb1a-7d46a021b4fb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:25.312417 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-03d52aa8-09eb-4c69-aa57-3ad4ea8a16f8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:25.313648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-03d52aa8-09eb-4c69-aa57-3ad4ea8a16f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:25.400045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:25.426468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 383/770] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:25.427355 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:25.515637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca4894-31c4-476b-bb1a-7d46a021b4fb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:25.586917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd310e-da0c-4148-b32d-bf54a560a3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:25.588001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd310e-da0c-4148-b32d-bf54a560a3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:25.588479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd310e-da0c-4148-b32d-bf54a560a3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:25.588948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd310e-da0c-4148-b32d-bf54a560a3e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:25.604341 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd310e-da0c-4148-b32d-bf54a560a3e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:25.607210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd310e-da0c-4148-b32d-bf54a560a3e9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-d4fd310e-da0c-4148-b32d-bf54a560a3e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:25.630666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:25.631671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:25.632606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:25.632606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:25.632606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:25.632606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:25.632606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:25.632606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:25.632606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:25.632606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:25.632606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:25.632606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:25.633732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 388/771] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Aug 29 20:08:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:25.641906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d52aa8-09eb-4c69-aa57-3ad4ea8a16f8 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:25.792763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d52aa8-09eb-4c69-aa57-3ad4ea8a16f8 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:25.835204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83244eee-b7e5-4247-b811-78879c45181f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:25.836847 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83244eee-b7e5-4247-b811-78879c45181f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:25.837438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83244eee-b7e5-4247-b811-78879c45181f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:25.837918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83244eee-b7e5-4247-b811-78879c45181f None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:25.838982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83244eee-b7e5-4247-b811-78879c45181f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:25.839576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83244eee-b7e5-4247-b811-78879c45181f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:25.839683 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd310e-da0c-4148-b32d-bf54a560a3e9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:25.841813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83244eee-b7e5-4247-b811-78879c45181f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:25.863144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 384/772] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Aug 29 20:08:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:25.872912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83244eee-b7e5-4247-b811-78879c45181f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:25.927941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:26.027295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83244eee-b7e5-4247-b811-78879c45181f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.033449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd310e-da0c-4148-b32d-bf54a560a3e9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.051457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:26.077956 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c92697-30d6-4ca6-9f6d-797f24a321ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.078686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c92697-30d6-4ca6-9f6d-797f24a321ce None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.078961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c92697-30d6-4ca6-9f6d-797f24a321ce None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.079228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c92697-30d6-4ca6-9f6d-797f24a321ce None admin] PATH_INFO: `/v3/services/network` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.080002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c92697-30d6-4ca6-9f6d-797f24a321ce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:26.081410 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c92697-30d6-4ca6-9f6d-797f24a321ce None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b2c92697-30d6-4ca6-9f6d-797f24a321ce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:26.092014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:26.093095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:26.094607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 389/773] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:25 2022] GET /identity/v3/services/network => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:26.095397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c92697-30d6-4ca6-9f6d-797f24a321ce None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:26.098870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6340e7-2e47-4878-8325-2f3b2ca5d0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.099988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6340e7-2e47-4878-8325-2f3b2ca5d0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.100499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6340e7-2e47-4878-8325-2f3b2ca5d0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.101000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6340e7-2e47-4878-8325-2f3b2ca5d0b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.123051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6340e7-2e47-4878-8325-2f3b2ca5d0b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:26.125919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6340e7-2e47-4878-8325-2f3b2ca5d0b4 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-2d6340e7-2e47-4878-8325-2f3b2ca5d0b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:26.159103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:26.161373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:26.163877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:26.163877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:26.163877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:26.170264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 385/774] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:26.170264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6340e7-2e47-4878-8325-2f3b2ca5d0b4 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:26.224003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c92697-30d6-4ca6-9f6d-797f24a321ce None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.268581 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fdb16-f3e3-460d-b9d3-5331bc85ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.269535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fdb16-f3e3-460d-b9d3-5331bc85ec60 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.269826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fdb16-f3e3-460d-b9d3-5331bc85ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.270098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fdb16-f3e3-460d-b9d3-5331bc85ec60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.285555 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fdb16-f3e3-460d-b9d3-5331bc85ec60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-891fdb16-f3e3-460d-b9d3-5331bc85ec60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:26.291911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:26.293722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 390/775] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:26.295428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fdb16-f3e3-460d-b9d3-5331bc85ec60 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:26.356861 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:26.362282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:26.371513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6340e7-2e47-4878-8325-2f3b2ca5d0b4 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.416623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943076d-6491-4093-82a5-d2b5fcdf4b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.417262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943076d-6491-4093-82a5-d2b5fcdf4b56 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.417556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943076d-6491-4093-82a5-d2b5fcdf4b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.417806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943076d-6491-4093-82a5-d2b5fcdf4b56 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.418504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943076d-6491-4093-82a5-d2b5fcdf4b56 None admin] RBAC: Adding query filter params (name=network) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:26.418812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943076d-6491-4093-82a5-d2b5fcdf4b56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:26.420247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943076d-6491-4093-82a5-d2b5fcdf4b56 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:26.433033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 386/776] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:26.434074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943076d-6491-4093-82a5-d2b5fcdf4b56 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:26.486865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fdb16-f3e3-460d-b9d3-5331bc85ec60 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.549214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd5bae-4197-425c-af7f-d2b5281b53b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.550606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd5bae-4197-425c-af7f-d2b5281b53b1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.551366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd5bae-4197-425c-af7f-d2b5281b53b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.552115 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd5bae-4197-425c-af7f-d2b5281b53b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.553383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd5bae-4197-425c-af7f-d2b5281b53b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:26.554128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd5bae-4197-425c-af7f-d2b5281b53b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:26.557725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd5bae-4197-425c-af7f-d2b5281b53b1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:26.574518 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943076d-6491-4093-82a5-d2b5fcdf4b56 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.587529 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 391/777] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:26.589651 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd5bae-4197-425c-af7f-d2b5281b53b1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:26.620596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37295-3b45-41ef-82dd-1e2c57ca39d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.621128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37295-3b45-41ef-82dd-1e2c57ca39d5 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.621410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37295-3b45-41ef-82dd-1e2c57ca39d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.621675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37295-3b45-41ef-82dd-1e2c57ca39d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.622393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b37295-3b45-41ef-82dd-1e2c57ca39d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:26.622700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b37295-3b45-41ef-82dd-1e2c57ca39d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:26.624127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b37295-3b45-41ef-82dd-1e2c57ca39d5 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:26.637670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 387/778] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:26.637670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37295-3b45-41ef-82dd-1e2c57ca39d5 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:26.671905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:26.778359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37295-3b45-41ef-82dd-1e2c57ca39d5 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.801772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:26.810636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd5bae-4197-425c-af7f-d2b5281b53b1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.848640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f95844-bfe5-4841-90a0-79b4abc81349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.849647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f95844-bfe5-4841-90a0-79b4abc81349 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.850295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f95844-bfe5-4841-90a0-79b4abc81349 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.851323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f95844-bfe5-4841-90a0-79b4abc81349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.861178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f95844-bfe5-4841-90a0-79b4abc81349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:26.863104 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f95844-bfe5-4841-90a0-79b4abc81349 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-79f95844-bfe5-4841-90a0-79b4abc81349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:26.883930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:26.884914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:26.885854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:26.885854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:26.885854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:26.885854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:26.885854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:26.885854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:26.885854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:26.885854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:26.890394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 388/779] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:26.891585 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f95844-bfe5-4841-90a0-79b4abc81349 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:26.896793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773839-0d15-4778-91c5-b350612b4de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.898378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773839-0d15-4778-91c5-b350612b4de7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.898902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773839-0d15-4778-91c5-b350612b4de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.899359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773839-0d15-4778-91c5-b350612b4de7 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.900426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773839-0d15-4778-91c5-b350612b4de7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:26.900917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773839-0d15-4778-91c5-b350612b4de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:26.903575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773839-0d15-4778-91c5-b350612b4de7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:26.915601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 392/780] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:26.916689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773839-0d15-4778-91c5-b350612b4de7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.012374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:27.038128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f95844-bfe5-4841-90a0-79b4abc81349 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:27.083781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad927bb8-e2ec-46c4-8213-395f1f416c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:27.085219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad927bb8-e2ec-46c4-8213-395f1f416c83 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.085984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad927bb8-e2ec-46c4-8213-395f1f416c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.087078 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad927bb8-e2ec-46c4-8213-395f1f416c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.102127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad927bb8-e2ec-46c4-8213-395f1f416c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:27.104673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad927bb8-e2ec-46c4-8213-395f1f416c83 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:27.121954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773839-0d15-4778-91c5-b350612b4de7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-ad927bb8-e2ec-46c4-8213-395f1f416c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:27.130317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:27.131530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:27.132440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:27.132440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:27.132440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:27.132440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 389/781] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:27.134059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad927bb8-e2ec-46c4-8213-395f1f416c83 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.181626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fa440-fd36-4a14-b2a5-c2eee7b486cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:27.182697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fa440-fd36-4a14-b2a5-c2eee7b486cb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.183205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fa440-fd36-4a14-b2a5-c2eee7b486cb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.183705 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fa440-fd36-4a14-b2a5-c2eee7b486cb None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.185155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fa440-fd36-4a14-b2a5-c2eee7b486cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:27.185634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fa440-fd36-4a14-b2a5-c2eee7b486cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:27.188319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fa440-fd36-4a14-b2a5-c2eee7b486cb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:27.217432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 393/782] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:27.217432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4446-8aa8-4fea-a745-dc3c5b16e487 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.217432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4446-8aa8-4fea-a745-dc3c5b16e487 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.217432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4446-8aa8-4fea-a745-dc3c5b16e487 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.218465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 394/783] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:27.219941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f4446-8aa8-4fea-a745-dc3c5b16e487 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.266334 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:27.333708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad927bb8-e2ec-46c4-8213-395f1f416c83 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:27.376708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f4446-8aa8-4fea-a745-dc3c5b16e487 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:27.377581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:27.382948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6e5be-eaef-48ac-92cf-b47111b91712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:27.384265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6e5be-eaef-48ac-92cf-b47111b91712 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.384622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6e5be-eaef-48ac-92cf-b47111b91712 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.384884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6e5be-eaef-48ac-92cf-b47111b91712 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.385624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6e5be-eaef-48ac-92cf-b47111b91712 None admin] RBAC: Adding query filter params (interface=public, service_id=6ccf84c3136e47acbd5c60940782f126, region_id=RegionOne) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:27.385944 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6e5be-eaef-48ac-92cf-b47111b91712 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:27.387399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6e5be-eaef-48ac-92cf-b47111b91712 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:27.396391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 390/784] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Aug 29 20:08:27 2022] GET /identity/v3/endpoints?service_id=6ccf84c3136e47acbd5c60940782f126&interface=public®ion_id=RegionOne => generated 194 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:27.402374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6e5be-eaef-48ac-92cf-b47111b91712 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.418053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a567693-e788-4c1f-bb73-1990bad3a666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:27.419016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567693-e788-4c1f-bb73-1990bad3a666 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.419316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567693-e788-4c1f-bb73-1990bad3a666 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.419567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567693-e788-4c1f-bb73-1990bad3a666 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.420235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a567693-e788-4c1f-bb73-1990bad3a666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:27.420544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a567693-e788-4c1f-bb73-1990bad3a666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:27.422068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a567693-e788-4c1f-bb73-1990bad3a666 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:27.436021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 395/785] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:27.437327 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d519-bb02-4225-ad3d-3db15a6bd96d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.437634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d519-bb02-4225-ad3d-3db15a6bd96d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.437881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d519-bb02-4225-ad3d-3db15a6bd96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.458877 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d950d519-bb02-4225-ad3d-3db15a6bd96d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:27.460232 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d950d519-bb02-4225-ad3d-3db15a6bd96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:27.522232 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6e5be-eaef-48ac-92cf-b47111b91712 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:27.536774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 396/786] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:27.537643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950d519-bb02-4225-ad3d-3db15a6bd96d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.569945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c948c3c-68b5-4274-bc30-8cb6007c658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:27.571236 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:27.571747 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c948c3c-68b5-4274-bc30-8cb6007c658b None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.572092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c948c3c-68b5-4274-bc30-8cb6007c658b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.572370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c948c3c-68b5-4274-bc30-8cb6007c658b None admin] PATH_INFO: `/v3/projects/8e86d23a023e4db497277d055b604ebe/users/30946d3b3f0f4a81b2ae5aa6e84f3920/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.575253 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c948c3c-68b5-4274-bc30-8cb6007c658b None admin] RBAC: Authorizing `identity:create_grant(project_id=8e86d23a023e4db497277d055b604ebe, user_id=30946d3b3f0f4a81b2ae5aa6e84f3920, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:27.577763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c948c3c-68b5-4274-bc30-8cb6007c658b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:27.675061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950d519-bb02-4225-ad3d-3db15a6bd96d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:27.718338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 391/787] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:27 2022] PUT /identity/v3/projects/8e86d23a023e4db497277d055b604ebe/users/30946d3b3f0f4a81b2ae5aa6e84f3920/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:27.718338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e20f8-2f44-4e13-976c-7588d156e2e2 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.718338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e20f8-2f44-4e13-976c-7588d156e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.718338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e20f8-2f44-4e13-976c-7588d156e2e2 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.718338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 392/788] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:27.718338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e20f8-2f44-4e13-976c-7588d156e2e2 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.729508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6e24d-64cc-4450-b28f-43f7b1186612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:27.730510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6e24d-64cc-4450-b28f-43f7b1186612 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.730942 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6e24d-64cc-4450-b28f-43f7b1186612 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.731401 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6e24d-64cc-4450-b28f-43f7b1186612 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.732201 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6e24d-64cc-4450-b28f-43f7b1186612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:27.734284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6e24d-64cc-4450-b28f-43f7b1186612 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:27.741595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 397/789] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Aug 29 20:08:27 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:27.744033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a5cfb-4627-45c5-8598-d829437e5a0c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.744488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a5cfb-4627-45c5-8598-d829437e5a0c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.744939 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a5cfb-4627-45c5-8598-d829437e5a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.769218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2a8a5cfb-4627-45c5-8598-d829437e5a0c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:27.770987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2a8a5cfb-4627-45c5-8598-d829437e5a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:27.877852 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:27.879587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 398/790] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:27.888219 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a5cfb-4627-45c5-8598-d829437e5a0c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.926835 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:28.004158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e20f8-2f44-4e13-976c-7588d156e2e2 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:28.092889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc25b95-accb-44f0-8c3b-6dcf5bcd7d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:28.095070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc25b95-accb-44f0-8c3b-6dcf5bcd7d15 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:28.095358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc25b95-accb-44f0-8c3b-6dcf5bcd7d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:28.095635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc25b95-accb-44f0-8c3b-6dcf5bcd7d15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:28.107117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc25b95-accb-44f0-8c3b-6dcf5bcd7d15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:28.108715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc25b95-accb-44f0-8c3b-6dcf5bcd7d15 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-3dc25b95-accb-44f0-8c3b-6dcf5bcd7d15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:28.121983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:28.124257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:28.126843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:28.126843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:28.126843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:28.126843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:28.126843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:28.126843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:28.126843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:28.126843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:28.126843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:28.126843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:28.126843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 393/791] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Aug 29 20:08:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:28.129501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc25b95-accb-44f0-8c3b-6dcf5bcd7d15 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:28.130340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a5cfb-4627-45c5-8598-d829437e5a0c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:28.206123 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24458750-088f-4bd4-ab30-40dea87decd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:28.207615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458750-088f-4bd4-ab30-40dea87decd8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:28.208310 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458750-088f-4bd4-ab30-40dea87decd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:28.209400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458750-088f-4bd4-ab30-40dea87decd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:28.233443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24458750-088f-4bd4-ab30-40dea87decd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-24458750-088f-4bd4-ab30-40dea87decd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:28.245558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:28.247868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:28.249549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:28.249549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:28.249549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:28.249549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:28.249549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:28.249549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:28.249549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:28.249549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:28.249549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:28.249549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:28.249549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:28.249549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:28.254246 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 399/792] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:28.264448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24458750-088f-4bd4-ab30-40dea87decd8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:28.405227 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:28.409416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc25b95-accb-44f0-8c3b-6dcf5bcd7d15 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:28.438328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:28.466524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaac681-da92-43a9-8ab9-fe46ab446c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:28.467050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaac681-da92-43a9-8ab9-fe46ab446c00 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:28.467342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaac681-da92-43a9-8ab9-fe46ab446c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:28.467616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaac681-da92-43a9-8ab9-fe46ab446c00 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:28.468992 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaac681-da92-43a9-8ab9-fe46ab446c00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:28.469307 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaac681-da92-43a9-8ab9-fe46ab446c00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:28.472220 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaac681-da92-43a9-8ab9-fe46ab446c00 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:28.504609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24458750-088f-4bd4-ab30-40dea87decd8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:28.511798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 394/793] 10.222.0.81 () {56 vars in 1149 bytes} [Mon Aug 29 20:08:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:28.512716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaac681-da92-43a9-8ab9-fe46ab446c00 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:28.563428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03361cd-ee40-4dde-a58d-2b56a659f7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:28.564758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03361cd-ee40-4dde-a58d-2b56a659f7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:28.565050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03361cd-ee40-4dde-a58d-2b56a659f7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:28.565327 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03361cd-ee40-4dde-a58d-2b56a659f7f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:28.566026 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03361cd-ee40-4dde-a58d-2b56a659f7f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:28.566452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03361cd-ee40-4dde-a58d-2b56a659f7f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:28.569355 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03361cd-ee40-4dde-a58d-2b56a659f7f5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:28.585217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 400/794] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:28.588507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03361cd-ee40-4dde-a58d-2b56a659f7f5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:28.670349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaac681-da92-43a9-8ab9-fe46ab446c00 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:28.721688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0e260-2d68-4489-a164-9300d58741d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:28.723108 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0e260-2d68-4489-a164-9300d58741d6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:28.723108 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0e260-2d68-4489-a164-9300d58741d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:28.723357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0e260-2d68-4489-a164-9300d58741d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:28.724060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0e260-2d68-4489-a164-9300d58741d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:28.726180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0e260-2d68-4489-a164-9300d58741d6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-afc0e260-2d68-4489-a164-9300d58741d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:28.741080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:28.743549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:28.745396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 395/795] 10.222.0.81 () {56 vars in 1129 bytes} [Mon Aug 29 20:08:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:28.755608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0e260-2d68-4489-a164-9300d58741d6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:28.800549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:28.819182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03361cd-ee40-4dde-a58d-2b56a659f7f5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:28.876861 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:28.891711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280c1ef-cfc0-4cb6-99fd-ca642363f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:28.893221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280c1ef-cfc0-4cb6-99fd-ca642363f684 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:28.893954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280c1ef-cfc0-4cb6-99fd-ca642363f684 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:28.895339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280c1ef-cfc0-4cb6-99fd-ca642363f684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:28.915435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0e260-2d68-4489-a164-9300d58741d6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:28.988801 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f784b49-ca3c-421a-b5b0-8f13985fba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:28.989964 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f784b49-ca3c-421a-b5b0-8f13985fba98 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:28.990596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f784b49-ca3c-421a-b5b0-8f13985fba98 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:28.991158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f784b49-ca3c-421a-b5b0-8f13985fba98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.015772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f784b49-ca3c-421a-b5b0-8f13985fba98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:29.018977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f784b49-ca3c-421a-b5b0-8f13985fba98 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-9f784b49-ca3c-421a-b5b0-8f13985fba98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:29.052296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:29.054164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:29.058867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:29.058867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:29.058867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:29.058867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 396/796] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:29.058867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f784b49-ca3c-421a-b5b0-8f13985fba98 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:29.106431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280c1ef-cfc0-4cb6-99fd-ca642363f684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:29.108856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280c1ef-cfc0-4cb6-99fd-ca642363f684 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-d280c1ef-cfc0-4cb6-99fd-ca642363f684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:29.145275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:29.147386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:29.149954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:29.149954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:29.149954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:29.151822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 401/797] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 565 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:29.153668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280c1ef-cfc0-4cb6-99fd-ca642363f684 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:29.275856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:29.296658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f784b49-ca3c-421a-b5b0-8f13985fba98 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:29.373001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280c1ef-cfc0-4cb6-99fd-ca642363f684 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:29.390470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a90122-f8eb-489f-b075-423ff80d1947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:29.392033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a90122-f8eb-489f-b075-423ff80d1947 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:29.392844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a90122-f8eb-489f-b075-423ff80d1947 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:29.393668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a90122-f8eb-489f-b075-423ff80d1947 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.395465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a90122-f8eb-489f-b075-423ff80d1947 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:29.396357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a90122-f8eb-489f-b075-423ff80d1947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:29.400104 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a90122-f8eb-489f-b075-423ff80d1947 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:29.415077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 397/798] 10.222.0.81 () {56 vars in 1124 bytes} [Mon Aug 29 20:08:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:29.417259 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a90122-f8eb-489f-b075-423ff80d1947 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:29.440511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8ae24-d9e5-4dd0-a44f-e41ac213783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:29.441430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8ae24-d9e5-4dd0-a44f-e41ac213783b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:29.441801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8ae24-d9e5-4dd0-a44f-e41ac213783b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:29.442316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8ae24-d9e5-4dd0-a44f-e41ac213783b None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.443348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8ae24-d9e5-4dd0-a44f-e41ac213783b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:29.443812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8ae24-d9e5-4dd0-a44f-e41ac213783b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:29.447054 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8ae24-d9e5-4dd0-a44f-e41ac213783b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:29.470494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 402/799] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:29.472133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8ae24-d9e5-4dd0-a44f-e41ac213783b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:29.554148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:29.636688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a90122-f8eb-489f-b075-423ff80d1947 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:29.644493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8ae24-d9e5-4dd0-a44f-e41ac213783b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:29.685844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19542d-d2a6-4299-93a5-4bbc9e6b1454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:29.686501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19542d-d2a6-4299-93a5-4bbc9e6b1454 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:29.686787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19542d-d2a6-4299-93a5-4bbc9e6b1454 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:29.687056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19542d-d2a6-4299-93a5-4bbc9e6b1454 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.687697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19542d-d2a6-4299-93a5-4bbc9e6b1454 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:29.688000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19542d-d2a6-4299-93a5-4bbc9e6b1454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:29.689573 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19542d-d2a6-4299-93a5-4bbc9e6b1454 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:29.701842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 403/800] 10.222.0.81 () {56 vars in 1124 bytes} [Mon Aug 29 20:08:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:29.701842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19542d-d2a6-4299-93a5-4bbc9e6b1454 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:29.704422 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db52dcd-834b-4717-8f92-2f466dcc6db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:29.705564 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db52dcd-834b-4717-8f92-2f466dcc6db5 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:29.706178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db52dcd-834b-4717-8f92-2f466dcc6db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:29.706828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db52dcd-834b-4717-8f92-2f466dcc6db5 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.708040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db52dcd-834b-4717-8f92-2f466dcc6db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:29.708746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db52dcd-834b-4717-8f92-2f466dcc6db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:29.711768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db52dcd-834b-4717-8f92-2f466dcc6db5 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:29.734303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 398/801] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:29.736977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db52dcd-834b-4717-8f92-2f466dcc6db5 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:29.757660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:29.824007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19542d-d2a6-4299-93a5-4bbc9e6b1454 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:29.827190 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:29.866457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f6a4b-c17e-4ca1-b4ae-6db5aa18ac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:29.868106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f6a4b-c17e-4ca1-b4ae-6db5aa18ac5b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:29.869590 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f6a4b-c17e-4ca1-b4ae-6db5aa18ac5b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:29.870178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f6a4b-c17e-4ca1-b4ae-6db5aa18ac5b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.879483 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f6a4b-c17e-4ca1-b4ae-6db5aa18ac5b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:29.881390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f6a4b-c17e-4ca1-b4ae-6db5aa18ac5b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-906f6a4b-c17e-4ca1-b4ae-6db5aa18ac5b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:29.896615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:29.897675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:29.899323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:29.899323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:29.899323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:29.899323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:29.899323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:29.899323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:29.899323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:29.899323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:29.899323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:29.899323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:29.901836 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 404/802] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:29.903122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f6a4b-c17e-4ca1-b4ae-6db5aa18ac5b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:29.948002 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db52dcd-834b-4717-8f92-2f466dcc6db5 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.028776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f6a4b-c17e-4ca1-b4ae-6db5aa18ac5b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.029611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86901d-5304-487e-8058-5dee3eae55da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.031901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86901d-5304-487e-8058-5dee3eae55da None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.033380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86901d-5304-487e-8058-5dee3eae55da None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.033974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86901d-5304-487e-8058-5dee3eae55da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.035379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86901d-5304-487e-8058-5dee3eae55da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:30.038507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86901d-5304-487e-8058-5dee3eae55da None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:30.075447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28198c0-47ba-4914-a7d7-c18d2848d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.076153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28198c0-47ba-4914-a7d7-c18d2848d026 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.076522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28198c0-47ba-4914-a7d7-c18d2848d026 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.076835 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28198c0-47ba-4914-a7d7-c18d2848d026 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.085284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28198c0-47ba-4914-a7d7-c18d2848d026 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:30.087258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28198c0-47ba-4914-a7d7-c18d2848d026 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b28198c0-47ba-4914-a7d7-c18d2848d026 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:30.101114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:30.103145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:30.105718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:30.105718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:30.105718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:30.105718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:30.105718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:30.105718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:30.105718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:30.105718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:30.105718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 405/803] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:30.105718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28198c0-47ba-4914-a7d7-c18d2848d026 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:30.166896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 399/804] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:08:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:30.166896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86901d-5304-487e-8058-5dee3eae55da None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:30.179405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:30.382630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:30.424719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28198c0-47ba-4914-a7d7-c18d2848d026 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.455665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86901d-5304-487e-8058-5dee3eae55da None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.480517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0348a-fbeb-4944-9273-8a195574ae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.481991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0348a-fbeb-4944-9273-8a195574ae28 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.482747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0348a-fbeb-4944-9273-8a195574ae28 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.483474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0348a-fbeb-4944-9273-8a195574ae28 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.484889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0348a-fbeb-4944-9273-8a195574ae28 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:30.485537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0348a-fbeb-4944-9273-8a195574ae28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:30.489708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0348a-fbeb-4944-9273-8a195574ae28 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:30.500841 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef8f16-d176-4d5a-bd0c-7212a6abde53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.501469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef8f16-d176-4d5a-bd0c-7212a6abde53 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.501750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef8f16-d176-4d5a-bd0c-7212a6abde53 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.502024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef8f16-d176-4d5a-bd0c-7212a6abde53 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.502783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef8f16-d176-4d5a-bd0c-7212a6abde53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:30.503093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef8f16-d176-4d5a-bd0c-7212a6abde53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:30.504579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef8f16-d176-4d5a-bd0c-7212a6abde53 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:30.521696 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 400/805] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:30.527234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1de636-5e72-478c-8d1a-2cc6227cfbca None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.527234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1de636-5e72-478c-8d1a-2cc6227cfbca None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.527234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1de636-5e72-478c-8d1a-2cc6227cfbca None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.527565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 406/806] 10.222.0.81 () {56 vars in 1135 bytes} [Mon Aug 29 20:08:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:30.529637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 401/807] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:30.531363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0348a-fbeb-4944-9273-8a195574ae28 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:30.532260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6d323-6e54-419c-9fa8-0a46a6b47cc9 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.532607 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6d323-6e54-419c-9fa8-0a46a6b47cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.532818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6d323-6e54-419c-9fa8-0a46a6b47cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.554435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d0a6d323-6e54-419c-9fa8-0a46a6b47cc9 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:30.555910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d0a6d323-6e54-419c-9fa8-0a46a6b47cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:30.654335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 402/808] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:30.655573 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6d323-6e54-419c-9fa8-0a46a6b47cc9 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:30.710513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:30.743048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0348a-fbeb-4944-9273-8a195574ae28 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.780270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:30.793970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a750b-60dc-40e4-8537-24b30354eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.794714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a750b-60dc-40e4-8537-24b30354eb2c None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.795303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a750b-60dc-40e4-8537-24b30354eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.795303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a750b-60dc-40e4-8537-24b30354eb2c None admin] PATH_INFO: `/v3/projects/8e86d23a023e4db497277d055b604ebe/users/2a96ca7980a54be5bee6aae4bb54b664/roles/f9bdecb8ab28491cac0078d1452a3bef` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.814868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a750b-60dc-40e4-8537-24b30354eb2c None admin] RBAC: Authorizing `identity:create_grant(project_id=8e86d23a023e4db497277d055b604ebe, user_id=2a96ca7980a54be5bee6aae4bb54b664, role_id=f9bdecb8ab28491cac0078d1452a3bef)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:30.821227 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a750b-60dc-40e4-8537-24b30354eb2c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:30.827052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6d323-6e54-419c-9fa8-0a46a6b47cc9 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.877688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95d865-2332-4ba8-ba16-43bc2e9ee764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.878366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95d865-2332-4ba8-ba16-43bc2e9ee764 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.878640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95d865-2332-4ba8-ba16-43bc2e9ee764 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.878953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95d865-2332-4ba8-ba16-43bc2e9ee764 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.892925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95d865-2332-4ba8-ba16-43bc2e9ee764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:30.894816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95d865-2332-4ba8-ba16-43bc2e9ee764 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-bc95d865-2332-4ba8-ba16-43bc2e9ee764 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:30.912823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:30.913893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:30.915302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:30.915302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:30.915302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:30.918653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 403/809] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:30.921145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6ed99-32eb-4f4b-b1b9-dfc6943a8063 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.921580 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6ed99-32eb-4f4b-b1b9-dfc6943a8063 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.923018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6ed99-32eb-4f4b-b1b9-dfc6943a8063 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.925969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 404/810] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:30.927260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6ed99-32eb-4f4b-b1b9-dfc6943a8063 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:30.942567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 407/811] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:30 2022] PUT /identity/v3/projects/8e86d23a023e4db497277d055b604ebe/users/2a96ca7980a54be5bee6aae4bb54b664/roles/f9bdecb8ab28491cac0078d1452a3bef => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:30.944282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c317b89-9c50-4d49-88d5-678fa5175a05 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.944764 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c317b89-9c50-4d49-88d5-678fa5175a05 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.945228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c317b89-9c50-4d49-88d5-678fa5175a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.967363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4c317b89-9c50-4d49-88d5-678fa5175a05 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:30.968981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4c317b89-9c50-4d49-88d5-678fa5175a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:31.067525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 408/812] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:31.069020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c317b89-9c50-4d49-88d5-678fa5175a05 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.116423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6ed99-32eb-4f4b-b1b9-dfc6943a8063 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.135097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:31.197935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c5e91-1c89-4950-8166-5f43f29adf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.211647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c5e91-1c89-4950-8166-5f43f29adf81 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.212703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c5e91-1c89-4950-8166-5f43f29adf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.214208 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c5e91-1c89-4950-8166-5f43f29adf81 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.216965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:31.218689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c5e91-1c89-4950-8166-5f43f29adf81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:31.220503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c5e91-1c89-4950-8166-5f43f29adf81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:31.223852 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c5e91-1c89-4950-8166-5f43f29adf81 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:31.249797 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 405/813] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:31.256469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c5e91-1c89-4950-8166-5f43f29adf81 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.298753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c317b89-9c50-4d49-88d5-678fa5175a05 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.424640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc64d04-abc8-4ade-8c78-46db630761ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.425528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc64d04-abc8-4ade-8c78-46db630761ec None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.425911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc64d04-abc8-4ade-8c78-46db630761ec None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.426351 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc64d04-abc8-4ade-8c78-46db630761ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.442306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc64d04-abc8-4ade-8c78-46db630761ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-5cc64d04-abc8-4ade-8c78-46db630761ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:31.449445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:31.450472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:31.451346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:31.451346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:31.451346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:31.451346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:31.451346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:31.451346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:31.451346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:31.451346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:31.451346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:31.451346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:31.451346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:31.451346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:31.454358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 409/814] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:31.458385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc64d04-abc8-4ade-8c78-46db630761ec None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.518009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c5e91-1c89-4950-8166-5f43f29adf81 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.588050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb95b1-f641-4f57-a66b-df7f187c00dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.588924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb95b1-f641-4f57-a66b-df7f187c00dd None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.589305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb95b1-f641-4f57-a66b-df7f187c00dd None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.589685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb95b1-f641-4f57-a66b-df7f187c00dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.598148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb95b1-f641-4f57-a66b-df7f187c00dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:31.600128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb95b1-f641-4f57-a66b-df7f187c00dd None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-b0bb95b1-f641-4f57-a66b-df7f187c00dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:31.614122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:31.616203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:31.620026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:31.620026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:31.620026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:31.620026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:31.620026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:31.620026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:31.620026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:31.620026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:31.630258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 406/815] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:31.630258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb95b1-f641-4f57-a66b-df7f187c00dd None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.645807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc64d04-abc8-4ade-8c78-46db630761ec None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.661049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:31.685652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:31.702579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041ace9-6105-4678-a954-4ccb8df6bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.703461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041ace9-6105-4678-a954-4ccb8df6bc73 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.703888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041ace9-6105-4678-a954-4ccb8df6bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.704513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041ace9-6105-4678-a954-4ccb8df6bc73 None admin] PATH_INFO: `/v3/services/network` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.705279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041ace9-6105-4678-a954-4ccb8df6bc73 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:31.708621 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041ace9-6105-4678-a954-4ccb8df6bc73 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-5041ace9-6105-4678-a954-4ccb8df6bc73 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:31.721719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:31.722935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:31.723808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:31.727709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 410/816] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/services/network => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:31.728905 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041ace9-6105-4678-a954-4ccb8df6bc73 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.798145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb95b1-f641-4f57-a66b-df7f187c00dd None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.866695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bc035-eecd-4ea2-ad27-29b5b4a94ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.867731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bc035-eecd-4ea2-ad27-29b5b4a94ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.868230 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bc035-eecd-4ea2-ad27-29b5b4a94ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.868801 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bc035-eecd-4ea2-ad27-29b5b4a94ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.870061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bc035-eecd-4ea2-ad27-29b5b4a94ee0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:31.870621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bc035-eecd-4ea2-ad27-29b5b4a94ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:31.873182 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bc035-eecd-4ea2-ad27-29b5b4a94ee0 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:31.876226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041ace9-6105-4678-a954-4ccb8df6bc73 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.894422 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 407/817] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:31.895605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bc035-eecd-4ea2-ad27-29b5b4a94ee0 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.950559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ef475-260c-4e7e-a3e6-6930e2f30721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.951690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ef475-260c-4e7e-a3e6-6930e2f30721 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.952409 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ef475-260c-4e7e-a3e6-6930e2f30721 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.952985 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ef475-260c-4e7e-a3e6-6930e2f30721 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.954389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ef475-260c-4e7e-a3e6-6930e2f30721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:31.954956 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ef475-260c-4e7e-a3e6-6930e2f30721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:31.957963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ef475-260c-4e7e-a3e6-6930e2f30721 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:31.990549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 411/818] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:31.992745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ef475-260c-4e7e-a3e6-6930e2f30721 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.074259 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:32.087983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bc035-eecd-4ea2-ad27-29b5b4a94ee0 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.102919 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:32.163947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482be49-7eed-4130-b755-512fc7735c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.165781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482be49-7eed-4130-b755-512fc7735c46 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.166455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482be49-7eed-4130-b755-512fc7735c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.167039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482be49-7eed-4130-b755-512fc7735c46 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.168335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482be49-7eed-4130-b755-512fc7735c46 None admin] RBAC: Adding query filter params (name=network) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:32.169006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482be49-7eed-4130-b755-512fc7735c46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.171749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482be49-7eed-4130-b755-512fc7735c46 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.181317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 408/819] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:32.183285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482be49-7eed-4130-b755-512fc7735c46 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.196369 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ef475-260c-4e7e-a3e6-6930e2f30721 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.257492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe51d88-d823-4b4e-93b3-e6b854ca5228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.259802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe51d88-d823-4b4e-93b3-e6b854ca5228 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.260411 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe51d88-d823-4b4e-93b3-e6b854ca5228 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.261036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe51d88-d823-4b4e-93b3-e6b854ca5228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.283654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe51d88-d823-4b4e-93b3-e6b854ca5228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.286749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe51d88-d823-4b4e-93b3-e6b854ca5228 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-cfe51d88-d823-4b4e-93b3-e6b854ca5228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:32.319108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:32.321659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:32.325005 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:32.325005 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:32.325005 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:32.325637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482be49-7eed-4130-b755-512fc7735c46 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.330786 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 412/820] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:32.332531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe51d88-d823-4b4e-93b3-e6b854ca5228 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.399338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b71220-0a5e-4c53-9f3a-2fdb9ca735eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.401005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b71220-0a5e-4c53-9f3a-2fdb9ca735eb None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.401720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b71220-0a5e-4c53-9f3a-2fdb9ca735eb None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.402465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b71220-0a5e-4c53-9f3a-2fdb9ca735eb None admin] PATH_INFO: `/v3/projects/8e86d23a023e4db497277d055b604ebe/users/829ac711e3d84e018404cf6dabeb3845/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.406616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b71220-0a5e-4c53-9f3a-2fdb9ca735eb None admin] RBAC: Authorizing `identity:create_grant(project_id=8e86d23a023e4db497277d055b604ebe, user_id=829ac711e3d84e018404cf6dabeb3845, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.410027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b71220-0a5e-4c53-9f3a-2fdb9ca735eb None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.506746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 409/821] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:32 2022] PUT /identity/v3/projects/8e86d23a023e4db497277d055b604ebe/users/829ac711e3d84e018404cf6dabeb3845/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:32.508822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b71220-0a5e-4c53-9f3a-2fdb9ca735eb None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.538326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:32.543699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:32.546990 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe51d88-d823-4b4e-93b3-e6b854ca5228 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.600071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d2261-bdb6-4d86-8cc0-21c98723a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.600833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d2261-bdb6-4d86-8cc0-21c98723a069 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.601113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d2261-bdb6-4d86-8cc0-21c98723a069 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.601386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d2261-bdb6-4d86-8cc0-21c98723a069 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.602365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d2261-bdb6-4d86-8cc0-21c98723a069 None admin] RBAC: Adding query filter params (type=network) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:32.603359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d2261-bdb6-4d86-8cc0-21c98723a069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.605502 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d2261-bdb6-4d86-8cc0-21c98723a069 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.612819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 413/822] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:32.614459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baabf8-a6e0-4af6-8d18-94722c123f75 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.614757 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baabf8-a6e0-4af6-8d18-94722c123f75 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.615030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baabf8-a6e0-4af6-8d18-94722c123f75 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.618457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 414/823] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:32.623262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d62b1-e24c-4df5-8589-3f452277ef75 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.623837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d62b1-e24c-4df5-8589-3f452277ef75 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.624486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d62b1-e24c-4df5-8589-3f452277ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.659902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-fc0d62b1-e24c-4df5-8589-3f452277ef75 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:32.662282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fc0d62b1-e24c-4df5-8589-3f452277ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:32.814007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 415/824] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:32.814007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d62b1-e24c-4df5-8589-3f452277ef75 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.848172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b71220-0a5e-4c53-9f3a-2fdb9ca735eb None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.921276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b22649-340e-4277-aead-27e6633e2c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.922498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b22649-340e-4277-aead-27e6633e2c0f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.922965 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b22649-340e-4277-aead-27e6633e2c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.923456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b22649-340e-4277-aead-27e6633e2c0f None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.924644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b22649-340e-4277-aead-27e6633e2c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:32.925179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b22649-340e-4277-aead-27e6633e2c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.928177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b22649-340e-4277-aead-27e6633e2c0f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.955522 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 410/825] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:32.963491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b22649-340e-4277-aead-27e6633e2c0f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.999136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.030821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d62b1-e24c-4df5-8589-3f452277ef75 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.147343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4452362-1122-46c5-8eac-c2437646a964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.148348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4452362-1122-46c5-8eac-c2437646a964 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.149166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4452362-1122-46c5-8eac-c2437646a964 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.149750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4452362-1122-46c5-8eac-c2437646a964 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.150681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4452362-1122-46c5-8eac-c2437646a964 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.152100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4452362-1122-46c5-8eac-c2437646a964 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.155223 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.184890 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b22649-340e-4277-aead-27e6633e2c0f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.229061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c4006-f05c-424b-8f1a-14b517956db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.229710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c4006-f05c-424b-8f1a-14b517956db4 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.229982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c4006-f05c-424b-8f1a-14b517956db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.230297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c4006-f05c-424b-8f1a-14b517956db4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.239294 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c4006-f05c-424b-8f1a-14b517956db4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.240828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c4006-f05c-424b-8f1a-14b517956db4 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-288c4006-f05c-424b-8f1a-14b517956db4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:33.254076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:33.255273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:33.256433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:33.256433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:33.256433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:33.256433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:33.256433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:33.256433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:33.256433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:33.256433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:33.256433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:33.256433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:33.256433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 411/826] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Aug 29 20:08:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:33.257067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c4006-f05c-424b-8f1a-14b517956db4 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.274705 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 416/827] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:08:32 2022] POST /identity/v3/endpoints => generated 337 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:33.285887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4452362-1122-46c5-8eac-c2437646a964 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.468662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c4006-f05c-424b-8f1a-14b517956db4 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.505062 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4452362-1122-46c5-8eac-c2437646a964 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.510627 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55010c9f-3d1f-41c4-b477-b802e76393a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.512598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55010c9f-3d1f-41c4-b477-b802e76393a0 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.512598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55010c9f-3d1f-41c4-b477-b802e76393a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.512598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55010c9f-3d1f-41c4-b477-b802e76393a0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.512598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55010c9f-3d1f-41c4-b477-b802e76393a0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.514051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55010c9f-3d1f-41c4-b477-b802e76393a0 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.516348 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-55010c9f-3d1f-41c4-b477-b802e76393a0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:33.525042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:33.531653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:33.532970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 412/828] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:33.536152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55010c9f-3d1f-41c4-b477-b802e76393a0 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.589144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ccbf0-144a-49f0-97e4-3fe9b8ff5b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.590878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ccbf0-144a-49f0-97e4-3fe9b8ff5b7b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.591675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ccbf0-144a-49f0-97e4-3fe9b8ff5b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.592463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ccbf0-144a-49f0-97e4-3fe9b8ff5b7b None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.594480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ccbf0-144a-49f0-97e4-3fe9b8ff5b7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:33.595340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ccbf0-144a-49f0-97e4-3fe9b8ff5b7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.598467 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ccbf0-144a-49f0-97e4-3fe9b8ff5b7b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.637813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 417/829] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Aug 29 20:08:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:33.643803 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ccbf0-144a-49f0-97e4-3fe9b8ff5b7b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.649763 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.653566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55010c9f-3d1f-41c4-b477-b802e76393a0 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.725486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f826c9b-b719-497d-8c05-bf641b9cb7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.726038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f826c9b-b719-497d-8c05-bf641b9cb7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.726353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f826c9b-b719-497d-8c05-bf641b9cb7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.726668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f826c9b-b719-497d-8c05-bf641b9cb7a7 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.727324 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f826c9b-b719-497d-8c05-bf641b9cb7a7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:33.727630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f826c9b-b719-497d-8c05-bf641b9cb7a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.729059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f826c9b-b719-497d-8c05-bf641b9cb7a7 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.738667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 413/830] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:33.741062 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48311b7a-7de6-4164-89d0-dd8fb437a626 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.741531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48311b7a-7de6-4164-89d0-dd8fb437a626 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.741813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48311b7a-7de6-4164-89d0-dd8fb437a626 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.744533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 414/831] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:33.749182 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48311b7a-7de6-4164-89d0-dd8fb437a626 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.811200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ccbf0-144a-49f0-97e4-3fe9b8ff5b7b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.848727 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.859205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c8c16-a3f8-4800-b141-ca78220e3260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.860102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c8c16-a3f8-4800-b141-ca78220e3260 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.860505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c8c16-a3f8-4800-b141-ca78220e3260 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.860955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c8c16-a3f8-4800-b141-ca78220e3260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.918489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48311b7a-7de6-4164-89d0-dd8fb437a626 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.962131 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d727d-4e62-42d9-b612-d83314c2d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.963099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d727d-4e62-42d9-b612-d83314c2d8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.963535 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d727d-4e62-42d9-b612-d83314c2d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.963955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d727d-4e62-42d9-b612-d83314c2d8a9 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.964791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d727d-4e62-42d9-b612-d83314c2d8a9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:33.965254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d727d-4e62-42d9-b612-d83314c2d8a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.965383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c8c16-a3f8-4800-b141-ca78220e3260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.966981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d727d-4e62-42d9-b612-d83314c2d8a9 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.967629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c8c16-a3f8-4800-b141-ca78220e3260 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.970135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.982968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 415/832] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:33.990437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9a933-3513-41f8-b177-7fc0f5915db0 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.990437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9a933-3513-41f8-b177-7fc0f5915db0 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.990437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9a933-3513-41f8-b177-7fc0f5915db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.010517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-8df9a933-3513-41f8-b177-7fc0f5915db0 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:34.011833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8df9a933-3513-41f8-b177-7fc0f5915db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:34.141705 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 418/833] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:08:34.142398 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 416/834] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:34.147645 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c8c16-a3f8-4800-b141-ca78220e3260 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:34.275148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c8c16-a3f8-4800-b141-ca78220e3260 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:34.276928 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:34.319247 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f075c0-621a-4a47-9593-d1705fdde00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:34.321419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f075c0-621a-4a47-9593-d1705fdde00d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.321811 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f075c0-621a-4a47-9593-d1705fdde00d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.322178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f075c0-621a-4a47-9593-d1705fdde00d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.335973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f075c0-621a-4a47-9593-d1705fdde00d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:34.337861 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f075c0-621a-4a47-9593-d1705fdde00d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-d2f075c0-621a-4a47-9593-d1705fdde00d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:34.357520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:34.358739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:34.359867 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:34.359867 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:34.359867 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:34.365287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 419/835] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:34.371432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9a933-3513-41f8-b177-7fc0f5915db0 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:34.444455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:34.515758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9a933-3513-41f8-b177-7fc0f5915db0 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:34.583793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff822b00-3f71-4723-a7fa-f5a7524efb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:34.584696 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff822b00-3f71-4723-a7fa-f5a7524efb07 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.585125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff822b00-3f71-4723-a7fa-f5a7524efb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.585553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff822b00-3f71-4723-a7fa-f5a7524efb07 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.587164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff822b00-3f71-4723-a7fa-f5a7524efb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:34.587691 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff822b00-3f71-4723-a7fa-f5a7524efb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:34.590382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff822b00-3f71-4723-a7fa-f5a7524efb07 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:34.599701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f075c0-621a-4a47-9593-d1705fdde00d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:34.613474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 417/836] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:34.620148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff822b00-3f71-4723-a7fa-f5a7524efb07 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:34.744100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f075c0-621a-4a47-9593-d1705fdde00d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:34.783724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe8ad1-9534-46fd-ba46-ef2e33a34259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:34.784746 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe8ad1-9534-46fd-ba46-ef2e33a34259 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.785274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe8ad1-9534-46fd-ba46-ef2e33a34259 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.785845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe8ad1-9534-46fd-ba46-ef2e33a34259 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.805495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff822b00-3f71-4723-a7fa-f5a7524efb07 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:34.807561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe8ad1-9534-46fd-ba46-ef2e33a34259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-9afe8ad1-9534-46fd-ba46-ef2e33a34259 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:34.817778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:34.819512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:34.821256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:34.821256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:34.821256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:34.821256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:34.821256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:34.821256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:34.821256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:34.821256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:34.821256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:34.821256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:34.821256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:34.821256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:34.825087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:34.834203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 420/837] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:34.838568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe8ad1-9534-46fd-ba46-ef2e33a34259 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:34.848194 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9103c2-2c76-4bcc-b6e4-783c6c9fd975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:34.848854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9103c2-2c76-4bcc-b6e4-783c6c9fd975 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.849741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9103c2-2c76-4bcc-b6e4-783c6c9fd975 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.849741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9103c2-2c76-4bcc-b6e4-783c6c9fd975 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.857661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9103c2-2c76-4bcc-b6e4-783c6c9fd975 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:34.860375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9103c2-2c76-4bcc-b6e4-783c6c9fd975 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:34.873753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-be9103c2-2c76-4bcc-b6e4-783c6c9fd975 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:34.877643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:34.879898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:34.881657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:34.881657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:34.881657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:34.881657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:34.881657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:34.881657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:34.881657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:34.881657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:34.890203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 418/838] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:34.890203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9103c2-2c76-4bcc-b6e4-783c6c9fd975 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.005697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe8ad1-9534-46fd-ba46-ef2e33a34259 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.054288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83804cea-2d93-4adb-a243-4dd6cbe7d1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.056001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83804cea-2d93-4adb-a243-4dd6cbe7d1dc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.056520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83804cea-2d93-4adb-a243-4dd6cbe7d1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.056988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83804cea-2d93-4adb-a243-4dd6cbe7d1dc None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.057766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83804cea-2d93-4adb-a243-4dd6cbe7d1dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:35.058125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83804cea-2d93-4adb-a243-4dd6cbe7d1dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:35.060234 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83804cea-2d93-4adb-a243-4dd6cbe7d1dc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:35.071520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9103c2-2c76-4bcc-b6e4-783c6c9fd975 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.079797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 421/839] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:35.079797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab4b0b-ac2c-4346-8212-2bfce7e9243e None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.079797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab4b0b-ac2c-4346-8212-2bfce7e9243e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.079797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab4b0b-ac2c-4346-8212-2bfce7e9243e None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.081815 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 422/840] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:35.084906 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab4b0b-ac2c-4346-8212-2bfce7e9243e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.128119 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019264a-7498-48eb-9f81-0700484bd518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.129115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019264a-7498-48eb-9f81-0700484bd518 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.129580 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019264a-7498-48eb-9f81-0700484bd518 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.130036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019264a-7498-48eb-9f81-0700484bd518 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.131303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019264a-7498-48eb-9f81-0700484bd518 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:35.131818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019264a-7498-48eb-9f81-0700484bd518 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:35.134876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019264a-7498-48eb-9f81-0700484bd518 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:35.156383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 419/841] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:35.159204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fa7c4-a32d-465a-877c-b5a082d7c0ef None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.159806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fa7c4-a32d-465a-877c-b5a082d7c0ef None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.161004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fa7c4-a32d-465a-877c-b5a082d7c0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.192774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-255fa7c4-a32d-465a-877c-b5a082d7c0ef None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:35.194879 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-255fa7c4-a32d-465a-877c-b5a082d7c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:35.231773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:35.244399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:35.285438 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab4b0b-ac2c-4346-8212-2bfce7e9243e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.290549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 420/842] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:35.293105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fa7c4-a32d-465a-877c-b5a082d7c0ef None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.330527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6b96b-7356-457f-b7c8-eca0163296a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.331226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6b96b-7356-457f-b7c8-eca0163296a5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.331508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6b96b-7356-457f-b7c8-eca0163296a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.331767 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6b96b-7356-457f-b7c8-eca0163296a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.351033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6b96b-7356-457f-b7c8-eca0163296a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:35.359289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6b96b-7356-457f-b7c8-eca0163296a5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-f9d6b96b-7356-457f-b7c8-eca0163296a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:35.377647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:35.379611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:35.381851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:35.381851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:35.381851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:35.383606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 423/843] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:35.387293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6b96b-7356-457f-b7c8-eca0163296a5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.535915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6b96b-7356-457f-b7c8-eca0163296a5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.542640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fa7c4-a32d-465a-877c-b5a082d7c0ef None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.592638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:35.610149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995970b-7320-403d-aca6-359ca87461ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.610149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995970b-7320-403d-aca6-359ca87461ee None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.610149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995970b-7320-403d-aca6-359ca87461ee None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.610149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995970b-7320-403d-aca6-359ca87461ee None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.610663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995970b-7320-403d-aca6-359ca87461ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:35.610663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995970b-7320-403d-aca6-359ca87461ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:35.610663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995970b-7320-403d-aca6-359ca87461ee None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:35.622623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 424/844] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:35.624522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995970b-7320-403d-aca6-359ca87461ee None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.625438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88124b7a-0ab2-4acd-a4eb-9ed0554d5a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.626608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88124b7a-0ab2-4acd-a4eb-9ed0554d5a78 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.630260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88124b7a-0ab2-4acd-a4eb-9ed0554d5a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.630260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88124b7a-0ab2-4acd-a4eb-9ed0554d5a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.634254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88124b7a-0ab2-4acd-a4eb-9ed0554d5a78 None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=30946d3b3f0f4a81b2ae5aa6e84f3920) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:35.634254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88124b7a-0ab2-4acd-a4eb-9ed0554d5a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:35.634603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88124b7a-0ab2-4acd-a4eb-9ed0554d5a78 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:35.658280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 421/845] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:35 2022] GET /identity/v3/role_assignments?user.id=30946d3b3f0f4a81b2ae5aa6e84f3920&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 608 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:35.658280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88124b7a-0ab2-4acd-a4eb-9ed0554d5a78 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.780055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:35.822724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995970b-7320-403d-aca6-359ca87461ee None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.908365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbfbd3-bfb7-43f7-9bfd-0dcc873e7857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.909024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbfbd3-bfb7-43f7-9bfd-0dcc873e7857 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.909299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbfbd3-bfb7-43f7-9bfd-0dcc873e7857 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.909564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbfbd3-bfb7-43f7-9bfd-0dcc873e7857 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.925493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbfbd3-bfb7-43f7-9bfd-0dcc873e7857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-1fcbfbd3-bfb7-43f7-9bfd-0dcc873e7857 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:35.935158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:35.936171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:35.936996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:35.936996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:35.936996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:35.936996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:35.936996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:35.936996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:35.936996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:35.936996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:35.936996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:35.936996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:35.936996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:35.936996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:35.946316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88124b7a-0ab2-4acd-a4eb-9ed0554d5a78 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.947805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 425/846] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:35.950122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbfbd3-bfb7-43f7-9bfd-0dcc873e7857 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.994792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88109be8-0f54-489e-897c-a01ea4eefd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.994792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88109be8-0f54-489e-897c-a01ea4eefd68 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.994792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88109be8-0f54-489e-897c-a01ea4eefd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.994792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88109be8-0f54-489e-897c-a01ea4eefd68 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.005039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88109be8-0f54-489e-897c-a01ea4eefd68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:36.007027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88109be8-0f54-489e-897c-a01ea4eefd68 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-88109be8-0f54-489e-897c-a01ea4eefd68 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:36.031085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:36.033005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:36.034956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:36.034956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:36.034956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:36.034956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:36.034956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:36.034956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:36.034956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:36.034956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:36.034956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:36.034956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:36.037500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 422/847] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Aug 29 20:08:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:36.038536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88109be8-0f54-489e-897c-a01ea4eefd68 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:36.091849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:36.203345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbfbd3-bfb7-43f7-9bfd-0dcc873e7857 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:36.222439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:36.239017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88109be8-0f54-489e-897c-a01ea4eefd68 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:36.256809 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd8f2a-ef30-46d5-874d-12c06fb0f35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:36.257440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8f2a-ef30-46d5-874d-12c06fb0f35e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.257773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8f2a-ef30-46d5-874d-12c06fb0f35e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.258131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8f2a-ef30-46d5-874d-12c06fb0f35e None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.259020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd8f2a-ef30-46d5-874d-12c06fb0f35e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:36.259324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd8f2a-ef30-46d5-874d-12c06fb0f35e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:36.260898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd8f2a-ef30-46d5-874d-12c06fb0f35e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:36.276145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 426/848] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:36.276145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c341db9-b85f-4cbf-bb30-56d1a2faebda None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.276145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c341db9-b85f-4cbf-bb30-56d1a2faebda None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.276145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c341db9-b85f-4cbf-bb30-56d1a2faebda None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.279122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 427/849] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:36.280095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c341db9-b85f-4cbf-bb30-56d1a2faebda None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:36.312559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dee3c1-ec48-4154-9a36-b7c501fd1162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:36.313963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dee3c1-ec48-4154-9a36-b7c501fd1162 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.314712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dee3c1-ec48-4154-9a36-b7c501fd1162 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.315583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dee3c1-ec48-4154-9a36-b7c501fd1162 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.317414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dee3c1-ec48-4154-9a36-b7c501fd1162 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:36.318324 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dee3c1-ec48-4154-9a36-b7c501fd1162 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:36.321896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dee3c1-ec48-4154-9a36-b7c501fd1162 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:36.365185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 423/850] 10.222.0.81 () {56 vars in 1149 bytes} [Mon Aug 29 20:08:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:36.366581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b83bb9-115d-4b1f-938d-490e15fada42 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.366855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b83bb9-115d-4b1f-938d-490e15fada42 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.367212 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b83bb9-115d-4b1f-938d-490e15fada42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.389758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-c4b83bb9-115d-4b1f-938d-490e15fada42 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:36.391011 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c4b83bb9-115d-4b1f-938d-490e15fada42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:36.431793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c341db9-b85f-4cbf-bb30-56d1a2faebda None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:36.447320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:36.479299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa1fac-c7c1-4515-8cc2-c559842c21f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:36.480592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa1fac-c7c1-4515-8cc2-c559842c21f5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.481417 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa1fac-c7c1-4515-8cc2-c559842c21f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.482083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa1fac-c7c1-4515-8cc2-c559842c21f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.498199 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa1fac-c7c1-4515-8cc2-c559842c21f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:36.500856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa1fac-c7c1-4515-8cc2-c559842c21f5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:36.514526 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 424/851] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:36.514526 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b83bb9-115d-4b1f-938d-490e15fada42 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b3fa1fac-c7c1-4515-8cc2-c559842c21f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:36.532556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:36.534880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:36.536879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:36.536879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:36.536879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:36.545643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 428/852] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:36.549248 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa1fac-c7c1-4515-8cc2-c559842c21f5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:36.652351 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:36.677356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b83bb9-115d-4b1f-938d-490e15fada42 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:36.717605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e545da-221f-4ab4-8681-fa19b0acdded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:36.718709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e545da-221f-4ab4-8681-fa19b0acdded None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.719192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e545da-221f-4ab4-8681-fa19b0acdded None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.719659 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e545da-221f-4ab4-8681-fa19b0acdded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.737660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa1fac-c7c1-4515-8cc2-c559842c21f5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:36.793655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3161a-2b6b-4e7c-b6eb-3e67e4c78939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:36.794530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3161a-2b6b-4e7c-b6eb-3e67e4c78939 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.794964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3161a-2b6b-4e7c-b6eb-3e67e4c78939 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.795182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3161a-2b6b-4e7c-b6eb-3e67e4c78939 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.796233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3161a-2b6b-4e7c-b6eb-3e67e4c78939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:36.796755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3161a-2b6b-4e7c-b6eb-3e67e4c78939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:36.799152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3161a-2b6b-4e7c-b6eb-3e67e4c78939 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:36.810665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e545da-221f-4ab4-8681-fa19b0acdded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:36.812787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e545da-221f-4ab4-8681-fa19b0acdded None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:36.830718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 429/853] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:36.834169 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3161a-2b6b-4e7c-b6eb-3e67e4c78939 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:36.872727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:36.931490 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:36.966261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 425/854] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:08:36.966261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e545da-221f-4ab4-8681-fa19b0acdded None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.001263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3161a-2b6b-4e7c-b6eb-3e67e4c78939 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.045712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2b7f8-d4ae-4ee1-856c-e7da219dd0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.046387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2b7f8-d4ae-4ee1-856c-e7da219dd0f6 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.046665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2b7f8-d4ae-4ee1-856c-e7da219dd0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.046933 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2b7f8-d4ae-4ee1-856c-e7da219dd0f6 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.047617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2b7f8-d4ae-4ee1-856c-e7da219dd0f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.049049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2b7f8-d4ae-4ee1-856c-e7da219dd0f6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.125022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e545da-221f-4ab4-8681-fa19b0acdded None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.165012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff96fa-7cb9-4d8e-8ca2-ca1c4008bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.165693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff96fa-7cb9-4d8e-8ca2-ca1c4008bf58 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.165975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff96fa-7cb9-4d8e-8ca2-ca1c4008bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.166247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff96fa-7cb9-4d8e-8ca2-ca1c4008bf58 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.176102 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff96fa-7cb9-4d8e-8ca2-ca1c4008bf58 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.182490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 430/855] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:08:36 2022] POST /identity/v3/services => generated 251 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:37.182753 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff96fa-7cb9-4d8e-8ca2-ca1c4008bf58 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.182851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2b7f8-d4ae-4ee1-856c-e7da219dd0f6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-20ff96fa-7cb9-4d8e-8ca2-ca1c4008bf58 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:37.194533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:37.196329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:37.197239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:37.197239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:37.197239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:37.197239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:37.197239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:37.197239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:37.197239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:37.197239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:37.197239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:37.197239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:37.197239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 426/856] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:37.202464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff96fa-7cb9-4d8e-8ca2-ca1c4008bf58 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.270494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:37.302151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:37.336304 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2b7f8-d4ae-4ee1-856c-e7da219dd0f6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.360968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff96fa-7cb9-4d8e-8ca2-ca1c4008bf58 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.389625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bb850-8c74-4c79-9efd-7e0a18d877ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.390710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bb850-8c74-4c79-9efd-7e0a18d877ec None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.390988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bb850-8c74-4c79-9efd-7e0a18d877ec None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.391257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bb850-8c74-4c79-9efd-7e0a18d877ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.408382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bb850-8c74-4c79-9efd-7e0a18d877ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.409123 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bb850-8c74-4c79-9efd-7e0a18d877ec None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.417447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cbd40-d136-47f4-a7f0-46f861cbb2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.418083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cbd40-d136-47f4-a7f0-46f861cbb2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.418459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cbd40-d136-47f4-a7f0-46f861cbb2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.418716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cbd40-d136-47f4-a7f0-46f861cbb2e1 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.420412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cbd40-d136-47f4-a7f0-46f861cbb2e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:37.420412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cbd40-d136-47f4-a7f0-46f861cbb2e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.421908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cbd40-d136-47f4-a7f0-46f861cbb2e1 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-1b0bb850-8c74-4c79-9efd-7e0a18d877ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:37.430624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:37.431704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:37.433024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:37.433024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:37.433024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:37.433024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 431/857] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:37.440905 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bb850-8c74-4c79-9efd-7e0a18d877ec None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.443913 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 427/858] 10.222.0.81 () {56 vars in 1135 bytes} [Mon Aug 29 20:08:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:37.450691 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cbd40-d136-47f4-a7f0-46f861cbb2e1 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.602365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:37.609643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cbd40-d136-47f4-a7f0-46f861cbb2e1 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.648991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bb850-8c74-4c79-9efd-7e0a18d877ec None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.664287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498fd89-bd45-4877-ac71-a34d890d7715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.665791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498fd89-bd45-4877-ac71-a34d890d7715 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.667089 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498fd89-bd45-4877-ac71-a34d890d7715 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.668269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498fd89-bd45-4877-ac71-a34d890d7715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.684992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:37.692447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eea58-c2d8-4864-8645-4dd29a1caaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.698530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eea58-c2d8-4864-8645-4dd29a1caaea None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.698530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eea58-c2d8-4864-8645-4dd29a1caaea None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.698530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eea58-c2d8-4864-8645-4dd29a1caaea None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.698530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69eea58-c2d8-4864-8645-4dd29a1caaea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:37.698530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69eea58-c2d8-4864-8645-4dd29a1caaea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.698530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69eea58-c2d8-4864-8645-4dd29a1caaea None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.712186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 432/859] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:37.717565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eea58-c2d8-4864-8645-4dd29a1caaea None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.793849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498fd89-bd45-4877-ac71-a34d890d7715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.795798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498fd89-bd45-4877-ac71-a34d890d7715 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.838520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eea58-c2d8-4864-8645-4dd29a1caaea None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.879082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27653fe3-018d-42b9-b340-954d250e369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.879735 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653fe3-018d-42b9-b340-954d250e369f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.880018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653fe3-018d-42b9-b340-954d250e369f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.880455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653fe3-018d-42b9-b340-954d250e369f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.889389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27653fe3-018d-42b9-b340-954d250e369f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.890925 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27653fe3-018d-42b9-b340-954d250e369f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-27653fe3-018d-42b9-b340-954d250e369f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:37.905701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:37.907037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:37.908001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:37.908001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:37.908001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:37.908001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:37.908001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:37.908001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:37.908001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:37.908001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:37.910625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 433/860] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:37.913582 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27653fe3-018d-42b9-b340-954d250e369f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.917384 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:37.924963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 428/861] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:37 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:08:37.934496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498fd89-bd45-4877-ac71-a34d890d7715 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.980881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:38.047770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27653fe3-018d-42b9-b340-954d250e369f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:38.084738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498fd89-bd45-4877-ac71-a34d890d7715 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:38.088318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e9968-a45a-462d-b133-e3c275f970ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:38.088939 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e9968-a45a-462d-b133-e3c275f970ea None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.089212 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e9968-a45a-462d-b133-e3c275f970ea None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.089476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e9968-a45a-462d-b133-e3c275f970ea None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.090186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e9968-a45a-462d-b133-e3c275f970ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:38.090523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e9968-a45a-462d-b133-e3c275f970ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:38.091993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e9968-a45a-462d-b133-e3c275f970ea None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:38.111459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 434/862] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:38.111459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c23d3-f39b-4fd8-a038-795b39637f59 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.111459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c23d3-f39b-4fd8-a038-795b39637f59 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.111459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c23d3-f39b-4fd8-a038-795b39637f59 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.111459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 435/863] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:38.112882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c23d3-f39b-4fd8-a038-795b39637f59 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:38.131423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b4447-dfdb-4e09-a5b5-1064bff26d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:38.131977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b4447-dfdb-4e09-a5b5-1064bff26d03 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.132262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b4447-dfdb-4e09-a5b5-1064bff26d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.133060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b4447-dfdb-4e09-a5b5-1064bff26d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.144462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b4447-dfdb-4e09-a5b5-1064bff26d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:38.145939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b4447-dfdb-4e09-a5b5-1064bff26d03 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-450b4447-dfdb-4e09-a5b5-1064bff26d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:38.163112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:38.164864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:38.165778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:38.165778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:38.165778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:38.165778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 429/864] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:38.166477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370b04a-ae3d-4929-8143-9df34b2b8254 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.166747 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370b04a-ae3d-4929-8143-9df34b2b8254 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.167020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370b04a-ae3d-4929-8143-9df34b2b8254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.187339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-c370b04a-ae3d-4929-8143-9df34b2b8254 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:38.188554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c370b04a-ae3d-4929-8143-9df34b2b8254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:38.241118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:38.244296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c23d3-f39b-4fd8-a038-795b39637f59 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:38.265984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:38.274523 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 430/865] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:38 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:38.274523 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370b04a-ae3d-4929-8143-9df34b2b8254 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:38.303975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c2161-605d-4795-9934-bc79b060a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:38.305861 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c2161-605d-4795-9934-bc79b060a292 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.306400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c2161-605d-4795-9934-bc79b060a292 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.307025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c2161-605d-4795-9934-bc79b060a292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.308374 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c2161-605d-4795-9934-bc79b060a292 None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=2a96ca7980a54be5bee6aae4bb54b664) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:38.309154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c2161-605d-4795-9934-bc79b060a292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:38.311464 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c2161-605d-4795-9934-bc79b060a292 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:38.319790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 436/866] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/role_assignments?user.id=2a96ca7980a54be5bee6aae4bb54b664&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:38.420549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370b04a-ae3d-4929-8143-9df34b2b8254 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:38.471664 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c8f6f-640a-400f-befd-115593008177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:38.472712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c8f6f-640a-400f-befd-115593008177 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.473281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c8f6f-640a-400f-befd-115593008177 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.473789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c8f6f-640a-400f-befd-115593008177 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.475090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c8f6f-640a-400f-befd-115593008177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:38.475647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c8f6f-640a-400f-befd-115593008177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:38.478387 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c8f6f-640a-400f-befd-115593008177 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:38.496553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 431/867] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:38.502056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c2161-605d-4795-9934-bc79b060a292 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:38.622213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c8f6f-640a-400f-befd-115593008177 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:38.640916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c2161-605d-4795-9934-bc79b060a292 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:38.672101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:38.704658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262f6de-bd13-4e7c-8a78-4464b359d679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:38.705999 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262f6de-bd13-4e7c-8a78-4464b359d679 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.706526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262f6de-bd13-4e7c-8a78-4464b359d679 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.707026 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262f6de-bd13-4e7c-8a78-4464b359d679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.723025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262f6de-bd13-4e7c-8a78-4464b359d679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:38.724486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262f6de-bd13-4e7c-8a78-4464b359d679 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-f262f6de-bd13-4e7c-8a78-4464b359d679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:38.742975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:38.743934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:38.744806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:38.744806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:38.744806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:38.744806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:38.744806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:38.744806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:38.744806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:38.744806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:38.747455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 437/868] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:38.752896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262f6de-bd13-4e7c-8a78-4464b359d679 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:38.772460 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c8f6f-640a-400f-befd-115593008177 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:38.803560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:38.819038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b791a-d601-47a1-968e-4d3048f612a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:38.819803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b791a-d601-47a1-968e-4d3048f612a6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.820356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b791a-d601-47a1-968e-4d3048f612a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.820502 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b791a-d601-47a1-968e-4d3048f612a6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.821172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b791a-d601-47a1-968e-4d3048f612a6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:38.823400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b791a-d601-47a1-968e-4d3048f612a6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-894b791a-d601-47a1-968e-4d3048f612a6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:38.839077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:38.840083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:38.840978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:38.846537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 432/869] 10.222.0.81 () {56 vars in 1132 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:38.849629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b791a-d601-47a1-968e-4d3048f612a6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:38.900573 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262f6de-bd13-4e7c-8a78-4464b359d679 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:38.951281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe6a29-dda1-4da4-b2f9-30dd5e6f09cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:38.952916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe6a29-dda1-4da4-b2f9-30dd5e6f09cd None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.953588 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe6a29-dda1-4da4-b2f9-30dd5e6f09cd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.954127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe6a29-dda1-4da4-b2f9-30dd5e6f09cd None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.955015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe6a29-dda1-4da4-b2f9-30dd5e6f09cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:38.955810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe6a29-dda1-4da4-b2f9-30dd5e6f09cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:38.959100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe6a29-dda1-4da4-b2f9-30dd5e6f09cd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:38.979270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 438/870] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:38.980418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe6a29-dda1-4da4-b2f9-30dd5e6f09cd None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:39.003592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b791a-d601-47a1-968e-4d3048f612a6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:39.006167 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:39.052827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338d26e-49b8-4441-b366-4980b283586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:39.053991 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338d26e-49b8-4441-b366-4980b283586a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.055121 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338d26e-49b8-4441-b366-4980b283586a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.055545 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338d26e-49b8-4441-b366-4980b283586a None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.056347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338d26e-49b8-4441-b366-4980b283586a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:39.057090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338d26e-49b8-4441-b366-4980b283586a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:39.060383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338d26e-49b8-4441-b366-4980b283586a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:39.067191 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 433/871] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:39.076079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338d26e-49b8-4441-b366-4980b283586a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:39.109468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:39.120689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe6a29-dda1-4da4-b2f9-30dd5e6f09cd None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:39.166665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2a639-9796-4dc7-891a-67ea6e0c667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:39.167741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2a639-9796-4dc7-891a-67ea6e0c667d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.168431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2a639-9796-4dc7-891a-67ea6e0c667d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.168932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2a639-9796-4dc7-891a-67ea6e0c667d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.170106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2a639-9796-4dc7-891a-67ea6e0c667d None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=829ac711e3d84e018404cf6dabeb3845) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:39.170692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2a639-9796-4dc7-891a-67ea6e0c667d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:39.172887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2a639-9796-4dc7-891a-67ea6e0c667d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:39.194780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 439/872] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/role_assignments?user.id=829ac711e3d84e018404cf6dabeb3845&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:39.214690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338d26e-49b8-4441-b366-4980b283586a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:39.259246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3402b-6856-44be-8bf5-0d1e56c8c775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:39.259879 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3402b-6856-44be-8bf5-0d1e56c8c775 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.260158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3402b-6856-44be-8bf5-0d1e56c8c775 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.260425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3402b-6856-44be-8bf5-0d1e56c8c775 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.261086 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3402b-6856-44be-8bf5-0d1e56c8c775 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:39.261389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3402b-6856-44be-8bf5-0d1e56c8c775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:39.262956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3402b-6856-44be-8bf5-0d1e56c8c775 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:39.269343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 434/873] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:39.322377 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a432e91-fe1c-4c76-af72-c1add30a3d18 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.322693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a432e91-fe1c-4c76-af72-c1add30a3d18 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.323006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a432e91-fe1c-4c76-af72-c1add30a3d18 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.324843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 440/874] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:39.330889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e0c9c-54de-4078-b31b-c4dd7843daf6 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.331149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e0c9c-54de-4078-b31b-c4dd7843daf6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.331499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e0c9c-54de-4078-b31b-c4dd7843daf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.355718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-0a1e0c9c-54de-4078-b31b-c4dd7843daf6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:39.357016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-0a1e0c9c-54de-4078-b31b-c4dd7843daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:39.388932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:39.459443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 435/875] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:39.780530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a432e91-fe1c-4c76-af72-c1add30a3d18 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:39.906869 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a432e91-fe1c-4c76-af72-c1add30a3d18 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:39.947076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc98664-4b6a-46b6-9c6f-f41f5b1474af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:39.948159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc98664-4b6a-46b6-9c6f-f41f5b1474af None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.948700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc98664-4b6a-46b6-9c6f-f41f5b1474af None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.949172 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc98664-4b6a-46b6-9c6f-f41f5b1474af None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.949951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc98664-4b6a-46b6-9c6f-f41f5b1474af None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:39.951546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc98664-4b6a-46b6-9c6f-f41f5b1474af None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-bcc98664-4b6a-46b6-9c6f-f41f5b1474af None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:39.961738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:39.962784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:39.963616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:39.966366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 441/876] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:39.978499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e0c9c-54de-4078-b31b-c4dd7843daf6 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:40.102461 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e0c9c-54de-4078-b31b-c4dd7843daf6 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:40.139977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844519b4-f1f2-4b0a-9007-7e3ada2b7a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.140590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844519b4-f1f2-4b0a-9007-7e3ada2b7a0d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.140873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844519b4-f1f2-4b0a-9007-7e3ada2b7a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.141145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844519b4-f1f2-4b0a-9007-7e3ada2b7a0d None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.141780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844519b4-f1f2-4b0a-9007-7e3ada2b7a0d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:40.142083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844519b4-f1f2-4b0a-9007-7e3ada2b7a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:40.143543 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844519b4-f1f2-4b0a-9007-7e3ada2b7a0d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:40.149252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 436/877] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:40.154862 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc98664-4b6a-46b6-9c6f-f41f5b1474af None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:40.184334 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:40.275755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc98664-4b6a-46b6-9c6f-f41f5b1474af None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:40.315765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399053c-943d-4935-9008-2b1c339d2792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.316634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399053c-943d-4935-9008-2b1c339d2792 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.317061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399053c-943d-4935-9008-2b1c339d2792 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.317504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399053c-943d-4935-9008-2b1c339d2792 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.318328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399053c-943d-4935-9008-2b1c339d2792 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:40.318776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399053c-943d-4935-9008-2b1c339d2792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:40.320891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399053c-943d-4935-9008-2b1c339d2792 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:40.327646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 442/878] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:40.338255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844519b4-f1f2-4b0a-9007-7e3ada2b7a0d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:40.366450 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:40.524957 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844519b4-f1f2-4b0a-9007-7e3ada2b7a0d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:40.593858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df88a7-1ab7-4860-a46d-d20a7e0ac4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.595084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df88a7-1ab7-4860-a46d-d20a7e0ac4fa None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.595560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df88a7-1ab7-4860-a46d-d20a7e0ac4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.596032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df88a7-1ab7-4860-a46d-d20a7e0ac4fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.597378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df88a7-1ab7-4860-a46d-d20a7e0ac4fa None admin] RBAC: Adding query filter params (interface=public, service_id=43c8c29841944b2a8e3c133805edfc24, region_id=RegionOne) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:40.597937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df88a7-1ab7-4860-a46d-d20a7e0ac4fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:40.600580 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df88a7-1ab7-4860-a46d-d20a7e0ac4fa None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:40.611912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 437/879] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Aug 29 20:08:40 2022] GET /identity/v3/endpoints?service_id=43c8c29841944b2a8e3c133805edfc24&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:40.617947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399053c-943d-4935-9008-2b1c339d2792 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:40.761566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a4a58-25ef-4e40-a3fd-54939efbe5a0 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.761904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a4a58-25ef-4e40-a3fd-54939efbe5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.762108 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a4a58-25ef-4e40-a3fd-54939efbe5a0 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.763912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 438/880] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:40.769557 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a5d9f-7ac9-4f73-a6c7-a0334dd3215e None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.769882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a5d9f-7ac9-4f73-a6c7-a0334dd3215e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.770107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a5d9f-7ac9-4f73-a6c7-a0334dd3215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.793402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:40.800693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a56a5d9f-7ac9-4f73-a6c7-a0334dd3215e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:40.803148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a56a5d9f-7ac9-4f73-a6c7-a0334dd3215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:40.811084 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399053c-943d-4935-9008-2b1c339d2792 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:40.850139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a65286-8478-496e-8d5e-61936002ada9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.850863 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a65286-8478-496e-8d5e-61936002ada9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.851657 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a65286-8478-496e-8d5e-61936002ada9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.851931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a65286-8478-496e-8d5e-61936002ada9 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.853066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a65286-8478-496e-8d5e-61936002ada9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:40.854306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a65286-8478-496e-8d5e-61936002ada9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:40.861015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 443/881] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Aug 29 20:08:40 2022] GET /identity/v3/services => generated 1011 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:08:40.912198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 439/882] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:40 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:41.190078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a65286-8478-496e-8d5e-61936002ada9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.307896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a65286-8478-496e-8d5e-61936002ada9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:41.354561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8c937-adcc-426e-8884-823d49660323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:41.355452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8c937-adcc-426e-8884-823d49660323 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.355878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8c937-adcc-426e-8884-823d49660323 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.356285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8c937-adcc-426e-8884-823d49660323 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.373225 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8c937-adcc-426e-8884-823d49660323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-ebb8c937-adcc-426e-8884-823d49660323 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:41.378629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:41.379623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:41.380447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 444/883] 10.222.0.81 () {56 vars in 1120 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:41.386187 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a5d9f-7ac9-4f73-a6c7-a0334dd3215e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.408474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:41.475687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8ab68-b545-496d-adb0-b4e3f0011299 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.475950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8ab68-b545-496d-adb0-b4e3f0011299 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.476137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8ab68-b545-496d-adb0-b4e3f0011299 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.479340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 445/884] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:41.485987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e9874-8997-432d-b40e-edbd9e6fdf85 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.486339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e9874-8997-432d-b40e-edbd9e6fdf85 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.486774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e9874-8997-432d-b40e-edbd9e6fdf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.512246 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2b6e9874-8997-432d-b40e-edbd9e6fdf85 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:41.514728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2b6e9874-8997-432d-b40e-edbd9e6fdf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:41.520944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:41.522455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a5d9f-7ac9-4f73-a6c7-a0334dd3215e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:41.571364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e59ae-293d-4dd7-965f-278bf31869c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:41.572424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e59ae-293d-4dd7-965f-278bf31869c5 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.572939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e59ae-293d-4dd7-965f-278bf31869c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.573426 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e59ae-293d-4dd7-965f-278bf31869c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.574455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e59ae-293d-4dd7-965f-278bf31869c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:41.574988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e59ae-293d-4dd7-965f-278bf31869c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:41.576647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e59ae-293d-4dd7-965f-278bf31869c5 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:41.592111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 440/885] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:41.593491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e59ae-293d-4dd7-965f-278bf31869c5 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.611261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 446/886] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:41.612798 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d4fa-dd69-49e7-9c31-aa8fa5f81643 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.613184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d4fa-dd69-49e7-9c31-aa8fa5f81643 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.613386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d4fa-dd69-49e7-9c31-aa8fa5f81643 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.614924 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 447/887] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:41.621460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06df73e-70c2-4ca5-b04c-b02a896b6fbb None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.621775 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06df73e-70c2-4ca5-b04c-b02a896b6fbb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.622015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06df73e-70c2-4ca5-b04c-b02a896b6fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.642457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f06df73e-70c2-4ca5-b04c-b02a896b6fbb None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:41.644072 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f06df73e-70c2-4ca5-b04c-b02a896b6fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:41.739036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e59ae-293d-4dd7-965f-278bf31869c5 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:41.747835 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 448/888] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:41.750676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:41.791473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c0780-d866-410a-911c-fd3ed11ef803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:41.792474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c0780-d866-410a-911c-fd3ed11ef803 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.792772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c0780-d866-410a-911c-fd3ed11ef803 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.793043 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c0780-d866-410a-911c-fd3ed11ef803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.805748 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c0780-d866-410a-911c-fd3ed11ef803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:41.807383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c0780-d866-410a-911c-fd3ed11ef803 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-4e3c0780-d866-410a-911c-fd3ed11ef803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:41.825046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:41.826075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:41.826997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:41.826997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:41.826997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:41.826997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 441/889] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:41.836188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06df73e-70c2-4ca5-b04c-b02a896b6fbb None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.945868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:41.970099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c0780-d866-410a-911c-fd3ed11ef803 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.991380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06df73e-70c2-4ca5-b04c-b02a896b6fbb None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:42.034255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd9056-a6f7-4f5e-90cf-2b0b15a37fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:42.035035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd9056-a6f7-4f5e-90cf-2b0b15a37fcc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:42.035316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd9056-a6f7-4f5e-90cf-2b0b15a37fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:42.035587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd9056-a6f7-4f5e-90cf-2b0b15a37fcc None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:42.036353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd9056-a6f7-4f5e-90cf-2b0b15a37fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:42.036662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd9056-a6f7-4f5e-90cf-2b0b15a37fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:42.038340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd9056-a6f7-4f5e-90cf-2b0b15a37fcc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:42.057124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 449/890] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:42.058321 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd9056-a6f7-4f5e-90cf-2b0b15a37fcc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:42.112789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c0780-d866-410a-911c-fd3ed11ef803 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:42.151419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:42.158017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2a8c9-2d1c-433f-b40b-46e9bef85593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:42.158820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2a8c9-2d1c-433f-b40b-46e9bef85593 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:42.159186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2a8c9-2d1c-433f-b40b-46e9bef85593 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:42.159529 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2a8c9-2d1c-433f-b40b-46e9bef85593 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:42.160471 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2a8c9-2d1c-433f-b40b-46e9bef85593 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:42.161983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2a8c9-2d1c-433f-b40b-46e9bef85593 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-49a2a8c9-2d1c-433f-b40b-46e9bef85593 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:42.173105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:42.175339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:42.177213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 442/891] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:42.179166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2a8c9-2d1c-433f-b40b-46e9bef85593 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:42.218304 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd9056-a6f7-4f5e-90cf-2b0b15a37fcc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:42.259097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:42.269985 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23bbd7-1e41-4e4a-8259-8e1166867bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:42.274598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23bbd7-1e41-4e4a-8259-8e1166867bfd None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:42.274598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23bbd7-1e41-4e4a-8259-8e1166867bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:42.274598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23bbd7-1e41-4e4a-8259-8e1166867bfd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:42.288741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23bbd7-1e41-4e4a-8259-8e1166867bfd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:42.291657 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23bbd7-1e41-4e4a-8259-8e1166867bfd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-ef23bbd7-1e41-4e4a-8259-8e1166867bfd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:42.316385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:42.317547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:42.318512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:42.318512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:42.318512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:42.318512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:42.318512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:42.318512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:42.318512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:42.318512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:42.318512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:42.318512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:42.318512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 450/892] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Aug 29 20:08:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:42.320187 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23bbd7-1e41-4e4a-8259-8e1166867bfd None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:42.338834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2a8c9-2d1c-433f-b40b-46e9bef85593 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:42.405934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30858770-d2a9-4255-93ef-17914ba59a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:42.407030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30858770-d2a9-4255-93ef-17914ba59a9f None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:42.407531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30858770-d2a9-4255-93ef-17914ba59a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:42.408072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30858770-d2a9-4255-93ef-17914ba59a9f None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:42.409275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30858770-d2a9-4255-93ef-17914ba59a9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:42.411955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30858770-d2a9-4255-93ef-17914ba59a9f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:42.478799 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23bbd7-1e41-4e4a-8259-8e1166867bfd None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:42.524697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47845b04-aec1-4476-885c-635a581bed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:42.525432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47845b04-aec1-4476-885c-635a581bed27 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:42.525725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47845b04-aec1-4476-885c-635a581bed27 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:42.526034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47845b04-aec1-4476-885c-635a581bed27 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:42.526712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47845b04-aec1-4476-885c-635a581bed27 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:42.527013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47845b04-aec1-4476-885c-635a581bed27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:42.534544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 443/893] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:08:42 2022] POST /identity/v3/services => generated 269 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:42.534745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47845b04-aec1-4476-885c-635a581bed27 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:42.534890 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30858770-d2a9-4255-93ef-17914ba59a9f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:42.544025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 451/894] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:42.551561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47845b04-aec1-4476-885c-635a581bed27 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:42.639556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:42.672349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:42.746003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47845b04-aec1-4476-885c-635a581bed27 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:42.793250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30858770-d2a9-4255-93ef-17914ba59a9f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:42.808552 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ac78f-fa78-40e4-971f-f5779a1528fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:42.809655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ac78f-fa78-40e4-971f-f5779a1528fd None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:42.810149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ac78f-fa78-40e4-971f-f5779a1528fd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:42.811755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ac78f-fa78-40e4-971f-f5779a1528fd None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:42.812973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ac78f-fa78-40e4-971f-f5779a1528fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:42.813601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ac78f-fa78-40e4-971f-f5779a1528fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:42.816023 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ac78f-fa78-40e4-971f-f5779a1528fd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:42.824214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 452/895] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:42.859630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bd112-d33e-4baa-890e-7606b43b47ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:42.860699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bd112-d33e-4baa-890e-7606b43b47ad None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:42.861221 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bd112-d33e-4baa-890e-7606b43b47ad None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:42.861726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bd112-d33e-4baa-890e-7606b43b47ad None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:42.863081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bd112-d33e-4baa-890e-7606b43b47ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:42.863651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bd112-d33e-4baa-890e-7606b43b47ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:42.866320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bd112-d33e-4baa-890e-7606b43b47ad None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:42.903421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 444/896] 10.222.0.81 () {56 vars in 1149 bytes} [Mon Aug 29 20:08:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:42.916563 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ac78f-fa78-40e4-971f-f5779a1528fd None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:42.968187 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed672b-7ff2-4653-838f-d70c89afd86f None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:42.968635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed672b-7ff2-4653-838f-d70c89afd86f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:42.968939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed672b-7ff2-4653-838f-d70c89afd86f None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:42.971120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 445/897] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:42.977604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e70292-2a2d-4355-9912-f7364bb90765 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:42.977922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e70292-2a2d-4355-9912-f7364bb90765 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:42.978436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e70292-2a2d-4355-9912-f7364bb90765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:43.005905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-93e70292-2a2d-4355-9912-f7364bb90765 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:43.008633 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-93e70292-2a2d-4355-9912-f7364bb90765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:43.095606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ac78f-fa78-40e4-971f-f5779a1528fd None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:43.132019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:43.153476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165ab88-3f30-4518-b2b3-a14af35c9b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:43.154104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165ab88-3f30-4518-b2b3-a14af35c9b32 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:43.156618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165ab88-3f30-4518-b2b3-a14af35c9b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:43.156618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165ab88-3f30-4518-b2b3-a14af35c9b32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:43.160975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 446/898] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:43.234626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165ab88-3f30-4518-b2b3-a14af35c9b32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:43.236116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165ab88-3f30-4518-b2b3-a14af35c9b32 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:43.348342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 453/899] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:42 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:08:43.356390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e70292-2a2d-4355-9912-f7364bb90765 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:43.410123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:43.482794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165ab88-3f30-4518-b2b3-a14af35c9b32 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:43.510147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e70292-2a2d-4355-9912-f7364bb90765 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:43.514763 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:43.551479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208e5f-8258-43f6-8663-a4cbfad33d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:43.552151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208e5f-8258-43f6-8663-a4cbfad33d4c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:43.552432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208e5f-8258-43f6-8663-a4cbfad33d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:43.552808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208e5f-8258-43f6-8663-a4cbfad33d4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:43.565970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd208e5f-8258-43f6-8663-a4cbfad33d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:43.567720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd208e5f-8258-43f6-8663-a4cbfad33d4c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-cd208e5f-8258-43f6-8663-a4cbfad33d4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:43.584424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:43.586908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:43.588721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:43.588721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:43.588721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:43.591084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 447/900] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:43.592143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208e5f-8258-43f6-8663-a4cbfad33d4c None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:43.696000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165ab88-3f30-4518-b2b3-a14af35c9b32 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:43.721613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:43.732135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208e5f-8258-43f6-8663-a4cbfad33d4c None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:43.769265 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2758e7-96e0-49af-9de7-8429e97ce0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:43.770640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2758e7-96e0-49af-9de7-8429e97ce0ea None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:43.771272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2758e7-96e0-49af-9de7-8429e97ce0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:43.771864 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2758e7-96e0-49af-9de7-8429e97ce0ea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:43.773389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2758e7-96e0-49af-9de7-8429e97ce0ea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:43.774627 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907879d-0edb-4588-bfef-20465a8d0180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:43.775501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907879d-0edb-4588-bfef-20465a8d0180 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:43.775949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907879d-0edb-4588-bfef-20465a8d0180 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:43.776182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2758e7-96e0-49af-9de7-8429e97ce0ea None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:43.776632 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907879d-0edb-4588-bfef-20465a8d0180 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:43.777878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907879d-0edb-4588-bfef-20465a8d0180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:43.778579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907879d-0edb-4588-bfef-20465a8d0180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:43.781761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907879d-0edb-4588-bfef-20465a8d0180 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2e2758e7-96e0-49af-9de7-8429e97ce0ea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:43.797287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:43.798426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:43.799269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:43.806694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 448/901] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:43.806973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 454/902] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:43.808840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2758e7-96e0-49af-9de7-8429e97ce0ea None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:43.810681 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907879d-0edb-4588-bfef-20465a8d0180 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:43.931593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907879d-0edb-4588-bfef-20465a8d0180 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:43.967168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:43.975154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c84c8-22c9-40f8-89ea-952b2970bf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:43.976108 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c84c8-22c9-40f8-89ea-952b2970bf41 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:43.976579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c84c8-22c9-40f8-89ea-952b2970bf41 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:43.977068 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c84c8-22c9-40f8-89ea-952b2970bf41 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:43.978064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c84c8-22c9-40f8-89ea-952b2970bf41 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:43.978608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c84c8-22c9-40f8-89ea-952b2970bf41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:43.980255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c84c8-22c9-40f8-89ea-952b2970bf41 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:43.986181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 449/903] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:43.992250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c84c8-22c9-40f8-89ea-952b2970bf41 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:43.996572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2758e7-96e0-49af-9de7-8429e97ce0ea None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:44.017674 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:44.050085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7969-56e0-4810-aaba-e90364ffdc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:44.050998 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7969-56e0-4810-aaba-e90364ffdc58 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.051395 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7969-56e0-4810-aaba-e90364ffdc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.051795 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7969-56e0-4810-aaba-e90364ffdc58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.062160 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e7969-56e0-4810-aaba-e90364ffdc58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:44.064205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e7969-56e0-4810-aaba-e90364ffdc58 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-f58e7969-56e0-4810-aaba-e90364ffdc58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:44.081692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:44.082718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:44.083586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:44.083586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:44.083586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:44.083586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:44.083586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:44.083586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:44.083586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:44.083586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:44.086359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 455/904] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:44.089841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7969-56e0-4810-aaba-e90364ffdc58 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:44.142945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c84c8-22c9-40f8-89ea-952b2970bf41 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:44.186441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b7d8a-9023-4bdf-bf72-a5677bd69803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:44.187546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b7d8a-9023-4bdf-bf72-a5677bd69803 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.188037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b7d8a-9023-4bdf-bf72-a5677bd69803 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.188560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b7d8a-9023-4bdf-bf72-a5677bd69803 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.189486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b7d8a-9023-4bdf-bf72-a5677bd69803 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:44.190001 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b7d8a-9023-4bdf-bf72-a5677bd69803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:44.191683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b7d8a-9023-4bdf-bf72-a5677bd69803 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:44.198996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 450/905] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:44.209289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b7d8a-9023-4bdf-bf72-a5677bd69803 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:44.245587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7969-56e0-4810-aaba-e90364ffdc58 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:44.295020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae75c1-12bb-445a-a6b6-392331beabb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:44.295707 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae75c1-12bb-445a-a6b6-392331beabb0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.295992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae75c1-12bb-445a-a6b6-392331beabb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.296268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae75c1-12bb-445a-a6b6-392331beabb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.297092 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae75c1-12bb-445a-a6b6-392331beabb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:44.297402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae75c1-12bb-445a-a6b6-392331beabb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:44.298942 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae75c1-12bb-445a-a6b6-392331beabb0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:44.322505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 456/906] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:44.328352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae75c1-12bb-445a-a6b6-392331beabb0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:44.331804 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:44.406188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:44.432795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b7d8a-9023-4bdf-bf72-a5677bd69803 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:44.486115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea8bc1-b1d7-4ecc-a00d-6f06906965ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:44.487143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea8bc1-b1d7-4ecc-a00d-6f06906965ef None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.487661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea8bc1-b1d7-4ecc-a00d-6f06906965ef None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.488125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea8bc1-b1d7-4ecc-a00d-6f06906965ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.489020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea8bc1-b1d7-4ecc-a00d-6f06906965ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:44.490637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea8bc1-b1d7-4ecc-a00d-6f06906965ef None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:44.529346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae75c1-12bb-445a-a6b6-392331beabb0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:44.578249 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8da782-d6ba-430d-a1f4-84ccd090fc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:44.578966 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8da782-d6ba-430d-a1f4-84ccd090fc9f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.579178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8da782-d6ba-430d-a1f4-84ccd090fc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.579506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8da782-d6ba-430d-a1f4-84ccd090fc9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.580127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8da782-d6ba-430d-a1f4-84ccd090fc9f None admin] RBAC: Adding query filter params (role.id=cc4a817595fc4a5abef6fa6a8660cbf8, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=2a96ca7980a54be5bee6aae4bb54b664) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:44.580410 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8da782-d6ba-430d-a1f4-84ccd090fc9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:44.581871 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8da782-d6ba-430d-a1f4-84ccd090fc9f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:44.590279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 457/907] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:44 2022] GET /identity/v3/role_assignments?user.id=2a96ca7980a54be5bee6aae4bb54b664&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=cc4a817595fc4a5abef6fa6a8660cbf8 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:44.629769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 451/908] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:08:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:08:44.977231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24774a9b-74bc-40ae-bec7-3a28655cfb27 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.977804 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24774a9b-74bc-40ae-bec7-3a28655cfb27 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.977804 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24774a9b-74bc-40ae-bec7-3a28655cfb27 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.979478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 458/909] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:44.985423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dffce-94d4-42fb-83d7-af8bc1bbd55d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.985715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dffce-94d4-42fb-83d7-af8bc1bbd55d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.985967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dffce-94d4-42fb-83d7-af8bc1bbd55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:45.006212 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e76dffce-94d4-42fb-83d7-af8bc1bbd55d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:45.008177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e76dffce-94d4-42fb-83d7-af8bc1bbd55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:45.095703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 452/910] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:45.178738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c547c4-37bd-47ac-af61-305ef9148e2b None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:45.179600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c547c4-37bd-47ac-af61-305ef9148e2b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:45.179880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c547c4-37bd-47ac-af61-305ef9148e2b None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:45.181850 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 459/911] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:45.189482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb0dae-411d-42c5-b787-1b97d96d9030 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:45.189813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb0dae-411d-42c5-b787-1b97d96d9030 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:45.190173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb0dae-411d-42c5-b787-1b97d96d9030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:45.216088 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-82bb0dae-411d-42c5-b787-1b97d96d9030 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:45.218064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-82bb0dae-411d-42c5-b787-1b97d96d9030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:45.322392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:45.348766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 453/912] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:45.494809 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c547c4-37bd-47ac-af61-305ef9148e2b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:45.589802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:45.632400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c547c4-37bd-47ac-af61-305ef9148e2b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:45.675117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cdcc6-b6de-4ec5-8182-8ac8b0b10e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:45.675742 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cdcc6-b6de-4ec5-8182-8ac8b0b10e85 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:45.676018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cdcc6-b6de-4ec5-8182-8ac8b0b10e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:45.676285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cdcc6-b6de-4ec5-8182-8ac8b0b10e85 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:45.676944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cdcc6-b6de-4ec5-8182-8ac8b0b10e85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:45.678340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cdcc6-b6de-4ec5-8182-8ac8b0b10e85 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:45.765349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 460/913] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:08:45 2022] POST /identity/v3/services => generated 241 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:45.841503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb0dae-411d-42c5-b787-1b97d96d9030 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:46.002213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb0dae-411d-42c5-b787-1b97d96d9030 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:46.060530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8e637-89ce-4863-aa41-67a00653cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:46.061193 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8e637-89ce-4863-aa41-67a00653cd6e None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.061470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8e637-89ce-4863-aa41-67a00653cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.061739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8e637-89ce-4863-aa41-67a00653cd6e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.062390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8e637-89ce-4863-aa41-67a00653cd6e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:46.063909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8e637-89ce-4863-aa41-67a00653cd6e None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-e1a8e637-89ce-4863-aa41-67a00653cd6e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:46.075219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:46.076237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:46.077132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 454/914] 10.222.0.81 () {56 vars in 1132 bytes} [Mon Aug 29 20:08:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:46.087576 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cdcc6-b6de-4ec5-8182-8ac8b0b10e85 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:46.214869 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cdcc6-b6de-4ec5-8182-8ac8b0b10e85 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:46.248480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:46.258709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64879889-ac49-4ff3-aa09-05352f217e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:46.259335 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64879889-ac49-4ff3-aa09-05352f217e0e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.259610 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64879889-ac49-4ff3-aa09-05352f217e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.259875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64879889-ac49-4ff3-aa09-05352f217e0e None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.260624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64879889-ac49-4ff3-aa09-05352f217e0e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:46.260925 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64879889-ac49-4ff3-aa09-05352f217e0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:46.262346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64879889-ac49-4ff3-aa09-05352f217e0e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:46.268322 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 461/915] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:46.277554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8e637-89ce-4863-aa41-67a00653cd6e None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:46.381610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:46.469096 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8e637-89ce-4863-aa41-67a00653cd6e None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:46.521103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4461a-cf0e-4ed5-a967-393ff9bc0f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:46.522147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4461a-cf0e-4ed5-a967-393ff9bc0f77 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.522673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4461a-cf0e-4ed5-a967-393ff9bc0f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.523687 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4461a-cf0e-4ed5-a967-393ff9bc0f77 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.524865 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4461a-cf0e-4ed5-a967-393ff9bc0f77 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:46.525439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4461a-cf0e-4ed5-a967-393ff9bc0f77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:46.527405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4461a-cf0e-4ed5-a967-393ff9bc0f77 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:46.533905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 455/916] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:46.544442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64879889-ac49-4ff3-aa09-05352f217e0e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:46.746211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64879889-ac49-4ff3-aa09-05352f217e0e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:46.785271 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6f355-4544-4e28-8b06-b0b4c5e7078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:46.785903 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6f355-4544-4e28-8b06-b0b4c5e7078f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.786169 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6f355-4544-4e28-8b06-b0b4c5e7078f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.786473 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6f355-4544-4e28-8b06-b0b4c5e7078f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.787188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6f355-4544-4e28-8b06-b0b4c5e7078f None admin] RBAC: Adding query filter params (interface=public, service_id=c27b9340fcea4cd086a5574fa465407a, region_id=RegionOne) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:46.787492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6f355-4544-4e28-8b06-b0b4c5e7078f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:46.789041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6f355-4544-4e28-8b06-b0b4c5e7078f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:46.796043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 462/917] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Aug 29 20:08:46 2022] GET /identity/v3/endpoints?service_id=c27b9340fcea4cd086a5574fa465407a&interface=public®ion_id=RegionOne => generated 194 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:46.805982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4461a-cf0e-4ed5-a967-393ff9bc0f77 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:46.992153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27259112-7500-4f42-ad84-83d9bd8a9383 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.992634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27259112-7500-4f42-ad84-83d9bd8a9383 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.993116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27259112-7500-4f42-ad84-83d9bd8a9383 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.995555 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 463/918] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:47.001068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a994c04-b308-4a89-8043-5da6202ce21f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.001301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a994c04-b308-4a89-8043-5da6202ce21f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.001563 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a994c04-b308-4a89-8043-5da6202ce21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.018723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4461a-cf0e-4ed5-a967-393ff9bc0f77 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:47.022386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3a994c04-b308-4a89-8043-5da6202ce21f None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:47.024235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3a994c04-b308-4a89-8043-5da6202ce21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:47.056211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:47.081120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62e98a-5ca1-4245-b8ff-fa11237191d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:47.082069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62e98a-5ca1-4245-b8ff-fa11237191d0 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.082606 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62e98a-5ca1-4245-b8ff-fa11237191d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.083229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62e98a-5ca1-4245-b8ff-fa11237191d0 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.084366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62e98a-5ca1-4245-b8ff-fa11237191d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:47.086511 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62e98a-5ca1-4245-b8ff-fa11237191d0 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:47.095679 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 456/919] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Aug 29 20:08:46 2022] GET /identity/v3/services => generated 1497 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:08:47.122276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:47.140894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 464/920] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:47.386380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af48c5-4048-46bd-aada-eccd88781e0a None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.387251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af48c5-4048-46bd-aada-eccd88781e0a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.387911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af48c5-4048-46bd-aada-eccd88781e0a None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.391222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 457/921] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:47.400108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b441496-c6e5-413f-9627-06087d681943 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.400427 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b441496-c6e5-413f-9627-06087d681943 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.400660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b441496-c6e5-413f-9627-06087d681943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.421450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2b441496-c6e5-413f-9627-06087d681943 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:47.423006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2b441496-c6e5-413f-9627-06087d681943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:47.433407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af48c5-4048-46bd-aada-eccd88781e0a None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:47.594447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 465/922] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:47.605095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af48c5-4048-46bd-aada-eccd88781e0a None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:47.666673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f000429-27b1-41a2-8460-ebad8ccabcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:47.667735 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f000429-27b1-41a2-8460-ebad8ccabcc2 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.668230 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f000429-27b1-41a2-8460-ebad8ccabcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.668704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f000429-27b1-41a2-8460-ebad8ccabcc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.669924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f000429-27b1-41a2-8460-ebad8ccabcc2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:47.672656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f000429-27b1-41a2-8460-ebad8ccabcc2 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:47.677412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: WARNING keystone.server.flask.common [None req-0f000429-27b1-41a2-8460-ebad8ccabcc2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 20:08:47.741219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.sql.core [None req-0f000429-27b1-41a2-8460-ebad8ccabcc2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 20:08:47.741219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 20:08:47.741219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [parameters: {'id': '71751ddfc6ce47828fa5ef68234eed2d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 20:08:47.741219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81955) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-0f000429-27b1-41a2-8460-ebad8ccabcc2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 71751ddfc6ce47828fa5ef68234eed2d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 71751ddfc6ce47828fa5ef68234eed2d. Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:08:47.777434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application result.read() Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 20:08:47.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application yield resource Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise self.value Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application session.commit() Aug 29 20:08:47.782617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self.session.flush() Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application compat.raise_( Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 20:08:47.786203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 20:08:47.794092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application result.read() Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:08:47.797411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [parameters: {'id': '71751ddfc6ce47828fa5ef68234eed2d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:47.802858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:47.804805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:47.806947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:47.806947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 20:08:47.806947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 20:08:47.806947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:47.806947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:47.806947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 20:08:47.806947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 20:08:47.806947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 71751ddfc6ce47828fa5ef68234eed2d. Aug 29 20:08:47.806947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:47.806947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 458/923] 10.222.0.81 () {60 vars in 1140 bytes} [Mon Aug 29 20:08:47 2022] POST /identity/v3/projects => generated 262 bytes in 347 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:47.808563 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b441496-c6e5-413f-9627-06087d681943 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:47.958261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b441496-c6e5-413f-9627-06087d681943 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:47.975634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:47.997705 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626138e0-ccca-4dce-84ad-de594e7a23c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:47.998379 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626138e0-ccca-4dce-84ad-de594e7a23c8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.998655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626138e0-ccca-4dce-84ad-de594e7a23c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.998919 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626138e0-ccca-4dce-84ad-de594e7a23c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.006722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626138e0-ccca-4dce-84ad-de594e7a23c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:48.008037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f000429-27b1-41a2-8460-ebad8ccabcc2 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:48.009281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626138e0-ccca-4dce-84ad-de594e7a23c8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-626138e0-ccca-4dce-84ad-de594e7a23c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:48.022631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:48.024722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:48.026636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:48.026636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:48.026636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:48.026636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:48.026636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:48.026636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:48.026636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:48.026636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:48.026636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 466/924] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:48.030892 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626138e0-ccca-4dce-84ad-de594e7a23c8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:48.059213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:48.178876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626138e0-ccca-4dce-84ad-de594e7a23c8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:48.183127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f000429-27b1-41a2-8460-ebad8ccabcc2 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:48.231847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267993b-b391-4947-831a-5eff8be5cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:48.231847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267993b-b391-4947-831a-5eff8be5cf1e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:48.231847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267993b-b391-4947-831a-5eff8be5cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:48.231847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267993b-b391-4947-831a-5eff8be5cf1e None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.232257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267993b-b391-4947-831a-5eff8be5cf1e None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:48.232257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267993b-b391-4947-831a-5eff8be5cf1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:48.232257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267993b-b391-4947-831a-5eff8be5cf1e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:48.243194 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d5a84-d2a8-460f-a8a6-28d30ad7a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:48.243870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d5a84-d2a8-460f-a8a6-28d30ad7a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:48.244152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d5a84-d2a8-460f-a8a6-28d30ad7a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:48.244550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d5a84-d2a8-460f-a8a6-28d30ad7a4c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.254674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 467/925] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:48.267340 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d5a84-d2a8-460f-a8a6-28d30ad7a4c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-298d5a84-d2a8-460f-a8a6-28d30ad7a4c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:48.274054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:48.278935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:48.279783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 459/926] 10.222.0.81 () {56 vars in 1120 bytes} [Mon Aug 29 20:08:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:48.287605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267993b-b391-4947-831a-5eff8be5cf1e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:48.328647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:48.479028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e93dcb-5497-47d5-8803-e150ef66f045 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:48.479302 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267993b-b391-4947-831a-5eff8be5cf1e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:48.479529 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e93dcb-5497-47d5-8803-e150ef66f045 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:48.479979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e93dcb-5497-47d5-8803-e150ef66f045 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.491197 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 460/927] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:48 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:48.496667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e57a3a-7890-4f54-abeb-390254222489 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:48.496941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e57a3a-7890-4f54-abeb-390254222489 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:48.497273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e57a3a-7890-4f54-abeb-390254222489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.528288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-c4e57a3a-7890-4f54-abeb-390254222489 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:48.529933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c4e57a3a-7890-4f54-abeb-390254222489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:48.534762 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182b371-a9cf-4333-976d-f8622cc81e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:48.535634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182b371-a9cf-4333-976d-f8622cc81e77 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:48.536044 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182b371-a9cf-4333-976d-f8622cc81e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:48.536440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182b371-a9cf-4333-976d-f8622cc81e77 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.537280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182b371-a9cf-4333-976d-f8622cc81e77 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:48.537717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182b371-a9cf-4333-976d-f8622cc81e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:48.540114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182b371-a9cf-4333-976d-f8622cc81e77 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:48.549891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 468/928] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Aug 29 20:08:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:48.557759 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182b371-a9cf-4333-976d-f8622cc81e77 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:48.649932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 461/929] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:48.677718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:48.686888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182b371-a9cf-4333-976d-f8622cc81e77 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:48.727381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da3050-9fca-45ea-90fa-d1d00147cd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:48.728178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da3050-9fca-45ea-90fa-d1d00147cd28 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:48.728652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da3050-9fca-45ea-90fa-d1d00147cd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:48.729116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da3050-9fca-45ea-90fa-d1d00147cd28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.743996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da3050-9fca-45ea-90fa-d1d00147cd28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:48.745410 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da3050-9fca-45ea-90fa-d1d00147cd28 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-d6da3050-9fca-45ea-90fa-d1d00147cd28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:48.761540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:48.762681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:48.763566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:48.763566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:48.763566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:48.763566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 469/930] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:48.770241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e57a3a-7890-4f54-abeb-390254222489 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:48.802949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:48.885448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e57a3a-7890-4f54-abeb-390254222489 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:48.943410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1052c4f-3536-4434-b369-5dd7cbdf75b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:48.945052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052c4f-3536-4434-b369-5dd7cbdf75b6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:48.945856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052c4f-3536-4434-b369-5dd7cbdf75b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:48.946639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052c4f-3536-4434-b369-5dd7cbdf75b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.948180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1052c4f-3536-4434-b369-5dd7cbdf75b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:48.949024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1052c4f-3536-4434-b369-5dd7cbdf75b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:48.952206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1052c4f-3536-4434-b369-5dd7cbdf75b6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:48.975273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da3050-9fca-45ea-90fa-d1d00147cd28 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:48.982582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 462/931] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:48.987184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1052c4f-3536-4434-b369-5dd7cbdf75b6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:49.137202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:49.156279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1052c4f-3536-4434-b369-5dd7cbdf75b6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:49.175040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da3050-9fca-45ea-90fa-d1d00147cd28 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:49.207651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac052a-f489-4418-a7a7-698fb38e6c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:49.208872 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac052a-f489-4418-a7a7-698fb38e6c51 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.209447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac052a-f489-4418-a7a7-698fb38e6c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.210027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac052a-f489-4418-a7a7-698fb38e6c51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.225987 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac052a-f489-4418-a7a7-698fb38e6c51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:49.229320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac052a-f489-4418-a7a7-698fb38e6c51 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:49.231438 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02cda-2f73-49b7-935e-5e7429b141e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:49.233043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02cda-2f73-49b7-935e-5e7429b141e5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.233515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02cda-2f73-49b7-935e-5e7429b141e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.233966 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02cda-2f73-49b7-935e-5e7429b141e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.235509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b02cda-2f73-49b7-935e-5e7429b141e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:49.237153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b02cda-2f73-49b7-935e-5e7429b141e5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-f1b02cda-2f73-49b7-935e-5e7429b141e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:49.248194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:49.249233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:49.250068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:49.253066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 470/932] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-24ac052a-f489-4418-a7a7-698fb38e6c51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:49.260764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:49.261861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:49.263255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:49.263255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:49.263255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:49.263255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:49.263255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:49.263255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:49.263255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:49.263255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:49.263255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:49.263255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:49.263805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 463/933] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Aug 29 20:08:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:49.269987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02cda-2f73-49b7-935e-5e7429b141e5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:49.270601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac052a-f489-4418-a7a7-698fb38e6c51 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:49.296598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:49.449466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02cda-2f73-49b7-935e-5e7429b141e5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:49.474257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac052a-f489-4418-a7a7-698fb38e6c51 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:49.524120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb5e36-7903-49ec-8032-62f306bba986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:49.525781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb5e36-7903-49ec-8032-62f306bba986 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.526640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb5e36-7903-49ec-8032-62f306bba986 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.527427 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb5e36-7903-49ec-8032-62f306bba986 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.528872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb5e36-7903-49ec-8032-62f306bba986 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:49.529830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb5e36-7903-49ec-8032-62f306bba986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:49.532973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb5e36-7903-49ec-8032-62f306bba986 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:49.550258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076f07f-58e9-41fe-a62c-842226b1a23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:49.550258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f07f-58e9-41fe-a62c-842226b1a23d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.550258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f07f-58e9-41fe-a62c-842226b1a23d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.550258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f07f-58e9-41fe-a62c-842226b1a23d None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.550948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076f07f-58e9-41fe-a62c-842226b1a23d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:49.550948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076f07f-58e9-41fe-a62c-842226b1a23d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:49.551909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076f07f-58e9-41fe-a62c-842226b1a23d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:49.552234 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 471/934] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:49.555995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb5e36-7903-49ec-8032-62f306bba986 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:49.598268 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 464/935] 10.222.0.81 () {56 vars in 1149 bytes} [Mon Aug 29 20:08:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:49.600036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076f07f-58e9-41fe-a62c-842226b1a23d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:49.607273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:49.702029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:49.731242 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb5e36-7903-49ec-8032-62f306bba986 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:49.773385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7499-5a73-4aa3-acc3-8dbd134785e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:49.774350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7499-5a73-4aa3-acc3-8dbd134785e9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.774630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7499-5a73-4aa3-acc3-8dbd134785e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.774896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7499-5a73-4aa3-acc3-8dbd134785e9 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.775481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076f07f-58e9-41fe-a62c-842226b1a23d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:49.775585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea7499-5a73-4aa3-acc3-8dbd134785e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:49.775815 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea7499-5a73-4aa3-acc3-8dbd134785e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:49.777175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea7499-5a73-4aa3-acc3-8dbd134785e9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:49.787743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 472/936] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:49.787743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eaec3-745d-4147-bb33-1845e5d2a43d None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.787743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eaec3-745d-4147-bb33-1845e5d2a43d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.787743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eaec3-745d-4147-bb33-1845e5d2a43d None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.790658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 473/937] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:49.791491 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eaec3-745d-4147-bb33-1845e5d2a43d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:49.828053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd46aa5-936f-4eb5-819d-87ef92df2354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:49.829302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd46aa5-936f-4eb5-819d-87ef92df2354 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.830039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd46aa5-936f-4eb5-819d-87ef92df2354 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.830850 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd46aa5-936f-4eb5-819d-87ef92df2354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.847503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd46aa5-936f-4eb5-819d-87ef92df2354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:49.849052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd46aa5-936f-4eb5-819d-87ef92df2354 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-3cd46aa5-936f-4eb5-819d-87ef92df2354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:49.870163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:49.871812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:49.873249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:49.873249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:49.873249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:49.873249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 465/938] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:49.873249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12616850-ee8e-4385-a683-6cd04e5067af None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.873249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12616850-ee8e-4385-a683-6cd04e5067af None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.873907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12616850-ee8e-4385-a683-6cd04e5067af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.899700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-12616850-ee8e-4385-a683-6cd04e5067af None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:49.900920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-12616850-ee8e-4385-a683-6cd04e5067af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:49.980206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eaec3-745d-4147-bb33-1845e5d2a43d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:49.988694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:50.016936 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 466/939] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:50.019046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12616850-ee8e-4385-a683-6cd04e5067af None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:50.052968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1150b-8175-4b2e-89de-a3d73dc7f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:50.056901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1150b-8175-4b2e-89de-a3d73dc7f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.057456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1150b-8175-4b2e-89de-a3d73dc7f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.057917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1150b-8175-4b2e-89de-a3d73dc7f2d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.059434 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1150b-8175-4b2e-89de-a3d73dc7f2d5 None admin] RBAC: Adding query filter params (interface=public, service_id=4d13987117d24a93a20cf15637018e36, region_id=RegionOne) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:50.060111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1150b-8175-4b2e-89de-a3d73dc7f2d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:50.062796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1150b-8175-4b2e-89de-a3d73dc7f2d5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:50.075416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 474/940] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Aug 29 20:08:49 2022] GET /identity/v3/endpoints?service_id=4d13987117d24a93a20cf15637018e36&interface=public®ion_id=RegionOne => generated 194 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:50.086280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1150b-8175-4b2e-89de-a3d73dc7f2d5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:50.094674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:50.206462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12616850-ee8e-4385-a683-6cd04e5067af None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:50.252707 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1150b-8175-4b2e-89de-a3d73dc7f2d5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:50.261132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fcb97-b829-4a0c-8d43-86b831a01924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:50.261760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fcb97-b829-4a0c-8d43-86b831a01924 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.262070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fcb97-b829-4a0c-8d43-86b831a01924 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.262388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fcb97-b829-4a0c-8d43-86b831a01924 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.262986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fcb97-b829-4a0c-8d43-86b831a01924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:50.263289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fcb97-b829-4a0c-8d43-86b831a01924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:50.264768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fcb97-b829-4a0c-8d43-86b831a01924 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:50.286038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 467/941] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:50.287077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fcb97-b829-4a0c-8d43-86b831a01924 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:50.324815 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669e64c-16f9-406a-8b23-0dfdfa900128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:50.325752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669e64c-16f9-406a-8b23-0dfdfa900128 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.326160 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669e64c-16f9-406a-8b23-0dfdfa900128 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.326570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669e64c-16f9-406a-8b23-0dfdfa900128 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.327313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669e64c-16f9-406a-8b23-0dfdfa900128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:50.329360 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669e64c-16f9-406a-8b23-0dfdfa900128 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:50.344791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 475/942] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/services => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:08:50.344791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669e64c-16f9-406a-8b23-0dfdfa900128 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:50.397142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:50.472704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:50.525285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fcb97-b829-4a0c-8d43-86b831a01924 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:50.536477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669e64c-16f9-406a-8b23-0dfdfa900128 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:50.594007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a123bf6-06b6-49b1-8c2c-a67909cbf001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:50.595241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a123bf6-06b6-49b1-8c2c-a67909cbf001 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.595706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a123bf6-06b6-49b1-8c2c-a67909cbf001 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.596180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a123bf6-06b6-49b1-8c2c-a67909cbf001 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.606105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a123bf6-06b6-49b1-8c2c-a67909cbf001 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:50.607698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a123bf6-06b6-49b1-8c2c-a67909cbf001 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:50.612212 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad315a9c-bd15-4d7d-a1ad-73b101453158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:50.613912 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad315a9c-bd15-4d7d-a1ad-73b101453158 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.614793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad315a9c-bd15-4d7d-a1ad-73b101453158 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.615560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad315a9c-bd15-4d7d-a1ad-73b101453158 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.616708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad315a9c-bd15-4d7d-a1ad-73b101453158 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:50.619323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad315a9c-bd15-4d7d-a1ad-73b101453158 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-0a123bf6-06b6-49b1-8c2c-a67909cbf001 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:50.621376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:50.623759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:50.625984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:50.625984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:50.625984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:50.625984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:50.625984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:50.625984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:50.625984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:50.625984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:50.625984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 468/943] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:50.625984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c69d4a-7467-4555-8dca-9e566c43898f None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.625984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c69d4a-7467-4555-8dca-9e566c43898f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.627342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c69d4a-7467-4555-8dca-9e566c43898f None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.630734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 469/944] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:50.633401 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2833d-b9b7-44c4-84ef-b01aea7173af None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.633721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2833d-b9b7-44c4-84ef-b01aea7173af None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.634738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2833d-b9b7-44c4-84ef-b01aea7173af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-ad315a9c-bd15-4d7d-a1ad-73b101453158 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:50.645308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:50.647256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:50.649583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 476/945] 10.222.0.81 () {56 vars in 1132 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:50.651234 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad315a9c-bd15-4d7d-a1ad-73b101453158 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:50.661472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-4fb2833d-b9b7-44c4-84ef-b01aea7173af None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:50.662710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4fb2833d-b9b7-44c4-84ef-b01aea7173af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:50.751116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 470/946] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:50.752863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2833d-b9b7-44c4-84ef-b01aea7173af None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:50.824619 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:50.901460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad315a9c-bd15-4d7d-a1ad-73b101453158 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:50.969137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:50.976779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bc095-0023-43de-9dc8-2a866e072206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:50.977461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bc095-0023-43de-9dc8-2a866e072206 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.977808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bc095-0023-43de-9dc8-2a866e072206 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.978203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bc095-0023-43de-9dc8-2a866e072206 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.979003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bc095-0023-43de-9dc8-2a866e072206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:50.982876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bc095-0023-43de-9dc8-2a866e072206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:50.983011 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2833d-b9b7-44c4-84ef-b01aea7173af None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:50.983105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bc095-0023-43de-9dc8-2a866e072206 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:50.997289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 477/947] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:51.006336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bc095-0023-43de-9dc8-2a866e072206 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.040442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d40b7a-71d6-4d3e-975f-12f0c93628d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.041181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d40b7a-71d6-4d3e-975f-12f0c93628d8 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.041536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d40b7a-71d6-4d3e-975f-12f0c93628d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.041836 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d40b7a-71d6-4d3e-975f-12f0c93628d8 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.042646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d40b7a-71d6-4d3e-975f-12f0c93628d8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:51.043042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d40b7a-71d6-4d3e-975f-12f0c93628d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.044592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d40b7a-71d6-4d3e-975f-12f0c93628d8 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.050851 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 471/948] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:51.058821 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d40b7a-71d6-4d3e-975f-12f0c93628d8 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.175931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bc095-0023-43de-9dc8-2a866e072206 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.200020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.204865 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d40b7a-71d6-4d3e-975f-12f0c93628d8 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.224273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f53305-d465-43e9-b850-ce1cb3e52aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.225783 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f53305-d465-43e9-b850-ce1cb3e52aa6 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.226871 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f53305-d465-43e9-b850-ce1cb3e52aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.227299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f53305-d465-43e9-b850-ce1cb3e52aa6 None admin] PATH_INFO: `/v3/projects/8e86d23a023e4db497277d055b604ebe/users/2a96ca7980a54be5bee6aae4bb54b664/roles/cc4a817595fc4a5abef6fa6a8660cbf8` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.231029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f53305-d465-43e9-b850-ce1cb3e52aa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e86d23a023e4db497277d055b604ebe, user_id=2a96ca7980a54be5bee6aae4bb54b664, role_id=cc4a817595fc4a5abef6fa6a8660cbf8)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.233244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f53305-d465-43e9-b850-ce1cb3e52aa6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.262675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb3aee-8699-46b5-8ddf-f0bec3270d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.263335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb3aee-8699-46b5-8ddf-f0bec3270d66 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.263562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb3aee-8699-46b5-8ddf-f0bec3270d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.263857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb3aee-8699-46b5-8ddf-f0bec3270d66 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.264499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb3aee-8699-46b5-8ddf-f0bec3270d66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.266004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb3aee-8699-46b5-8ddf-f0bec3270d66 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.312684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.sql.core [None req-cacb3aee-8699-46b5-8ddf-f0bec3270d66 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 20:08:51.312684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 20:08:51.312684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [parameters: {'user_id': '1978641fcb764b678d701d9747ca5e6e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 20:08:51.312684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81955) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-cacb3aee-8699-46b5-8ddf-f0bec3270d66 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application result.read() Aug 29 20:08:51.321397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:08:51.326205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application yield resource Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise self.value Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application session.commit() Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 20:08:51.328217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self.session.flush() Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application compat.raise_( Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 20:08:51.329961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:08:51.333045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application result.read() Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:08:51.337918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [parameters: {'user_id': '1978641fcb764b678d701d9747ca5e6e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:51.341593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 20:08:51.353914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 20:08:51.363335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 20:08:51.363335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 20:08:51.363335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 20:08:51.363335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 20:08:51.363335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 20:08:51.363335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:51.363335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 472/949] 10.222.0.81 () {60 vars in 1131 bytes} [Mon Aug 29 20:08:51 2022] POST /identity/v3/users => generated 160 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:51.365176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 478/950] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:51 2022] PUT /identity/v3/projects/8e86d23a023e4db497277d055b604ebe/users/2a96ca7980a54be5bee6aae4bb54b664/roles/cc4a817595fc4a5abef6fa6a8660cbf8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:51.367044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb3aee-8699-46b5-8ddf-f0bec3270d66 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.367305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f53305-d465-43e9-b850-ce1cb3e52aa6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.476407 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.551623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb3aee-8699-46b5-8ddf-f0bec3270d66 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.562397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f53305-d465-43e9-b850-ce1cb3e52aa6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.621904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7199c-74d9-4bce-9562-2a57ab57450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.622520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7199c-74d9-4bce-9562-2a57ab57450a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.622801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7199c-74d9-4bce-9562-2a57ab57450a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.623071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7199c-74d9-4bce-9562-2a57ab57450a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.629053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d0028-9248-46ec-8b19-de9cd995c851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.630542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d0028-9248-46ec-8b19-de9cd995c851 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.630830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d0028-9248-46ec-8b19-de9cd995c851 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.631103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d0028-9248-46ec-8b19-de9cd995c851 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.631777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d0028-9248-46ec-8b19-de9cd995c851 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:51.632645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d0028-9248-46ec-8b19-de9cd995c851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.634605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d0028-9248-46ec-8b19-de9cd995c851 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.639162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7199c-74d9-4bce-9562-2a57ab57450a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.641391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7199c-74d9-4bce-9562-2a57ab57450a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-e3f7199c-74d9-4bce-9562-2a57ab57450a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:51.657096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:51.658203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:51.659221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:51.659221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:51.659221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:51.659221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:51.659221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:51.659221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:51.659221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:51.659221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:51.659221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:08:51.659221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:51.659772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 473/951] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:51.659855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 479/952] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:51.667196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d0028-9248-46ec-8b19-de9cd995c851 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.668663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7199c-74d9-4bce-9562-2a57ab57450a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.727192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.869448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d0028-9248-46ec-8b19-de9cd995c851 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.888104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7199c-74d9-4bce-9562-2a57ab57450a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.916658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332724-ceee-4ff2-9e24-663a884a273c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.917603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332724-ceee-4ff2-9e24-663a884a273c None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.918475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332724-ceee-4ff2-9e24-663a884a273c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.918905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332724-ceee-4ff2-9e24-663a884a273c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.920304 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.920960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd332724-ceee-4ff2-9e24-663a884a273c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.923814 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd332724-ceee-4ff2-9e24-663a884a273c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.964872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a4a55-b1ba-45e9-b748-9389be216b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.965769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a4a55-b1ba-45e9-b748-9389be216b7b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.966296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a4a55-b1ba-45e9-b748-9389be216b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.966716 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a4a55-b1ba-45e9-b748-9389be216b7b None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.967771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a4a55-b1ba-45e9-b748-9389be216b7b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:51.968274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a4a55-b1ba-45e9-b748-9389be216b7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.970063 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a4a55-b1ba-45e9-b748-9389be216b7b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:52.025696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 480/953] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Aug 29 20:08:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:52.135620 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 474/954] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:08:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:52.782196 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c3ef0-cb7f-49de-bc9e-c11a9f437869 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:52.783072 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c3ef0-cb7f-49de-bc9e-c11a9f437869 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:52.783217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c3ef0-cb7f-49de-bc9e-c11a9f437869 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:52.785858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 481/955] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:52.794906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8e8f-099c-436b-8282-d7f2dd5beb4e None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:52.795651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8e8f-099c-436b-8282-d7f2dd5beb4e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:52.795824 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8e8f-099c-436b-8282-d7f2dd5beb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:52.828785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-5c7d8e8f-099c-436b-8282-d7f2dd5beb4e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:52.831623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5c7d8e8f-099c-436b-8282-d7f2dd5beb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:52.974833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 475/956] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:53.414344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c3ef0-cb7f-49de-bc9e-c11a9f437869 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:53.546769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c3ef0-cb7f-49de-bc9e-c11a9f437869 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:53.591254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce9c3c-f4a2-4d7b-aff3-2023629466bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:53.591899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9c3c-f4a2-4d7b-aff3-2023629466bc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:53.592166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9c3c-f4a2-4d7b-aff3-2023629466bc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:53.592449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9c3c-f4a2-4d7b-aff3-2023629466bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:53.593020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce9c3c-f4a2-4d7b-aff3-2023629466bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:53.594479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce9c3c-f4a2-4d7b-aff3-2023629466bc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-33ce9c3c-f4a2-4d7b-aff3-2023629466bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:53.605432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:53.607477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:53.609161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:53.617173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 482/957] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:53.617505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8e8f-099c-436b-8282-d7f2dd5beb4e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:53.634394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:53.806081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8e8f-099c-436b-8282-d7f2dd5beb4e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:53.872217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1e592-c36a-4161-aec7-f45e65716aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:53.872767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1e592-c36a-4161-aec7-f45e65716aaa None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:53.873046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1e592-c36a-4161-aec7-f45e65716aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:53.873323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1e592-c36a-4161-aec7-f45e65716aaa None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:53.873985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1e592-c36a-4161-aec7-f45e65716aaa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:53.874321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1e592-c36a-4161-aec7-f45e65716aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:53.875706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1e592-c36a-4161-aec7-f45e65716aaa None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:53.889008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 476/958] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:53.890044 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce9c3c-f4a2-4d7b-aff3-2023629466bc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:53.930128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:54.009911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce9c3c-f4a2-4d7b-aff3-2023629466bc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:54.051567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f027f3-6e6c-4229-8a95-08f99dbd0caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:54.052269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f027f3-6e6c-4229-8a95-08f99dbd0caa None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.052547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f027f3-6e6c-4229-8a95-08f99dbd0caa None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.052817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f027f3-6e6c-4229-8a95-08f99dbd0caa None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.054186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f027f3-6e6c-4229-8a95-08f99dbd0caa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:54.054570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f027f3-6e6c-4229-8a95-08f99dbd0caa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:54.056019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f027f3-6e6c-4229-8a95-08f99dbd0caa None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:54.061797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 483/959] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:54.067733 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1e592-c36a-4161-aec7-f45e65716aaa None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:54.099420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0dea0-0f7b-4f58-8bd0-2e72cb46f286 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.099706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0dea0-0f7b-4f58-8bd0-2e72cb46f286 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.099978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0dea0-0f7b-4f58-8bd0-2e72cb46f286 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.101900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 484/960] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:54.107420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61a2b-c4ea-41cc-ac21-9464b9fddc38 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.108218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61a2b-c4ea-41cc-ac21-9464b9fddc38 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.108218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61a2b-c4ea-41cc-ac21-9464b9fddc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.127906 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-46a61a2b-c4ea-41cc-ac21-9464b9fddc38 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:54.129128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-46a61a2b-c4ea-41cc-ac21-9464b9fddc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:54.197175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:54.222996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 485/961] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:54.248800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1e592-c36a-4161-aec7-f45e65716aaa None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:54.312127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee91ac6-372b-4148-b8e1-b3644e9014f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:54.313181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee91ac6-372b-4148-b8e1-b3644e9014f4 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.313700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee91ac6-372b-4148-b8e1-b3644e9014f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.314197 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee91ac6-372b-4148-b8e1-b3644e9014f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.315501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee91ac6-372b-4148-b8e1-b3644e9014f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:54.318166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee91ac6-372b-4148-b8e1-b3644e9014f4 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:54.393942 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26089f21-8895-4a3f-8fdb-ff7d62e95c15 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.394131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26089f21-8895-4a3f-8fdb-ff7d62e95c15 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.394447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26089f21-8895-4a3f-8fdb-ff7d62e95c15 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.395840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 486/962] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:54.402641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3562d-546e-429e-a476-743b3724ff4e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.402903 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3562d-546e-429e-a476-743b3724ff4e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.403168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3562d-546e-429e-a476-743b3724ff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.426237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-03b3562d-546e-429e-a476-743b3724ff4e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:54.427576 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-03b3562d-546e-429e-a476-743b3724ff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:54.459018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 477/963] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:08:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:08:54.464878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:54.501552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee91ac6-372b-4148-b8e1-b3644e9014f4 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:54.562306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 487/964] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:54.645222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee91ac6-372b-4148-b8e1-b3644e9014f4 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:54.684309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:54.692722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6a1aa-d5d8-4845-9dcc-3564ba2ae760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:54.693374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6a1aa-d5d8-4845-9dcc-3564ba2ae760 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.693654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6a1aa-d5d8-4845-9dcc-3564ba2ae760 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.701135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6a1aa-d5d8-4845-9dcc-3564ba2ae760 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.707697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6a1aa-d5d8-4845-9dcc-3564ba2ae760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-54d6a1aa-d5d8-4845-9dcc-3564ba2ae760 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:54.713714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:54.714774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:54.715652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 478/965] 10.222.0.81 () {56 vars in 1120 bytes} [Mon Aug 29 20:08:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:54.722350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3562d-546e-429e-a476-743b3724ff4e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:54.840918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3562d-546e-429e-a476-743b3724ff4e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:54.846758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6a1aa-d5d8-4845-9dcc-3564ba2ae760 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:54.890405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ab009-0a22-4f39-8dc7-54b5bf25daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:54.891115 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ab009-0a22-4f39-8dc7-54b5bf25daf6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.891647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ab009-0a22-4f39-8dc7-54b5bf25daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.891929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ab009-0a22-4f39-8dc7-54b5bf25daf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.892677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ab009-0a22-4f39-8dc7-54b5bf25daf6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:54.893139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ab009-0a22-4f39-8dc7-54b5bf25daf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:54.896747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ab009-0a22-4f39-8dc7-54b5bf25daf6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:54.907452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 488/966] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Aug 29 20:08:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:54.913828 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ab009-0a22-4f39-8dc7-54b5bf25daf6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:54.936305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:54.993343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6a1aa-d5d8-4845-9dcc-3564ba2ae760 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:55.052078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ab009-0a22-4f39-8dc7-54b5bf25daf6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:55.057487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffdefc-5212-4f6d-9d26-793219d009b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:55.058428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffdefc-5212-4f6d-9d26-793219d009b0 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:55.058929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffdefc-5212-4f6d-9d26-793219d009b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:55.059404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffdefc-5212-4f6d-9d26-793219d009b0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:55.060482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffdefc-5212-4f6d-9d26-793219d009b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:55.063132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffdefc-5212-4f6d-9d26-793219d009b0 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-10ffdefc-5212-4f6d-9d26-793219d009b0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:55.079355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:55.081484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:55.083299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 479/967] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:55.088674 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffdefc-5212-4f6d-9d26-793219d009b0 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:55.107347 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aef1f1-dbcd-45ee-b8fc-7b94f6979abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:55.108522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aef1f1-dbcd-45ee-b8fc-7b94f6979abf None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:55.109089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aef1f1-dbcd-45ee-b8fc-7b94f6979abf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:55.109665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aef1f1-dbcd-45ee-b8fc-7b94f6979abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:55.132766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aef1f1-dbcd-45ee-b8fc-7b94f6979abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:55.135529 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aef1f1-dbcd-45ee-b8fc-7b94f6979abf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:55.156570 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-a8aef1f1-dbcd-45ee-b8fc-7b94f6979abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:55.165418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:55.171312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:55.173706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:55.173706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:55.173706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:55.173706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 489/968] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:55.175570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aef1f1-dbcd-45ee-b8fc-7b94f6979abf None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:55.222608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffdefc-5212-4f6d-9d26-793219d009b0 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:55.267245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:55.275956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642909c-68ca-406d-8009-372046a7937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:55.276748 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642909c-68ca-406d-8009-372046a7937c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:55.277036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642909c-68ca-406d-8009-372046a7937c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:55.277311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642909c-68ca-406d-8009-372046a7937c None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:55.277960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642909c-68ca-406d-8009-372046a7937c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:55.278892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642909c-68ca-406d-8009-372046a7937c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:55.279757 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642909c-68ca-406d-8009-372046a7937c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:55.287595 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 480/969] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:55.293573 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642909c-68ca-406d-8009-372046a7937c None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:55.307769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aef1f1-dbcd-45ee-b8fc-7b94f6979abf None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:55.351017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974218a5-21f4-47a7-b8d1-60d134c846ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:55.351910 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974218a5-21f4-47a7-b8d1-60d134c846ec None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:55.352241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974218a5-21f4-47a7-b8d1-60d134c846ec None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:55.352519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974218a5-21f4-47a7-b8d1-60d134c846ec None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:55.353191 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974218a5-21f4-47a7-b8d1-60d134c846ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:55.353498 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974218a5-21f4-47a7-b8d1-60d134c846ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:55.354974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974218a5-21f4-47a7-b8d1-60d134c846ec None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:55.370744 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 490/970] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:55.376667 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974218a5-21f4-47a7-b8d1-60d134c846ec None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:55.547649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974218a5-21f4-47a7-b8d1-60d134c846ec None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:55.592535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:55.596860 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642909c-68ca-406d-8009-372046a7937c None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:55.607607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792a00-300d-495e-9a3c-d6f2d1ad3f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:55.608597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792a00-300d-495e-9a3c-d6f2d1ad3f44 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:55.609114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792a00-300d-495e-9a3c-d6f2d1ad3f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:55.609575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792a00-300d-495e-9a3c-d6f2d1ad3f44 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:55.624573 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:55.625051 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33792a00-300d-495e-9a3c-d6f2d1ad3f44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:55.628415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33792a00-300d-495e-9a3c-d6f2d1ad3f44 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:55.650168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4104af-3add-4303-acdd-c71f2b176263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:55.650884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4104af-3add-4303-acdd-c71f2b176263 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:55.651185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4104af-3add-4303-acdd-c71f2b176263 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:55.651461 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4104af-3add-4303-acdd-c71f2b176263 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:55.652117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4104af-3add-4303-acdd-c71f2b176263 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:55.652423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4104af-3add-4303-acdd-c71f2b176263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:55.653833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4104af-3add-4303-acdd-c71f2b176263 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-33792a00-300d-495e-9a3c-d6f2d1ad3f44 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:55.655182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:55.656973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:55.666465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:55.666465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:55.666465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:55.666465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:55.666465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:55.666465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:55.666465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:55.666465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:55.666465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:55.666465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:55.666465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 491/971] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Aug 29 20:08:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:55.666465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792a00-300d-495e-9a3c-d6f2d1ad3f44 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:55.678963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 481/972] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:55.839027 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792a00-300d-495e-9a3c-d6f2d1ad3f44 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:55.882127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048466e6-e10f-49f9-857a-b4b6c33e58d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:55.883099 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048466e6-e10f-49f9-857a-b4b6c33e58d9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:55.883509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048466e6-e10f-49f9-857a-b4b6c33e58d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:55.883912 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048466e6-e10f-49f9-857a-b4b6c33e58d9 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:55.884820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048466e6-e10f-49f9-857a-b4b6c33e58d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:55.885258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048466e6-e10f-49f9-857a-b4b6c33e58d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:55.894637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048466e6-e10f-49f9-857a-b4b6c33e58d9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:55.921826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 492/973] 10.222.0.81 () {56 vars in 1149 bytes} [Mon Aug 29 20:08:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:55.930483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4104af-3add-4303-acdd-c71f2b176263 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:56.061096 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4104af-3add-4303-acdd-c71f2b176263 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:56.099592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18351f8c-2ae8-4ea9-b699-809684dcdc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:56.100120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18351f8c-2ae8-4ea9-b699-809684dcdc3e None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.100403 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18351f8c-2ae8-4ea9-b699-809684dcdc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.100703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18351f8c-2ae8-4ea9-b699-809684dcdc3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.199135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:56.237240 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18351f8c-2ae8-4ea9-b699-809684dcdc3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:56.240951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18351f8c-2ae8-4ea9-b699-809684dcdc3e None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:56.376615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 482/974] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:55 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:08:56.386290 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048466e6-e10f-49f9-857a-b4b6c33e58d9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:56.482154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:56.586525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048466e6-e10f-49f9-857a-b4b6c33e58d9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:56.652781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25af6d-7892-4936-9772-acb4d3acebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:56.653847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25af6d-7892-4936-9772-acb4d3acebd5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.654378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25af6d-7892-4936-9772-acb4d3acebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.654863 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25af6d-7892-4936-9772-acb4d3acebd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.674845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25af6d-7892-4936-9772-acb4d3acebd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:56.677432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25af6d-7892-4936-9772-acb4d3acebd5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-7c25af6d-7892-4936-9772-acb4d3acebd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:56.696049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:56.697937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:56.699843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:56.699843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:56.699843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:56.706915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 493/975] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:56.707327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18351f8c-2ae8-4ea9-b699-809684dcdc3e None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:56.721630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e12e6-e3e2-4165-a4d5-2daee54575dc None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.722299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e12e6-e3e2-4165-a4d5-2daee54575dc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.722817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e12e6-e3e2-4165-a4d5-2daee54575dc None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.726330 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 494/976] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:56.732360 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8dad1-91eb-46a4-93d9-b8febaa8b2a5 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.732638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8dad1-91eb-46a4-93d9-b8febaa8b2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.732915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8dad1-91eb-46a4-93d9-b8febaa8b2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.764266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e3b8dad1-91eb-46a4-93d9-b8febaa8b2a5 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:56.766152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e3b8dad1-91eb-46a4-93d9-b8febaa8b2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:56.816387 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:56.843698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18351f8c-2ae8-4ea9-b699-809684dcdc3e None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:56.872788 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 495/977] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:56.904447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cc2b1-7b1f-4fe9-98ef-08a5dbe3fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:56.905359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cc2b1-7b1f-4fe9-98ef-08a5dbe3fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.905848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cc2b1-7b1f-4fe9-98ef-08a5dbe3fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.906349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cc2b1-7b1f-4fe9-98ef-08a5dbe3fdb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.907550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cc2b1-7b1f-4fe9-98ef-08a5dbe3fdb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:56.908083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cc2b1-7b1f-4fe9-98ef-08a5dbe3fdb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:56.910679 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cc2b1-7b1f-4fe9-98ef-08a5dbe3fdb7 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:56.935274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 483/978] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:56.942995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8dad1-91eb-46a4-93d9-b8febaa8b2a5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:56.981032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:57.068824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8dad1-91eb-46a4-93d9-b8febaa8b2a5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:57.107270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de729621-1b1d-4cd4-800a-5bc241d70ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:57.107914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de729621-1b1d-4cd4-800a-5bc241d70ede None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.108188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de729621-1b1d-4cd4-800a-5bc241d70ede None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.108460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de729621-1b1d-4cd4-800a-5bc241d70ede None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.115844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de729621-1b1d-4cd4-800a-5bc241d70ede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:57.117811 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de729621-1b1d-4cd4-800a-5bc241d70ede None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-de729621-1b1d-4cd4-800a-5bc241d70ede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:57.130135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:57.131100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:57.138653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:57.138653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:57.138653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:57.138653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:57.138653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:57.138653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:57.138653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:57.138653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:08:57.138653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 496/979] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:57.139229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cc2b1-7b1f-4fe9-98ef-08a5dbe3fdb7 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:57.252368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cc2b1-7b1f-4fe9-98ef-08a5dbe3fdb7 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:57.293774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d5918-576c-48bc-8554-17b6082c6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:57.294434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d5918-576c-48bc-8554-17b6082c6e23 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.294732 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d5918-576c-48bc-8554-17b6082c6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.294973 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d5918-576c-48bc-8554-17b6082c6e23 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.295695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d5918-576c-48bc-8554-17b6082c6e23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:57.296023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d5918-576c-48bc-8554-17b6082c6e23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:57.297508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d5918-576c-48bc-8554-17b6082c6e23 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:57.308824 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:57.321638 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 484/980] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:57.324408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de729621-1b1d-4cd4-800a-5bc241d70ede None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:57.391758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d5918-576c-48bc-8554-17b6082c6e23 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:57.493722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:57.515344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de729621-1b1d-4cd4-800a-5bc241d70ede None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:57.561769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fd548-b054-4910-a9c6-c421f5945c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:57.562586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd548-b054-4910-a9c6-c421f5945c23 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.562871 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd548-b054-4910-a9c6-c421f5945c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.563250 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd548-b054-4910-a9c6-c421f5945c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.564215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fd548-b054-4910-a9c6-c421f5945c23 None admin] RBAC: Adding query filter params (role.id=cc4a817595fc4a5abef6fa6a8660cbf8, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=2a96ca7980a54be5bee6aae4bb54b664) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:57.564648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fd548-b054-4910-a9c6-c421f5945c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:57.566459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fd548-b054-4910-a9c6-c421f5945c23 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:57.568129 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d5918-576c-48bc-8554-17b6082c6e23 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:57.576559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 497/981] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:57 2022] GET /identity/v3/role_assignments?user.id=2a96ca7980a54be5bee6aae4bb54b664&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=cc4a817595fc4a5abef6fa6a8660cbf8 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:57.640011 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ac3cb-6e9e-4da2-ac98-bba7cccaec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:57.641703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ac3cb-6e9e-4da2-ac98-bba7cccaec98 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.642572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ac3cb-6e9e-4da2-ac98-bba7cccaec98 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.643419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ac3cb-6e9e-4da2-ac98-bba7cccaec98 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.644889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ac3cb-6e9e-4da2-ac98-bba7cccaec98 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:57.649835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ac3cb-6e9e-4da2-ac98-bba7cccaec98 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-5c4ac3cb-6e9e-4da2-ac98-bba7cccaec98 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:57.669839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:57.672054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:57.673932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:08:57.678543 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 485/982] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:57.680779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fd548-b054-4910-a9c6-c421f5945c23 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:57.869503 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fd548-b054-4910-a9c6-c421f5945c23 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:57.932137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994becd7-088d-41af-b50c-e0f4697a8328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:57.933267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994becd7-088d-41af-b50c-e0f4697a8328 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.933720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994becd7-088d-41af-b50c-e0f4697a8328 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.934193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994becd7-088d-41af-b50c-e0f4697a8328 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.934763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed8e24-97d6-4cf5-b337-64a16c8ebe43 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.935046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed8e24-97d6-4cf5-b337-64a16c8ebe43 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.935314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed8e24-97d6-4cf5-b337-64a16c8ebe43 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.935866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994becd7-088d-41af-b50c-e0f4697a8328 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:57.935866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994becd7-088d-41af-b50c-e0f4697a8328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:57.936802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 486/983] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:57.938401 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994becd7-088d-41af-b50c-e0f4697a8328 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:57.942073 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63685474-8338-4feb-9349-b2f36bb3e4cb None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.942383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63685474-8338-4feb-9349-b2f36bb3e4cb None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.942709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63685474-8338-4feb-9349-b2f36bb3e4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.950138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 498/984] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:57.956683 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994becd7-088d-41af-b50c-e0f4697a8328 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:57.968273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-63685474-8338-4feb-9349-b2f36bb3e4cb None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:57.970096 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-63685474-8338-4feb-9349-b2f36bb3e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:57.979273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:58.053770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:58.072180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 487/985] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:58.088085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994becd7-088d-41af-b50c-e0f4697a8328 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:58.161127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bdfd5-56ca-4ae4-b105-69db330fa373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:58.162131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bdfd5-56ca-4ae4-b105-69db330fa373 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:58.162651 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bdfd5-56ca-4ae4-b105-69db330fa373 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:58.163236 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bdfd5-56ca-4ae4-b105-69db330fa373 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:58.164032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bdfd5-56ca-4ae4-b105-69db330fa373 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:58.164565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bdfd5-56ca-4ae4-b105-69db330fa373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:58.166744 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bdfd5-56ca-4ae4-b105-69db330fa373 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:58.179803 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 499/986] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:58.181283 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63685474-8338-4feb-9349-b2f36bb3e4cb None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:58.339455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63685474-8338-4feb-9349-b2f36bb3e4cb None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:58.363739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bdfd5-56ca-4ae4-b105-69db330fa373 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:58.404772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6210e6-6f03-49a8-954d-3e5a47629263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:58.405433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6210e6-6f03-49a8-954d-3e5a47629263 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:58.405764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6210e6-6f03-49a8-954d-3e5a47629263 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:58.406181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6210e6-6f03-49a8-954d-3e5a47629263 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:58.407207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6210e6-6f03-49a8-954d-3e5a47629263 None admin] RBAC: Adding query filter params (interface=admin, service_id=4d13987117d24a93a20cf15637018e36, region_id=RegionOne) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:58.407518 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6210e6-6f03-49a8-954d-3e5a47629263 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:58.408957 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6210e6-6f03-49a8-954d-3e5a47629263 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:58.417527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 488/987] 10.222.0.81 () {56 vars in 1249 bytes} [Mon Aug 29 20:08:58 2022] GET /identity/v3/endpoints?service_id=4d13987117d24a93a20cf15637018e36&interface=admin®ion_id=RegionOne => generated 193 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:58.423541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6210e6-6f03-49a8-954d-3e5a47629263 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:58.490442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:58.501498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:58.519498 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bdfd5-56ca-4ae4-b105-69db330fa373 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:58.554710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6210e6-6f03-49a8-954d-3e5a47629263 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:58.561828 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa32ee1-f217-4755-b73d-36314dae97ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:58.562479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa32ee1-f217-4755-b73d-36314dae97ae None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:58.562762 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa32ee1-f217-4755-b73d-36314dae97ae None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:58.563068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa32ee1-f217-4755-b73d-36314dae97ae None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:58.563753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa32ee1-f217-4755-b73d-36314dae97ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:58.565139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa32ee1-f217-4755-b73d-36314dae97ae None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:58.603732 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9051e-595f-4dcf-a8a5-5e9753d360ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:58.604352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9051e-595f-4dcf-a8a5-5e9753d360ca None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:58.604635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9051e-595f-4dcf-a8a5-5e9753d360ca None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:58.604916 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9051e-595f-4dcf-a8a5-5e9753d360ca None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:58.605531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9051e-595f-4dcf-a8a5-5e9753d360ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:58.606941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9051e-595f-4dcf-a8a5-5e9753d360ca None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:58.615934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 489/988] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Aug 29 20:08:58 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:08:58.645152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 500/989] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:08:58 2022] POST /identity/v3/services => generated 242 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:59.752599 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310625c-ac76-4d44-b680-ff71ed905bde None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:59.753400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310625c-ac76-4d44-b680-ff71ed905bde None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:59.753400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310625c-ac76-4d44-b680-ff71ed905bde None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:59.758293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 490/990] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:59.764242 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9029d25-b762-4eb9-808c-40d9f4b762a0 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:59.764776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9029d25-b762-4eb9-808c-40d9f4b762a0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:59.765214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9029d25-b762-4eb9-808c-40d9f4b762a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:59.801276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a9029d25-b762-4eb9-808c-40d9f4b762a0 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:59.803428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a9029d25-b762-4eb9-808c-40d9f4b762a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:59.940653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 501/991] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:00.268463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310625c-ac76-4d44-b680-ff71ed905bde None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:00.426956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310625c-ac76-4d44-b680-ff71ed905bde None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:00.474305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:00.496756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f931472-7a27-460c-a8ed-da38205c7e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:00.497845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f931472-7a27-460c-a8ed-da38205c7e79 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.498378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f931472-7a27-460c-a8ed-da38205c7e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.498918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f931472-7a27-460c-a8ed-da38205c7e79 None admin] PATH_INFO: `/v3/services/image` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:00.499987 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f931472-7a27-460c-a8ed-da38205c7e79 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:00.502169 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f931472-7a27-460c-a8ed-da38205c7e79 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-6f931472-7a27-460c-a8ed-da38205c7e79 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:00.520536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:00.521988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:00.524347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:00.530638 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 491/992] 10.222.0.81 () {56 vars in 1105 bytes} [Mon Aug 29 20:09:00 2022] GET /identity/v3/services/image => generated 86 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:00.531751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9029d25-b762-4eb9-808c-40d9f4b762a0 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:00.616786 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:00.680327 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9029d25-b762-4eb9-808c-40d9f4b762a0 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:00.746483 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820e7b1-25f2-497e-a84d-7cd0b2bfc429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:00.747479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820e7b1-25f2-497e-a84d-7cd0b2bfc429 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.747960 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820e7b1-25f2-497e-a84d-7cd0b2bfc429 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.748426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820e7b1-25f2-497e-a84d-7cd0b2bfc429 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:00.749615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820e7b1-25f2-497e-a84d-7cd0b2bfc429 None admin] RBAC: Adding query filter params (name=image) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:00.749973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820e7b1-25f2-497e-a84d-7cd0b2bfc429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:00.752577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820e7b1-25f2-497e-a84d-7cd0b2bfc429 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:00.767394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 502/993] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:00.768924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f931472-7a27-460c-a8ed-da38205c7e79 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:00.890442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e189bb6-13f8-4323-9342-4416ff35f9db None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.890751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e189bb6-13f8-4323-9342-4416ff35f9db None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.891080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e189bb6-13f8-4323-9342-4416ff35f9db None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:00.892778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 503/994] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:00.899545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d353e-a1ea-4f74-b453-7d33ac6af7d6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.899800 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d353e-a1ea-4f74-b453-7d33ac6af7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.900069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d353e-a1ea-4f74-b453-7d33ac6af7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:00.914204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f931472-7a27-460c-a8ed-da38205c7e79 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:00.922383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-694d353e-a1ea-4f74-b453-7d33ac6af7d6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:00.924006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-694d353e-a1ea-4f74-b453-7d33ac6af7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:00.961985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269600c1-14f4-424a-935c-a9033e8d0899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:00.963287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269600c1-14f4-424a-935c-a9033e8d0899 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.963707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269600c1-14f4-424a-935c-a9033e8d0899 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.964117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269600c1-14f4-424a-935c-a9033e8d0899 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:00.965098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269600c1-14f4-424a-935c-a9033e8d0899 None admin] RBAC: Adding query filter params (type=image) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:00.965578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269600c1-14f4-424a-935c-a9033e8d0899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:00.967744 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269600c1-14f4-424a-935c-a9033e8d0899 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:00.973154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 492/995] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:00.975063 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c6e11-03af-4c9f-8f35-8f8b2e40c498 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.976135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c6e11-03af-4c9f-8f35-8f8b2e40c498 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.976557 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c6e11-03af-4c9f-8f35-8f8b2e40c498 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:00.978736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 493/996] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:00.984785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36234ff5-a26a-42aa-9a8f-2652ce6b2e1b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.985208 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36234ff5-a26a-42aa-9a8f-2652ce6b2e1b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.985433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36234ff5-a26a-42aa-9a8f-2652ce6b2e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:01.011746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-36234ff5-a26a-42aa-9a8f-2652ce6b2e1b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:01.013333 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-36234ff5-a26a-42aa-9a8f-2652ce6b2e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:01.018189 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 504/997] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:01.077951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:01.119206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 494/998] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:01.298053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d353e-a1ea-4f74-b453-7d33ac6af7d6 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:01.391287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:01.424993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36234ff5-a26a-42aa-9a8f-2652ce6b2e1b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:01.448449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d353e-a1ea-4f74-b453-7d33ac6af7d6 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:01.493204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8f7cd-0c51-4577-a35a-96c0f397a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:01.494070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8f7cd-0c51-4577-a35a-96c0f397a424 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:01.494207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8f7cd-0c51-4577-a35a-96c0f397a424 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:01.494416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8f7cd-0c51-4577-a35a-96c0f397a424 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:01.495019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8f7cd-0c51-4577-a35a-96c0f397a424 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:01.496486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8f7cd-0c51-4577-a35a-96c0f397a424 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-27c8f7cd-0c51-4577-a35a-96c0f397a424 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:01.507398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:01.508641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:09:01.511595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 505/999] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:09:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:01.516337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8f7cd-0c51-4577-a35a-96c0f397a424 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:01.586531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36234ff5-a26a-42aa-9a8f-2652ce6b2e1b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:01.641566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8f7cd-0c51-4577-a35a-96c0f397a424 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:01.655139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be354ad-62d1-4ebf-8f59-b0705c4786dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:01.656237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be354ad-62d1-4ebf-8f59-b0705c4786dd None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:01.656708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be354ad-62d1-4ebf-8f59-b0705c4786dd None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:01.657419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be354ad-62d1-4ebf-8f59-b0705c4786dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:01.658547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be354ad-62d1-4ebf-8f59-b0705c4786dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:01.661160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be354ad-62d1-4ebf-8f59-b0705c4786dd None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:01.674552 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-0be354ad-62d1-4ebf-8f59-b0705c4786dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:01.679056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:01.681032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:09:01.682857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:01.690320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 495/1000] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Aug 29 20:09:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:01.691337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be354ad-62d1-4ebf-8f59-b0705c4786dd None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:01.698383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc3b2e-be1e-4534-bb70-829cce952315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:01.699042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc3b2e-be1e-4534-bb70-829cce952315 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:01.699320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc3b2e-be1e-4534-bb70-829cce952315 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:01.699594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc3b2e-be1e-4534-bb70-829cce952315 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:01.700244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc3b2e-be1e-4534-bb70-829cce952315 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:01.700647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc3b2e-be1e-4534-bb70-829cce952315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:01.702940 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc3b2e-be1e-4534-bb70-829cce952315 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:01.710699 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 506/1001] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:09:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:01.717961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc3b2e-be1e-4534-bb70-829cce952315 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:01.778439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:01.855581 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc3b2e-be1e-4534-bb70-829cce952315 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:01.872915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be354ad-62d1-4ebf-8f59-b0705c4786dd None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:01.895466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548729c6-2fe4-4cff-9197-8898ba7c778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:01.896082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548729c6-2fe4-4cff-9197-8898ba7c778e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:01.896360 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548729c6-2fe4-4cff-9197-8898ba7c778e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:01.896634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548729c6-2fe4-4cff-9197-8898ba7c778e None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:01.897313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548729c6-2fe4-4cff-9197-8898ba7c778e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:01.897617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548729c6-2fe4-4cff-9197-8898ba7c778e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:01.899377 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548729c6-2fe4-4cff-9197-8898ba7c778e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:01.905329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 507/1002] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:09:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:01.911498 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548729c6-2fe4-4cff-9197-8898ba7c778e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:01.938559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640992c2-c2ae-4011-85dd-c25d2a33ce20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:01.939777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640992c2-c2ae-4011-85dd-c25d2a33ce20 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:01.940274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640992c2-c2ae-4011-85dd-c25d2a33ce20 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:01.940755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640992c2-c2ae-4011-85dd-c25d2a33ce20 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:01.941852 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640992c2-c2ae-4011-85dd-c25d2a33ce20 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:01.942420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640992c2-c2ae-4011-85dd-c25d2a33ce20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:01.946680 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640992c2-c2ae-4011-85dd-c25d2a33ce20 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:01.962169 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 496/1003] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Aug 29 20:09:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:01.964166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640992c2-c2ae-4011-85dd-c25d2a33ce20 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:01.984036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:02.053846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548729c6-2fe4-4cff-9197-8898ba7c778e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:02.097330 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c94f8-1b91-4ef8-b546-e8e67c855692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:02.098346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c94f8-1b91-4ef8-b546-e8e67c855692 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:02.098658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c94f8-1b91-4ef8-b546-e8e67c855692 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:02.098968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c94f8-1b91-4ef8-b546-e8e67c855692 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:02.099923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c94f8-1b91-4ef8-b546-e8e67c855692 None admin] RBAC: Adding query filter params (interface=public, service_id=e83ad9eb41d34278965113d8bbfa649b, region_id=RegionOne) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:02.100539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c94f8-1b91-4ef8-b546-e8e67c855692 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:02.102993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c94f8-1b91-4ef8-b546-e8e67c855692 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:02.110570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 508/1004] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Aug 29 20:09:01 2022] GET /identity/v3/endpoints?service_id=e83ad9eb41d34278965113d8bbfa649b&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:02.116015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c94f8-1b91-4ef8-b546-e8e67c855692 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:02.152352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640992c2-c2ae-4011-85dd-c25d2a33ce20 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:02.163715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:02.197247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb28f49-3f3f-441f-8f3b-ff38a9040297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:02.197880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb28f49-3f3f-441f-8f3b-ff38a9040297 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:02.198159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb28f49-3f3f-441f-8f3b-ff38a9040297 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:02.198462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb28f49-3f3f-441f-8f3b-ff38a9040297 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:02.199116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb28f49-3f3f-441f-8f3b-ff38a9040297 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:02.199427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb28f49-3f3f-441f-8f3b-ff38a9040297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:02.200850 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb28f49-3f3f-441f-8f3b-ff38a9040297 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:02.207872 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 497/1005] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Aug 29 20:09:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:02.214740 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb28f49-3f3f-441f-8f3b-ff38a9040297 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:02.303740 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c94f8-1b91-4ef8-b546-e8e67c855692 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:02.335901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:02.366440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc1ee7-d0db-40ea-a337-fd2e50d6a91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:02.367204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc1ee7-d0db-40ea-a337-fd2e50d6a91a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:02.367660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc1ee7-d0db-40ea-a337-fd2e50d6a91a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:02.368219 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc1ee7-d0db-40ea-a337-fd2e50d6a91a None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:02.372997 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc1ee7-d0db-40ea-a337-fd2e50d6a91a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:02.376248 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc1ee7-d0db-40ea-a337-fd2e50d6a91a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:02.387208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 509/1006] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Aug 29 20:09:02 2022] GET /identity/v3/services => generated 1727 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:09:02.388227 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb28f49-3f3f-441f-8f3b-ff38a9040297 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:02.471921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1d401-317f-4e16-b85b-4ba71983cb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:02.473292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1d401-317f-4e16-b85b-4ba71983cb4e None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:02.473996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1d401-317f-4e16-b85b-4ba71983cb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:02.474747 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1d401-317f-4e16-b85b-4ba71983cb4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:02.476928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1d401-317f-4e16-b85b-4ba71983cb4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:02.479980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1d401-317f-4e16-b85b-4ba71983cb4e None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:02.603628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 498/1007] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:09:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:09:03.148023 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b188e7-761f-4660-af12-c626c58f5bfb None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:03.148627 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b188e7-761f-4660-af12-c626c58f5bfb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:03.148768 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b188e7-761f-4660-af12-c626c58f5bfb None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:03.150460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 510/1008] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:03.156714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d4157-02b0-4886-9290-4a34ce0d091b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:03.157183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d4157-02b0-4886-9290-4a34ce0d091b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:03.157415 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d4157-02b0-4886-9290-4a34ce0d091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:03.181804 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-354d4157-02b0-4886-9290-4a34ce0d091b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:03.183007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-354d4157-02b0-4886-9290-4a34ce0d091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:03.214021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:03.266123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 499/1009] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:03 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:03.552001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b188e7-761f-4660-af12-c626c58f5bfb None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:03.695051 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b188e7-761f-4660-af12-c626c58f5bfb None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:03.740608 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aa09d-3ddb-406e-b333-b3b5357d614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:03.741829 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aa09d-3ddb-406e-b333-b3b5357d614d None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:03.742134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aa09d-3ddb-406e-b333-b3b5357d614d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:03.742458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aa09d-3ddb-406e-b333-b3b5357d614d None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:03.743097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aa09d-3ddb-406e-b333-b3b5357d614d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:03.744543 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aa09d-3ddb-406e-b333-b3b5357d614d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:03.852180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 511/1010] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:09:03 2022] POST /identity/v3/services => generated 242 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:09:04.613637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361c147-6093-41ea-a099-5ac66ae35674 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:04.614464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361c147-6093-41ea-a099-5ac66ae35674 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:04.614464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361c147-6093-41ea-a099-5ac66ae35674 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:04.617130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 500/1011] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:04.622607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5780b04-d287-4d01-814c-0e2988fd9170 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:04.623204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5780b04-d287-4d01-814c-0e2988fd9170 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:04.623204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5780b04-d287-4d01-814c-0e2988fd9170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:04.643181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c5780b04-d287-4d01-814c-0e2988fd9170 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:04.644393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c5780b04-d287-4d01-814c-0e2988fd9170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:04.687613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:04.731015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 512/1012] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:04 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:05.014586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361c147-6093-41ea-a099-5ac66ae35674 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:05.101121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c81081-533a-4f0c-80b2-004e3c95cb4d None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.101618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c81081-533a-4f0c-80b2-004e3c95cb4d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.102078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c81081-533a-4f0c-80b2-004e3c95cb4d None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.106288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 513/1013] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:05.109431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d2b3a-52c0-4777-b931-a52c68f0e4c4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.109718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d2b3a-52c0-4777-b931-a52c68f0e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.110040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d2b3a-52c0-4777-b931-a52c68f0e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.129515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5a8d2b3a-52c0-4777-b931-a52c68f0e4c4 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:05.130745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5a8d2b3a-52c0-4777-b931-a52c68f0e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:05.159432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361c147-6093-41ea-a099-5ac66ae35674 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:05.203470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3693d1-56ba-4517-b248-71194b5a93f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:05.204445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3693d1-56ba-4517-b248-71194b5a93f6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.204922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3693d1-56ba-4517-b248-71194b5a93f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.206274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3693d1-56ba-4517-b248-71194b5a93f6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.206424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 514/1014] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:05 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:05.206516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3693d1-56ba-4517-b248-71194b5a93f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:05.208538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3693d1-56ba-4517-b248-71194b5a93f6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-5f3693d1-56ba-4517-b248-71194b5a93f6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:05.227235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:05.228709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:05.230722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 501/1015] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:09:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:05.235147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d2b3a-52c0-4777-b931-a52c68f0e4c4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:05.373154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:05.382621 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d2b3a-52c0-4777-b931-a52c68f0e4c4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:05.443781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e445d9f-640b-455c-99e6-d0486a4fe294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:05.445112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e445d9f-640b-455c-99e6-d0486a4fe294 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.445614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e445d9f-640b-455c-99e6-d0486a4fe294 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.446143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e445d9f-640b-455c-99e6-d0486a4fe294 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.447424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e445d9f-640b-455c-99e6-d0486a4fe294 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:05.447989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e445d9f-640b-455c-99e6-d0486a4fe294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:05.450733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e445d9f-640b-455c-99e6-d0486a4fe294 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:05.469414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 515/1016] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:09:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:05.471205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3693d1-56ba-4517-b248-71194b5a93f6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:05.517211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:05.528662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e445d9f-640b-455c-99e6-d0486a4fe294 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:05.616451 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3693d1-56ba-4517-b248-71194b5a93f6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:05.654655 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c1945-4a1a-48fa-a6a2-fcb447291594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:05.655452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c1945-4a1a-48fa-a6a2-fcb447291594 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.655726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c1945-4a1a-48fa-a6a2-fcb447291594 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.656000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c1945-4a1a-48fa-a6a2-fcb447291594 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.656759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c1945-4a1a-48fa-a6a2-fcb447291594 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:05.657064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c1945-4a1a-48fa-a6a2-fcb447291594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:05.658558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c1945-4a1a-48fa-a6a2-fcb447291594 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:05.669717 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 502/1017] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Aug 29 20:09:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:05.671349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c1945-4a1a-48fa-a6a2-fcb447291594 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:05.705241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e445d9f-640b-455c-99e6-d0486a4fe294 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:05.759904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4710b-e9e9-4a51-b0c0-6f40dc38a8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:05.760564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4710b-e9e9-4a51-b0c0-6f40dc38a8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.760849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4710b-e9e9-4a51-b0c0-6f40dc38a8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.761118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4710b-e9e9-4a51-b0c0-6f40dc38a8b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.762553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4710b-e9e9-4a51-b0c0-6f40dc38a8b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:05.764078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4710b-e9e9-4a51-b0c0-6f40dc38a8b4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:05.765856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 516/1018] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:05.773920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4710b-e9e9-4a51-b0c0-6f40dc38a8b4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:05.812825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:05.815440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:05.842410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c1945-4a1a-48fa-a6a2-fcb447291594 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:05.898350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe99f13-760a-4f70-8b84-b368cd3517a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:05.899168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe99f13-760a-4f70-8b84-b368cd3517a3 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.899637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe99f13-760a-4f70-8b84-b368cd3517a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.900036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe99f13-760a-4f70-8b84-b368cd3517a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.900813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe99f13-760a-4f70-8b84-b368cd3517a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:05.902933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe99f13-760a-4f70-8b84-b368cd3517a3 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:05.912011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4710b-e9e9-4a51-b0c0-6f40dc38a8b4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:05.951789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694ad9d-ec23-47e5-9acd-e7e3f10573c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:05.952411 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694ad9d-ec23-47e5-9acd-e7e3f10573c0 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.952682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694ad9d-ec23-47e5-9acd-e7e3f10573c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.953046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694ad9d-ec23-47e5-9acd-e7e3f10573c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.953609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694ad9d-ec23-47e5-9acd-e7e3f10573c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:05.955098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694ad9d-ec23-47e5-9acd-e7e3f10573c0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:06.002592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 503/1019] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:09:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:09:06.003935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d446e-f110-4177-8aee-bc8e8b44b256 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:06.004279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d446e-f110-4177-8aee-bc8e8b44b256 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:06.004487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d446e-f110-4177-8aee-bc8e8b44b256 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:06.005870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 504/1020] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:06.015332 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e60b3-f6da-4250-ba96-c71f08e895db None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:06.015766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e60b3-f6da-4250-ba96-c71f08e895db None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:06.016157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e60b3-f6da-4250-ba96-c71f08e895db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:06.038275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-b26e60b3-f6da-4250-ba96-c71f08e895db None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:06.043738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b26e60b3-f6da-4250-ba96-c71f08e895db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:06.136781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 505/1021] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:06.162926 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 517/1022] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:09:05 2022] POST /identity/v3/projects => generated 311 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:09:06.534605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e60b3-f6da-4250-ba96-c71f08e895db None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:06.625250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:06.671692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e60b3-f6da-4250-ba96-c71f08e895db None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:06.718693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342cb02-cd21-4ee8-8ffb-41eb758307cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:06.719342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342cb02-cd21-4ee8-8ffb-41eb758307cc None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:06.719619 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342cb02-cd21-4ee8-8ffb-41eb758307cc None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:06.719887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342cb02-cd21-4ee8-8ffb-41eb758307cc None admin] PATH_INFO: `/v3/services/image` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:06.720486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342cb02-cd21-4ee8-8ffb-41eb758307cc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:06.722093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342cb02-cd21-4ee8-8ffb-41eb758307cc None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-8342cb02-cd21-4ee8-8ffb-41eb758307cc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:06.733242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:06.734408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:06.739177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 506/1023] 10.222.0.81 () {56 vars in 1105 bytes} [Mon Aug 29 20:09:06 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:06.743751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694ad9d-ec23-47e5-9acd-e7e3f10573c0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:06.842514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:06.868587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694ad9d-ec23-47e5-9acd-e7e3f10573c0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:06.930676 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed8a92-742b-45a4-880d-d51d0d7f0d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:06.931719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed8a92-742b-45a4-880d-d51d0d7f0d5f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:06.932205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed8a92-742b-45a4-880d-d51d0d7f0d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:06.932685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed8a92-742b-45a4-880d-d51d0d7f0d5f None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:06.934127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed8a92-742b-45a4-880d-d51d0d7f0d5f None admin] RBAC: Adding query filter params (name=image) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:06.934908 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed8a92-742b-45a4-880d-d51d0d7f0d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:06.937999 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed8a92-742b-45a4-880d-d51d0d7f0d5f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:06.952773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 518/1024] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:06.954810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342cb02-cd21-4ee8-8ffb-41eb758307cc None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:07.134443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342cb02-cd21-4ee8-8ffb-41eb758307cc None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:07.187786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:07.197350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dab9a-4bca-448f-a1e7-43c270cd5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:07.198366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dab9a-4bca-448f-a1e7-43c270cd5ece None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:07.198855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dab9a-4bca-448f-a1e7-43c270cd5ece None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:07.201643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dab9a-4bca-448f-a1e7-43c270cd5ece None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:07.201643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dab9a-4bca-448f-a1e7-43c270cd5ece None admin] RBAC: Adding query filter params (type=image) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:07.201643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dab9a-4bca-448f-a1e7-43c270cd5ece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:07.203590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dab9a-4bca-448f-a1e7-43c270cd5ece None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:07.217943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 507/1025] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:07.223426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed8a92-742b-45a4-880d-d51d0d7f0d5f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:07.366240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed8a92-742b-45a4-880d-d51d0d7f0d5f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:07.415213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7c52c-9428-4959-8a01-9c8dc925f21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:07.416195 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c52c-9428-4959-8a01-9c8dc925f21b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:07.416672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c52c-9428-4959-8a01-9c8dc925f21b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:07.417148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c52c-9428-4959-8a01-9c8dc925f21b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:07.418532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7c52c-9428-4959-8a01-9c8dc925f21b None admin] RBAC: Adding query filter params (interface=public, service_id=bf6a6bdf9a644fd4aef365e54920cbfb, region_id=RegionOne) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:07.419197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7c52c-9428-4959-8a01-9c8dc925f21b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:07.421791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7c52c-9428-4959-8a01-9c8dc925f21b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:07.438199 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 519/1026] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Aug 29 20:09:07 2022] GET /identity/v3/endpoints?service_id=bf6a6bdf9a644fd4aef365e54920cbfb&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:07.442596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dab9a-4bca-448f-a1e7-43c270cd5ece None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:07.598061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dab9a-4bca-448f-a1e7-43c270cd5ece None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:07.639966 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95123d6-ada6-474b-ac82-70849f8c2110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:07.640949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95123d6-ada6-474b-ac82-70849f8c2110 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:07.640949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95123d6-ada6-474b-ac82-70849f8c2110 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:07.641258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95123d6-ada6-474b-ac82-70849f8c2110 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:07.641718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95123d6-ada6-474b-ac82-70849f8c2110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:07.643160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95123d6-ada6-474b-ac82-70849f8c2110 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:07.651632 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 508/1027] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Aug 29 20:09:07 2022] GET /identity/v3/services => generated 1957 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:09:08.291570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c7afd-0263-4a9d-8670-7953e40b1061 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:08.292354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c7afd-0263-4a9d-8670-7953e40b1061 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:08.292354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c7afd-0263-4a9d-8670-7953e40b1061 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:08.293729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 520/1028] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:08.302512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314f25b-e028-4601-981c-6f24f5b28976 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:08.302841 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314f25b-e028-4601-981c-6f24f5b28976 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:08.303622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314f25b-e028-4601-981c-6f24f5b28976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:08.324406 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f314f25b-e028-4601-981c-6f24f5b28976 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:08.325613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f314f25b-e028-4601-981c-6f24f5b28976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:08.368810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548409a3-35df-4b6e-9e28-670f4cbb2a86 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:08.369078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548409a3-35df-4b6e-9e28-670f4cbb2a86 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:08.369513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548409a3-35df-4b6e-9e28-670f4cbb2a86 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:08.371532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 521/1029] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:08.376655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb39ac9-84eb-4d89-8ae3-ea68105a4419 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:08.377039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb39ac9-84eb-4d89-8ae3-ea68105a4419 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:08.377246 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb39ac9-84eb-4d89-8ae3-ea68105a4419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:08.397583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6fb39ac9-84eb-4d89-8ae3-ea68105a4419 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:08.399132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6fb39ac9-84eb-4d89-8ae3-ea68105a4419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:08.408988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:08.430685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:08.443075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 509/1030] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:08.507953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 522/1031] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:08.785788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314f25b-e028-4601-981c-6f24f5b28976 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:08.901187 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb39ac9-84eb-4d89-8ae3-ea68105a4419 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:08.926440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314f25b-e028-4601-981c-6f24f5b28976 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:08.996112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb561b-2a4d-4682-aefb-ae89373f5a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:08.997341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb561b-2a4d-4682-aefb-ae89373f5a4f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:08.997671 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb561b-2a4d-4682-aefb-ae89373f5a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:08.998160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb561b-2a4d-4682-aefb-ae89373f5a4f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.021131 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb561b-2a4d-4682-aefb-ae89373f5a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-a1bb561b-2a4d-4682-aefb-ae89373f5a4f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:09.027492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:09.029771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:09.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 510/1032] 10.222.0.81 () {56 vars in 1120 bytes} [Mon Aug 29 20:09:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:09.039059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb561b-2a4d-4682-aefb-ae89373f5a4f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:09.086763 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb39ac9-84eb-4d89-8ae3-ea68105a4419 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:09.124750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:09.150365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d76dd-31f8-4bec-b44e-58310a1f4ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:09.151140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d76dd-31f8-4bec-b44e-58310a1f4ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:09.151436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d76dd-31f8-4bec-b44e-58310a1f4ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:09.151688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d76dd-31f8-4bec-b44e-58310a1f4ae4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.152968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d76dd-31f8-4bec-b44e-58310a1f4ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:09.154395 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d76dd-31f8-4bec-b44e-58310a1f4ae4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:09.156389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 523/1033] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:09.166271 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d76dd-31f8-4bec-b44e-58310a1f4ae4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:09.176872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:09.206823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb561b-2a4d-4682-aefb-ae89373f5a4f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:09.264876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d965a-b5e0-4292-96f8-42819dca19b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:09.266091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d965a-b5e0-4292-96f8-42819dca19b1 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:09.266776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d965a-b5e0-4292-96f8-42819dca19b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:09.267271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d965a-b5e0-4292-96f8-42819dca19b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.268468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d965a-b5e0-4292-96f8-42819dca19b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:09.269013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d965a-b5e0-4292-96f8-42819dca19b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:09.273427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d965a-b5e0-4292-96f8-42819dca19b1 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:09.295362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 511/1034] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Aug 29 20:09:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:09.297299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d965a-b5e0-4292-96f8-42819dca19b1 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:09.303617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d76dd-31f8-4bec-b44e-58310a1f4ae4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:09.343738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7316c-bd4d-4998-a959-721bec1af372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:09.344358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7316c-bd4d-4998-a959-721bec1af372 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:09.344632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7316c-bd4d-4998-a959-721bec1af372 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:09.345056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7316c-bd4d-4998-a959-721bec1af372 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.345731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7316c-bd4d-4998-a959-721bec1af372 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:09.347329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7316c-bd4d-4998-a959-721bec1af372 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:09.448432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 524/1035] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:09:09 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:09:09.449511 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d965a-b5e0-4292-96f8-42819dca19b1 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:09.471303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:09.499878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a179d-e662-4e7c-97d4-3d55b15e2a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:09.500553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a179d-e662-4e7c-97d4-3d55b15e2a5b None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:09.500832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a179d-e662-4e7c-97d4-3d55b15e2a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:09.501107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a179d-e662-4e7c-97d4-3d55b15e2a5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.516680 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a179d-e662-4e7c-97d4-3d55b15e2a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:09.519220 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a179d-e662-4e7c-97d4-3d55b15e2a5b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-af6a179d-e662-4e7c-97d4-3d55b15e2a5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:09.539400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:09.547311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:09.549109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:09.549109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:09.549109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:09.549109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 512/1036] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:09.554637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7316c-bd4d-4998-a959-721bec1af372 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:09.659186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:09.720591 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7316c-bd4d-4998-a959-721bec1af372 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:09.771214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b82772-2578-45ef-b5d6-7669613e376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:09.771883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b82772-2578-45ef-b5d6-7669613e376c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:09.773107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b82772-2578-45ef-b5d6-7669613e376c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:09.773376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b82772-2578-45ef-b5d6-7669613e376c None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.774058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b82772-2578-45ef-b5d6-7669613e376c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:09.774396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b82772-2578-45ef-b5d6-7669613e376c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:09.775792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b82772-2578-45ef-b5d6-7669613e376c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:09.792774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 525/1037] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:09.799658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a179d-e662-4e7c-97d4-3d55b15e2a5b None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:09.951070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a179d-e662-4e7c-97d4-3d55b15e2a5b None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:09.955593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ca255-3566-4275-8a07-cb2b078f8ffb None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:09.955877 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ca255-3566-4275-8a07-cb2b078f8ffb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:09.956179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ca255-3566-4275-8a07-cb2b078f8ffb None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.958377 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 526/1038] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:09.964613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5126bb0-5b67-4829-8bc6-2545599d7ed9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:09.964909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5126bb0-5b67-4829-8bc6-2545599d7ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:09.965332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5126bb0-5b67-4829-8bc6-2545599d7ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.986129 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f5126bb0-5b67-4829-8bc6-2545599d7ed9 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:09.987433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f5126bb0-5b67-4829-8bc6-2545599d7ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:10.003585 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ec30a-e2e9-4606-af9e-33d81054304d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:10.004286 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ec30a-e2e9-4606-af9e-33d81054304d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:10.004574 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ec30a-e2e9-4606-af9e-33d81054304d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:10.004827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ec30a-e2e9-4606-af9e-33d81054304d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:10.015562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ec30a-e2e9-4606-af9e-33d81054304d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:10.017263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ec30a-e2e9-4606-af9e-33d81054304d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-c39ec30a-e2e9-4606-af9e-33d81054304d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:09:10.034305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:10.035858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:10.036889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:10.036889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:10.036889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:09:10.036889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:09:10.036889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:09:10.036889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:09:10.036889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:09:10.036889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:09:10.036889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:09:10.036889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:10.036889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 513/1039] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Aug 29 20:09:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:10.046521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ec30a-e2e9-4606-af9e-33d81054304d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:10.087501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 527/1040] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:10.097184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:10.206035 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ec30a-e2e9-4606-af9e-33d81054304d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:10.249641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8259c-5aee-48da-9bf5-b8a642021c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:10.250287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8259c-5aee-48da-9bf5-b8a642021c62 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:10.250594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8259c-5aee-48da-9bf5-b8a642021c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:10.250851 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8259c-5aee-48da-9bf5-b8a642021c62 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:10.251576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8259c-5aee-48da-9bf5-b8a642021c62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:10.251870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8259c-5aee-48da-9bf5-b8a642021c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:10.253343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8259c-5aee-48da-9bf5-b8a642021c62 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:10.276906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 514/1041] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Aug 29 20:09:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:10.283645 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5126bb0-5b67-4829-8bc6-2545599d7ed9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:10.370588 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8259c-5aee-48da-9bf5-b8a642021c62 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:10.393239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:10.473182 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:10.477011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5126bb0-5b67-4829-8bc6-2545599d7ed9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:10.505091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8259c-5aee-48da-9bf5-b8a642021c62 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:10.521216 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c01d14-3aef-477c-bdaa-bd080325c030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:10.522053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01d14-3aef-477c-bdaa-bd080325c030 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:10.522477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01d14-3aef-477c-bdaa-bd080325c030 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:10.523027 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01d14-3aef-477c-bdaa-bd080325c030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:10.574938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4a1f7-de06-4ca3-a9b0-d9f1aaa4d6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:10.576470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4a1f7-de06-4ca3-a9b0-d9f1aaa4d6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:10.577238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4a1f7-de06-4ca3-a9b0-d9f1aaa4d6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:10.578009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4a1f7-de06-4ca3-a9b0-d9f1aaa4d6d2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:10.579149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4a1f7-de06-4ca3-a9b0-d9f1aaa4d6d2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:10.581784 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4a1f7-de06-4ca3-a9b0-d9f1aaa4d6d2 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-79b4a1f7-de06-4ca3-a9b0-d9f1aaa4d6d2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:10.592932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:10.595901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:10.597643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 515/1042] 10.222.0.81 () {56 vars in 1105 bytes} [Mon Aug 29 20:09:10 2022] GET /identity/v3/services/image => generated 86 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:10.601222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4a1f7-de06-4ca3-a9b0-d9f1aaa4d6d2 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:10.620728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c01d14-3aef-477c-bdaa-bd080325c030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:10.622499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c01d14-3aef-477c-bdaa-bd080325c030 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:10.701067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:10.745481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4a1f7-de06-4ca3-a9b0-d9f1aaa4d6d2 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:10.778465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 528/1043] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:10 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:09:10.780020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c01d14-3aef-477c-bdaa-bd080325c030 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:10.796172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fabc4-a266-4e5b-ae30-eccec2df27b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:10.796792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fabc4-a266-4e5b-ae30-eccec2df27b3 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:10.797098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fabc4-a266-4e5b-ae30-eccec2df27b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:10.797384 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fabc4-a266-4e5b-ae30-eccec2df27b3 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:10.797962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fabc4-a266-4e5b-ae30-eccec2df27b3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:10.798292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fabc4-a266-4e5b-ae30-eccec2df27b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:10.799676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fabc4-a266-4e5b-ae30-eccec2df27b3 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:10.805658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 516/1044] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:10.817204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fabc4-a266-4e5b-ae30-eccec2df27b3 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:10.843284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:10.918889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c01d14-3aef-477c-bdaa-bd080325c030 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:10.964073 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1af6a-feab-4fe7-93f9-a7f1c1cd7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:10.964721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1af6a-feab-4fe7-93f9-a7f1c1cd7535 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:10.965004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1af6a-feab-4fe7-93f9-a7f1c1cd7535 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:10.965294 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1af6a-feab-4fe7-93f9-a7f1c1cd7535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:10.978173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1af6a-feab-4fe7-93f9-a7f1c1cd7535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:10.979699 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1af6a-feab-4fe7-93f9-a7f1c1cd7535 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-1ff1af6a-feab-4fe7-93f9-a7f1c1cd7535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:10.996540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:10.998825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:11.000837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:11.000837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:11.000837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:09:11.000837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 529/1045] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:11.003511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1af6a-feab-4fe7-93f9-a7f1c1cd7535 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:11.008828 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:11.016912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fabc4-a266-4e5b-ae30-eccec2df27b3 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:11.071352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589cb40-5ab7-4615-8d72-9667002e8d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:11.072236 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589cb40-5ab7-4615-8d72-9667002e8d1c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:11.072701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589cb40-5ab7-4615-8d72-9667002e8d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:11.073129 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589cb40-5ab7-4615-8d72-9667002e8d1c None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:11.073938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589cb40-5ab7-4615-8d72-9667002e8d1c None admin] RBAC: Adding query filter params (type=image) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:11.074484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589cb40-5ab7-4615-8d72-9667002e8d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:11.076474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589cb40-5ab7-4615-8d72-9667002e8d1c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:11.083251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 517/1046] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:11.090011 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589cb40-5ab7-4615-8d72-9667002e8d1c None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:11.146087 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1af6a-feab-4fe7-93f9-a7f1c1cd7535 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:11.197515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d738e-1901-43b5-94f8-183203879cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:11.198352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d738e-1901-43b5-94f8-183203879cec None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:11.198796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d738e-1901-43b5-94f8-183203879cec None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:11.199228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d738e-1901-43b5-94f8-183203879cec None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:11.200071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d738e-1901-43b5-94f8-183203879cec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:11.200534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d738e-1901-43b5-94f8-183203879cec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:11.202332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d738e-1901-43b5-94f8-183203879cec None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:11.206681 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:11.226328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 530/1047] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:11.228579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d738e-1901-43b5-94f8-183203879cec None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:11.243044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589cb40-5ab7-4615-8d72-9667002e8d1c None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:11.295728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e11c77-3b68-4fab-b19e-54ddd0538cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:11.296193 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e11c77-3b68-4fab-b19e-54ddd0538cef None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:11.296472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e11c77-3b68-4fab-b19e-54ddd0538cef None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:11.296745 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e11c77-3b68-4fab-b19e-54ddd0538cef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:11.297440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e11c77-3b68-4fab-b19e-54ddd0538cef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:11.298965 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e11c77-3b68-4fab-b19e-54ddd0538cef None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:11.324936 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:11.374960 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d738e-1901-43b5-94f8-183203879cec None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:11.423195 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a95f3-76d2-45c0-a116-4818d95555b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:11.424291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a95f3-76d2-45c0-a116-4818d95555b2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:11.424291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a95f3-76d2-45c0-a116-4818d95555b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:11.424675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a95f3-76d2-45c0-a116-4818d95555b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:11.433931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a95f3-76d2-45c0-a116-4818d95555b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:11.436141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a95f3-76d2-45c0-a116-4818d95555b2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:11.438972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 518/1048] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:09:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2e4a95f3-76d2-45c0-a116-4818d95555b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:09:11.457285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:11.466533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:11.475817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:09:11.475817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:09:11.475817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:09:11.475817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:09:11.475817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:09:11.475817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:09:11.475817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:09:11.475817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:09:11.475817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 531/1049] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:09:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:11.477587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e11c77-3b68-4fab-b19e-54ddd0538cef None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:11.595143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747ff3e-8a74-423c-8420-6c303e09b992 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:11.595527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747ff3e-8a74-423c-8420-6c303e09b992 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:11.595735 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747ff3e-8a74-423c-8420-6c303e09b992 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:11.597265 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 532/1050] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:11.603796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f625-2277-4dc3-9fde-e45b483ed3df None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:11.604108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f625-2277-4dc3-9fde-e45b483ed3df None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:11.604370 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f625-2277-4dc3-9fde-e45b483ed3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:11.625320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-bf55f625-2277-4dc3-9fde-e45b483ed3df None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:11.626626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bf55f625-2277-4dc3-9fde-e45b483ed3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:11.635874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e11c77-3b68-4fab-b19e-54ddd0538cef None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:11.667766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:11.677542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e02da-e08e-4298-b005-73941d929490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:11.683715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e02da-e08e-4298-b005-73941d929490 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:11.683715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e02da-e08e-4298-b005-73941d929490 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:11.683715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e02da-e08e-4298-b005-73941d929490 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:11.683715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e02da-e08e-4298-b005-73941d929490 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:11.683715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e02da-e08e-4298-b005-73941d929490 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:11.683715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e02da-e08e-4298-b005-73941d929490 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:11.697989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 519/1051] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:09:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:11.704318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e02da-e08e-4298-b005-73941d929490 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:11.711818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 533/1052] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:11.832111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e02da-e08e-4298-b005-73941d929490 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:11.877175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df97c45-02b4-4e27-a682-9ba76f0e07ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:11.877788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df97c45-02b4-4e27-a682-9ba76f0e07ad None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:11.878064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df97c45-02b4-4e27-a682-9ba76f0e07ad None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:11.878370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df97c45-02b4-4e27-a682-9ba76f0e07ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:11.879113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df97c45-02b4-4e27-a682-9ba76f0e07ad None admin] RBAC: Adding query filter params (role.id=cc4a817595fc4a5abef6fa6a8660cbf8, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=30946d3b3f0f4a81b2ae5aa6e84f3920) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:11.879421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df97c45-02b4-4e27-a682-9ba76f0e07ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:11.880929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df97c45-02b4-4e27-a682-9ba76f0e07ad None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:11.894260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 520/1053] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:11 2022] GET /identity/v3/role_assignments?user.id=30946d3b3f0f4a81b2ae5aa6e84f3920&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=cc4a817595fc4a5abef6fa6a8660cbf8 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:11.987478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f625-2277-4dc3-9fde-e45b483ed3df None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:12.061363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:12.117806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f625-2277-4dc3-9fde-e45b483ed3df None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:12.178560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b6bea-05d8-4d0b-8073-2172434974e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:12.180092 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b6bea-05d8-4d0b-8073-2172434974e0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:12.180730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b6bea-05d8-4d0b-8073-2172434974e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:12.181334 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b6bea-05d8-4d0b-8073-2172434974e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:12.203194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b6bea-05d8-4d0b-8073-2172434974e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-273b6bea-05d8-4d0b-8073-2172434974e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:12.214725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:12.216988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:12.219090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:12.219090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:12.219090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:12.219090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:12.219090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:12.219090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:12.219090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:12.219090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:12.219090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:12.219090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:12.219090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:12.219090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:09:12.221550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 534/1054] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:09:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:12.232848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df97c45-02b4-4e27-a682-9ba76f0e07ad None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:12.336175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:12.421383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df97c45-02b4-4e27-a682-9ba76f0e07ad None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:12.459214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bc528-18e6-4c75-990c-173477f7593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:12.460203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bc528-18e6-4c75-990c-173477f7593a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:12.460515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bc528-18e6-4c75-990c-173477f7593a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:12.460786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bc528-18e6-4c75-990c-173477f7593a None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:12.461476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bc528-18e6-4c75-990c-173477f7593a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:12.461779 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bc528-18e6-4c75-990c-173477f7593a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:12.463238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bc528-18e6-4c75-990c-173477f7593a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:12.482314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 521/1055] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:09:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:12.484950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b6bea-05d8-4d0b-8073-2172434974e0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:12.702039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b6bea-05d8-4d0b-8073-2172434974e0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:12.732233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:12.775655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58961977-99ab-402c-a156-d0828eaef0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:12.777230 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961977-99ab-402c-a156-d0828eaef0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:12.777753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961977-99ab-402c-a156-d0828eaef0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:12.778432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961977-99ab-402c-a156-d0828eaef0e9 None admin] PATH_INFO: `/v3/users/2e0ed1057f7b4c68832f92bd9740a947` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:12.817935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58961977-99ab-402c-a156-d0828eaef0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=2e0ed1057f7b4c68832f92bd9740a947)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:12.822015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58961977-99ab-402c-a156-d0828eaef0e9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:12.825961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 535/1056] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:12 2022] GET /identity/v3/users/2e0ed1057f7b4c68832f92bd9740a947 => generated 285 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:12.835974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bc528-18e6-4c75-990c-173477f7593a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:13.067951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bc528-18e6-4c75-990c-173477f7593a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:13.097918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:13.143809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b02e9-5db0-489b-87ea-d7f9f199d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:13.145092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b02e9-5db0-489b-87ea-d7f9f199d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.145584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b02e9-5db0-489b-87ea-d7f9f199d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.146130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b02e9-5db0-489b-87ea-d7f9f199d7b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.245036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b02e9-5db0-489b-87ea-d7f9f199d7b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:13.246524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b02e9-5db0-489b-87ea-d7f9f199d7b9 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:13.414429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 522/1057] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:13.425361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58961977-99ab-402c-a156-d0828eaef0e9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:13.562051 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58961977-99ab-402c-a156-d0828eaef0e9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:13.606516 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02480ed6-475e-4bb4-8a2d-fbf698f331d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:13.607067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02480ed6-475e-4bb4-8a2d-fbf698f331d5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.607340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02480ed6-475e-4bb4-8a2d-fbf698f331d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.607642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02480ed6-475e-4bb4-8a2d-fbf698f331d5 None admin] PATH_INFO: `/v3/projects/6677efc2b7cd401da187dcaa208c216e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.608825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02480ed6-475e-4bb4-8a2d-fbf698f331d5 None admin] RBAC: Authorizing `identity:get_project(project_id=6677efc2b7cd401da187dcaa208c216e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:13.610307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02480ed6-475e-4bb4-8a2d-fbf698f331d5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:13.612289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 536/1058] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:13 2022] GET /identity/v3/projects/6677efc2b7cd401da187dcaa208c216e => generated 311 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:13.620195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b02e9-5db0-489b-87ea-d7f9f199d7b9 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:13.623995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38962-6cb3-4457-bd27-1b86fb2f7882 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.624586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38962-6cb3-4457-bd27-1b86fb2f7882 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.625036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38962-6cb3-4457-bd27-1b86fb2f7882 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.626623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 537/1059] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:13.632826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101ef8a-0063-443c-a024-d05f9e0be0f4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.633409 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101ef8a-0063-443c-a024-d05f9e0be0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.633858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101ef8a-0063-443c-a024-d05f9e0be0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.651154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:13.655014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5101ef8a-0063-443c-a024-d05f9e0be0f4 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:13.656305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5101ef8a-0063-443c-a024-d05f9e0be0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:13.706595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:13.766414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 538/1060] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:13.776807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b02e9-5db0-489b-87ea-d7f9f199d7b9 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:13.820449 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c01a9f-d2f5-4562-b26b-172544ea8e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:13.821071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c01a9f-d2f5-4562-b26b-172544ea8e4a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.821342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c01a9f-d2f5-4562-b26b-172544ea8e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.821790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c01a9f-d2f5-4562-b26b-172544ea8e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.822956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c01a9f-d2f5-4562-b26b-172544ea8e4a None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=6677efc2b7cd401da187dcaa208c216e, user.id=2e0ed1057f7b4c68832f92bd9740a947) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:13.823263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c01a9f-d2f5-4562-b26b-172544ea8e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:13.824746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c01a9f-d2f5-4562-b26b-172544ea8e4a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:13.838284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 523/1061] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:13 2022] GET /identity/v3/role_assignments?user.id=2e0ed1057f7b4c68832f92bd9740a947&scope.project.id=6677efc2b7cd401da187dcaa208c216e&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:13.937009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6a84f-2632-49e7-8145-c76bc2e1c99e None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.937297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6a84f-2632-49e7-8145-c76bc2e1c99e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.937687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6a84f-2632-49e7-8145-c76bc2e1c99e None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.939372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 539/1062] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:13.945987 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe269403-3fbb-4c1a-92f5-9541304b6b1e None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.946313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe269403-3fbb-4c1a-92f5-9541304b6b1e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.946586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe269403-3fbb-4c1a-92f5-9541304b6b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.968407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-fe269403-3fbb-4c1a-92f5-9541304b6b1e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:13.969674 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-fe269403-3fbb-4c1a-92f5-9541304b6b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:14.057085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 524/1063] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:14.292640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6a84f-2632-49e7-8145-c76bc2e1c99e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:14.446589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6a84f-2632-49e7-8145-c76bc2e1c99e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:14.495448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c0e5e-bb9d-4b77-aaac-6fda494974dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:14.496091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c0e5e-bb9d-4b77-aaac-6fda494974dc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:14.496385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c0e5e-bb9d-4b77-aaac-6fda494974dc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:14.496680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c0e5e-bb9d-4b77-aaac-6fda494974dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:14.548417 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe269403-3fbb-4c1a-92f5-9541304b6b1e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:14.560762 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:14.567255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:14.601343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c0e5e-bb9d-4b77-aaac-6fda494974dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:14.604779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c0e5e-bb9d-4b77-aaac-6fda494974dc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:14.722940 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe269403-3fbb-4c1a-92f5-9541304b6b1e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:14.757120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 540/1064] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:14.766929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c0e5e-bb9d-4b77-aaac-6fda494974dc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:14.793520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30e9de-1109-474e-876f-782aff8788d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:14.794551 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30e9de-1109-474e-876f-782aff8788d6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:14.795097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30e9de-1109-474e-876f-782aff8788d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:14.795548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30e9de-1109-474e-876f-782aff8788d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:14.819172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30e9de-1109-474e-876f-782aff8788d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-ef30e9de-1109-474e-876f-782aff8788d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:14.829323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:14.830464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:14.831318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:14.831318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:14.831318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:14.831318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:14.831318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:14.831318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:14.831318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:14.831318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:14.831318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:14.831318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:14.831318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:09:14.831318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:14.831948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 525/1065] 10.222.0.81 () {56 vars in 1120 bytes} [Mon Aug 29 20:09:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:14.842667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30e9de-1109-474e-876f-782aff8788d6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:14.874479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:14.910353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c0e5e-bb9d-4b77-aaac-6fda494974dc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:14.960144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656e093-a320-4fa4-8339-e0a14e3b382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:14.961239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656e093-a320-4fa4-8339-e0a14e3b382f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:14.961718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656e093-a320-4fa4-8339-e0a14e3b382f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:14.962111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656e093-a320-4fa4-8339-e0a14e3b382f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:14.973218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:14.977260 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656e093-a320-4fa4-8339-e0a14e3b382f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:14.979040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656e093-a320-4fa4-8339-e0a14e3b382f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-4656e093-a320-4fa4-8339-e0a14e3b382f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:14.999324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:15.001350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:15.003348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:15.003348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:15.003348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:09:15.003348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 541/1066] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:15.009760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656e093-a320-4fa4-8339-e0a14e3b382f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:15.042160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30e9de-1109-474e-876f-782aff8788d6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:15.109704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d538cc3-b5b5-4a16-bb69-c2aec606d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:15.110725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d538cc3-b5b5-4a16-bb69-c2aec606d349 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:15.111141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d538cc3-b5b5-4a16-bb69-c2aec606d349 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:15.111530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d538cc3-b5b5-4a16-bb69-c2aec606d349 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:15.112775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d538cc3-b5b5-4a16-bb69-c2aec606d349 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:15.113307 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d538cc3-b5b5-4a16-bb69-c2aec606d349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:15.116153 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d538cc3-b5b5-4a16-bb69-c2aec606d349 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:15.139772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 526/1067] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Aug 29 20:09:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:15.142119 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d538cc3-b5b5-4a16-bb69-c2aec606d349 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:15.154035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656e093-a320-4fa4-8339-e0a14e3b382f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:15.203549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:15.225308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61280144-ec85-45dc-851f-e680dfac7324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:15.226513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61280144-ec85-45dc-851f-e680dfac7324 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:15.226981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61280144-ec85-45dc-851f-e680dfac7324 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:15.227468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61280144-ec85-45dc-851f-e680dfac7324 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:15.228656 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61280144-ec85-45dc-851f-e680dfac7324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:15.229199 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61280144-ec85-45dc-851f-e680dfac7324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:15.231839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61280144-ec85-45dc-851f-e680dfac7324 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:15.258654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 542/1068] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:15.298199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d538cc3-b5b5-4a16-bb69-c2aec606d349 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:15.337197 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:15.351455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57581a06-c3c8-45d0-8b3a-2413d1d627c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:15.352898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57581a06-c3c8-45d0-8b3a-2413d1d627c3 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:15.353642 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57581a06-c3c8-45d0-8b3a-2413d1d627c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:15.354353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57581a06-c3c8-45d0-8b3a-2413d1d627c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:15.374391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57581a06-c3c8-45d0-8b3a-2413d1d627c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:15.375943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57581a06-c3c8-45d0-8b3a-2413d1d627c3 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-57581a06-c3c8-45d0-8b3a-2413d1d627c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:15.394305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:15.395336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:15.396339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:15.396339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:15.396339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:15.396339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 527/1069] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:15.406161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61280144-ec85-45dc-851f-e680dfac7324 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:15.587766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61280144-ec85-45dc-851f-e680dfac7324 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:15.640498 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4436dc8-8301-4bb1-a74f-dbf1edab0167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:15.641476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4436dc8-8301-4bb1-a74f-dbf1edab0167 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:15.641476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4436dc8-8301-4bb1-a74f-dbf1edab0167 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:15.641711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4436dc8-8301-4bb1-a74f-dbf1edab0167 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:15.642341 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4436dc8-8301-4bb1-a74f-dbf1edab0167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:15.642649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4436dc8-8301-4bb1-a74f-dbf1edab0167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:15.644070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4436dc8-8301-4bb1-a74f-dbf1edab0167 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:15.660446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 543/1070] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:15.667560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57581a06-c3c8-45d0-8b3a-2413d1d627c3 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:15.792483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57581a06-c3c8-45d0-8b3a-2413d1d627c3 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:15.833658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09d16c-bc6d-41bc-8d14-f03d050ffc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:15.834378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09d16c-bc6d-41bc-8d14-f03d050ffc24 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:15.834663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09d16c-bc6d-41bc-8d14-f03d050ffc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:15.834936 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09d16c-bc6d-41bc-8d14-f03d050ffc24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:15.843797 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09d16c-bc6d-41bc-8d14-f03d050ffc24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:15.845265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09d16c-bc6d-41bc-8d14-f03d050ffc24 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-0e09d16c-bc6d-41bc-8d14-f03d050ffc24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:09:15.858432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:15.859820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:15.860846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:15.860846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:15.860846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:09:15.860846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:09:15.860846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:09:15.860846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:09:15.860846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:09:15.860846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:09:15.860846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:09:15.860846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:15.860846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 528/1071] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Aug 29 20:09:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:15.866448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4436dc8-8301-4bb1-a74f-dbf1edab0167 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:15.918667 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:15.984901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4436dc8-8301-4bb1-a74f-dbf1edab0167 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:16.025088 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628292b-45fa-46fe-a56d-913fdce051ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:16.025705 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628292b-45fa-46fe-a56d-913fdce051ee None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.025976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628292b-45fa-46fe-a56d-913fdce051ee None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.026258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628292b-45fa-46fe-a56d-913fdce051ee None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.026996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628292b-45fa-46fe-a56d-913fdce051ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:16.027407 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628292b-45fa-46fe-a56d-913fdce051ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:16.028852 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628292b-45fa-46fe-a56d-913fdce051ee None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:16.050246 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 544/1072] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Aug 29 20:09:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:16.057416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09d16c-bc6d-41bc-8d14-f03d050ffc24 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:16.113217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:16.221365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09d16c-bc6d-41bc-8d14-f03d050ffc24 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:16.282254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cc142-941b-49ed-b191-2b677b63676f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:16.282978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cc142-941b-49ed-b191-2b677b63676f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.283255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cc142-941b-49ed-b191-2b677b63676f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.283525 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cc142-941b-49ed-b191-2b677b63676f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.296792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cc142-941b-49ed-b191-2b677b63676f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:16.298300 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cc142-941b-49ed-b191-2b677b63676f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-441cc142-941b-49ed-b191-2b677b63676f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:16.314956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:16.316914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:16.319338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:16.319338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:16.319338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:16.319338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 529/1073] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:16.324694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628292b-45fa-46fe-a56d-913fdce051ee None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:16.366540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091252fe-c4ee-4235-a10f-eb54c4d9d65f None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.366955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091252fe-c4ee-4235-a10f-eb54c4d9d65f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.367333 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091252fe-c4ee-4235-a10f-eb54c4d9d65f None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.368842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 530/1074] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:16.375261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1fc5a-12bb-4b5a-84fb-2087b67be502 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.375615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1fc5a-12bb-4b5a-84fb-2087b67be502 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.375951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1fc5a-12bb-4b5a-84fb-2087b67be502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.403739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6ed1fc5a-12bb-4b5a-84fb-2087b67be502 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:16.405182 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6ed1fc5a-12bb-4b5a-84fb-2087b67be502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:16.483014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:16.488031 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628292b-45fa-46fe-a56d-913fdce051ee None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:16.488679 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 531/1075] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:16.553036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1fb5c-1c46-41fd-8c5f-2c830470ced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:16.554035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1fb5c-1c46-41fd-8c5f-2c830470ced0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.554581 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1fb5c-1c46-41fd-8c5f-2c830470ced0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.555073 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1fb5c-1c46-41fd-8c5f-2c830470ced0 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.556288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1fb5c-1c46-41fd-8c5f-2c830470ced0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:16.556878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1fb5c-1c46-41fd-8c5f-2c830470ced0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:16.559460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1fb5c-1c46-41fd-8c5f-2c830470ced0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:16.581783 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 545/1076] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:16.588422 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1fc5a-12bb-4b5a-84fb-2087b67be502 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:16.618131 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:16.709178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1fc5a-12bb-4b5a-84fb-2087b67be502 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:16.755554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bea4af-08e4-4851-a029-cc7fd97f216a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:16.757209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bea4af-08e4-4851-a029-cc7fd97f216a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.757382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bea4af-08e4-4851-a029-cc7fd97f216a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.757532 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bea4af-08e4-4851-a029-cc7fd97f216a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.765595 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bea4af-08e4-4851-a029-cc7fd97f216a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:16.767231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bea4af-08e4-4851-a029-cc7fd97f216a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:16.780220 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1fb5c-1c46-41fd-8c5f-2c830470ced0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-c4bea4af-08e4-4851-a029-cc7fd97f216a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:09:16.780810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:16.781849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:16.783806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:09:16.783806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:09:16.783806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:09:16.783806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:09:16.783806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:09:16.783806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:09:16.783806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:09:16.783806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:16.783806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 532/1077] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:09:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:16.788484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bea4af-08e4-4851-a029-cc7fd97f216a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:16.902876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:16.907079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1fb5c-1c46-41fd-8c5f-2c830470ced0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:16.938107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bea4af-08e4-4851-a029-cc7fd97f216a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:16.946805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e3b8f-96b9-4aed-a1bc-47f33c28f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:16.947451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e3b8f-96b9-4aed-a1bc-47f33c28f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.947732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e3b8f-96b9-4aed-a1bc-47f33c28f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.948003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e3b8f-96b9-4aed-a1bc-47f33c28f4a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.961924 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e3b8f-96b9-4aed-a1bc-47f33c28f4a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-6d1e3b8f-96b9-4aed-a1bc-47f33c28f4a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:16.967136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:16.969040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:09:16.971118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 546/1078] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:09:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:16.977347 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e3b8f-96b9-4aed-a1bc-47f33c28f4a0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:17.002619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:17.003290 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d11d15-7e8c-4ad0-b468-0ce73e4d5577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:17.004329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d11d15-7e8c-4ad0-b468-0ce73e4d5577 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:17.004834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d11d15-7e8c-4ad0-b468-0ce73e4d5577 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:17.005308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d11d15-7e8c-4ad0-b468-0ce73e4d5577 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:17.008327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d11d15-7e8c-4ad0-b468-0ce73e4d5577 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:17.008802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d11d15-7e8c-4ad0-b468-0ce73e4d5577 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:17.011478 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d11d15-7e8c-4ad0-b468-0ce73e4d5577 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:17.028284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 533/1079] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:09:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:17.037450 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d11d15-7e8c-4ad0-b468-0ce73e4d5577 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:17.112279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e3b8f-96b9-4aed-a1bc-47f33c28f4a0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:17.167158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d11d15-7e8c-4ad0-b468-0ce73e4d5577 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:17.179126 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4acac-4af7-49d0-875e-266570573e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:17.180026 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4acac-4af7-49d0-875e-266570573e50 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:17.180436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4acac-4af7-49d0-875e-266570573e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:17.180814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4acac-4af7-49d0-875e-266570573e50 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:17.181961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4acac-4af7-49d0-875e-266570573e50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:17.182476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4acac-4af7-49d0-875e-266570573e50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:17.184830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4acac-4af7-49d0-875e-266570573e50 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:17.199523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 547/1080] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:09:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:17.207040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4acac-4af7-49d0-875e-266570573e50 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:17.214173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff06091-dd77-40e1-8fa5-9e335d01824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:17.215225 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff06091-dd77-40e1-8fa5-9e335d01824b None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:17.215669 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff06091-dd77-40e1-8fa5-9e335d01824b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:17.216114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff06091-dd77-40e1-8fa5-9e335d01824b None admin] PATH_INFO: `/v3/projects/8e86d23a023e4db497277d055b604ebe/users/30946d3b3f0f4a81b2ae5aa6e84f3920/roles/cc4a817595fc4a5abef6fa6a8660cbf8` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:17.219677 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff06091-dd77-40e1-8fa5-9e335d01824b None admin] RBAC: Authorizing `identity:create_grant(project_id=8e86d23a023e4db497277d055b604ebe, user_id=30946d3b3f0f4a81b2ae5aa6e84f3920, role_id=cc4a817595fc4a5abef6fa6a8660cbf8)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:17.222310 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff06091-dd77-40e1-8fa5-9e335d01824b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:17.308243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:17.308590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 534/1081] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:09:17 2022] PUT /identity/v3/projects/8e86d23a023e4db497277d055b604ebe/users/30946d3b3f0f4a81b2ae5aa6e84f3920/roles/cc4a817595fc4a5abef6fa6a8660cbf8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:09:17.337582 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4acac-4af7-49d0-875e-266570573e50 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:17.389507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde40ee-62de-40ca-aa24-b7dc7c08e5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:17.390359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde40ee-62de-40ca-aa24-b7dc7c08e5db None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:17.390725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde40ee-62de-40ca-aa24-b7dc7c08e5db None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:17.391125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde40ee-62de-40ca-aa24-b7dc7c08e5db None admin] PATH_INFO: `/v3/users/2e0ed1057f7b4c68832f92bd9740a947` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:17.392593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde40ee-62de-40ca-aa24-b7dc7c08e5db None admin] RBAC: Authorizing `identity:get_user(user_id=2e0ed1057f7b4c68832f92bd9740a947)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:17.394219 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde40ee-62de-40ca-aa24-b7dc7c08e5db None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:17.396235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 548/1082] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:17 2022] GET /identity/v3/users/2e0ed1057f7b4c68832f92bd9740a947 => generated 285 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:17.404680 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff06091-dd77-40e1-8fa5-9e335d01824b None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:17.409606 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:17.570127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff06091-dd77-40e1-8fa5-9e335d01824b None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:17.613173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb88e6-eed3-4303-ac4c-87b7c7bb33dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:17.614365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb88e6-eed3-4303-ac4c-87b7c7bb33dc None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:17.614829 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb88e6-eed3-4303-ac4c-87b7c7bb33dc None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:17.615367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb88e6-eed3-4303-ac4c-87b7c7bb33dc None admin] PATH_INFO: `/v3/projects/6677efc2b7cd401da187dcaa208c216e` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:17.617489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb88e6-eed3-4303-ac4c-87b7c7bb33dc None admin] RBAC: Authorizing `identity:get_project(project_id=6677efc2b7cd401da187dcaa208c216e)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:17.620269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb88e6-eed3-4303-ac4c-87b7c7bb33dc None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:17.623638 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 535/1083] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:17 2022] GET /identity/v3/projects/6677efc2b7cd401da187dcaa208c216e => generated 311 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:17.631097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde40ee-62de-40ca-aa24-b7dc7c08e5db None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:17.774959 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde40ee-62de-40ca-aa24-b7dc7c08e5db None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:17.831372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667bf94-c973-4bc5-883e-c802092bb0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:17.832436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667bf94-c973-4bc5-883e-c802092bb0ec None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:17.832924 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667bf94-c973-4bc5-883e-c802092bb0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:17.833404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667bf94-c973-4bc5-883e-c802092bb0ec None admin] PATH_INFO: `/v3/projects/6677efc2b7cd401da187dcaa208c216e/users/2e0ed1057f7b4c68832f92bd9740a947/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:17.837611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667bf94-c973-4bc5-883e-c802092bb0ec None admin] RBAC: Authorizing `identity:create_grant(project_id=6677efc2b7cd401da187dcaa208c216e, user_id=2e0ed1057f7b4c68832f92bd9740a947, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:17.840402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667bf94-c973-4bc5-883e-c802092bb0ec None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:18.061949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 549/1084] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:09:17 2022] PUT /identity/v3/projects/6677efc2b7cd401da187dcaa208c216e/users/2e0ed1057f7b4c68832f92bd9740a947/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:09:19.358157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eee2e-59af-4fc3-8730-126f0450e35e None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:19.358702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eee2e-59af-4fc3-8730-126f0450e35e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:19.358795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eee2e-59af-4fc3-8730-126f0450e35e None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:19.360127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 536/1085] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:19.366168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d9abb-7c0f-40b1-9a91-6c7dd7d99cde None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:19.366987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d9abb-7c0f-40b1-9a91-6c7dd7d99cde None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:19.366987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d9abb-7c0f-40b1-9a91-6c7dd7d99cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:19.386730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-da3d9abb-7c0f-40b1-9a91-6c7dd7d99cde None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:19.387940 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-da3d9abb-7c0f-40b1-9a91-6c7dd7d99cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:19.391146 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:19.501240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 550/1086] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:19.872536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863eee2e-59af-4fc3-8730-126f0450e35e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:19.960103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:20.002190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863eee2e-59af-4fc3-8730-126f0450e35e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:20.042860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c8cb8-b762-4b41-96db-6912dfa5aade None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:20.044371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c8cb8-b762-4b41-96db-6912dfa5aade None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:20.046214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c8cb8-b762-4b41-96db-6912dfa5aade None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:20.046874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be972f5-5a50-4a02-a52f-d374708dc7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:20.047621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be972f5-5a50-4a02-a52f-d374708dc7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:20.049027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be972f5-5a50-4a02-a52f-d374708dc7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:20.049027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be972f5-5a50-4a02-a52f-d374708dc7c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:20.049329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 551/1087] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:20.054564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557a507-4fed-49c6-99bd-e5aaae1399be None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:20.054843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557a507-4fed-49c6-99bd-e5aaae1399be None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:20.055113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557a507-4fed-49c6-99bd-e5aaae1399be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:20.061880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be972f5-5a50-4a02-a52f-d374708dc7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-3be972f5-5a50-4a02-a52f-d374708dc7c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:20.067355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:20.068803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:20.069805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 537/1088] 10.222.0.81 () {56 vars in 1120 bytes} [Mon Aug 29 20:09:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:20.076140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be972f5-5a50-4a02-a52f-d374708dc7c1 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:20.081133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e557a507-4fed-49c6-99bd-e5aaae1399be None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:20.082419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e557a507-4fed-49c6-99bd-e5aaae1399be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:20.158360 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 552/1089] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:20.188900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be972f5-5a50-4a02-a52f-d374708dc7c1 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:20.218457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:20.224439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb434da-ced1-401a-b6b1-dc89d266b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:20.225817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb434da-ced1-401a-b6b1-dc89d266b2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:20.231279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb434da-ced1-401a-b6b1-dc89d266b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:20.231279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb434da-ced1-401a-b6b1-dc89d266b2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:20.231279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb434da-ced1-401a-b6b1-dc89d266b2c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:20.231279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb434da-ced1-401a-b6b1-dc89d266b2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:20.231279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb434da-ced1-401a-b6b1-dc89d266b2c8 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:20.237497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 538/1090] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Aug 29 20:09:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:20.243943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557a507-4fed-49c6-99bd-e5aaae1399be None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:20.323371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:20.360208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557a507-4fed-49c6-99bd-e5aaae1399be None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:20.399098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa802-32c2-42df-818e-e250845c4e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:20.399873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa802-32c2-42df-818e-e250845c4e36 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:20.399988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa802-32c2-42df-818e-e250845c4e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:20.400252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa802-32c2-42df-818e-e250845c4e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:20.411378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fa802-32c2-42df-818e-e250845c4e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:20.413260 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fa802-32c2-42df-818e-e250845c4e36 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2b1fa802-32c2-42df-818e-e250845c4e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:20.429706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:20.430805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:20.432120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:20.432120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:20.432120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:09:20.432120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 553/1091] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:20.439466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb434da-ced1-401a-b6b1-dc89d266b2c8 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:20.465742 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa802-32c2-42df-818e-e250845c4e36 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:20.670565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa802-32c2-42df-818e-e250845c4e36 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:20.685989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb434da-ced1-401a-b6b1-dc89d266b2c8 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:20.695123 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:20.711259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443aa4a-4515-4d88-9062-0e1f7227c216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:20.711915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443aa4a-4515-4d88-9062-0e1f7227c216 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:20.712195 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443aa4a-4515-4d88-9062-0e1f7227c216 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:20.712466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443aa4a-4515-4d88-9062-0e1f7227c216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:20.724323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443aa4a-4515-4d88-9062-0e1f7227c216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:20.726456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cadc7-0b06-4e07-ba43-65a79e5b80d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:20.727458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cadc7-0b06-4e07-ba43-65a79e5b80d3 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:20.727913 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cadc7-0b06-4e07-ba43-65a79e5b80d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:20.728280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cadc7-0b06-4e07-ba43-65a79e5b80d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:20.728931 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cadc7-0b06-4e07-ba43-65a79e5b80d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:20.729233 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cadc7-0b06-4e07-ba43-65a79e5b80d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2443aa4a-4515-4d88-9062-0e1f7227c216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:20.729339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:20.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:09:20.731079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 554/1092] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:09:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:20.731749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cadc7-0b06-4e07-ba43-65a79e5b80d3 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:20.736751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443aa4a-4515-4d88-9062-0e1f7227c216 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:20.744740 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 539/1093] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:20.750288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cadc7-0b06-4e07-ba43-65a79e5b80d3 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:20.810743 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:20.861122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443aa4a-4515-4d88-9062-0e1f7227c216 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:20.863982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cadc7-0b06-4e07-ba43-65a79e5b80d3 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:20.907873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb80a15-49b5-49f7-9497-4ae521a3db10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:20.908695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb80a15-49b5-49f7-9497-4ae521a3db10 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:20.909167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb80a15-49b5-49f7-9497-4ae521a3db10 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:20.909608 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb80a15-49b5-49f7-9497-4ae521a3db10 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:20.910872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb80a15-49b5-49f7-9497-4ae521a3db10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:20.911393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb80a15-49b5-49f7-9497-4ae521a3db10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:20.913894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb80a15-49b5-49f7-9497-4ae521a3db10 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:20.918125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49f7d0-335f-42b7-a627-846b876819a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:20.919107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49f7d0-335f-42b7-a627-846b876819a9 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:20.919547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49f7d0-335f-42b7-a627-846b876819a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:20.919981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49f7d0-335f-42b7-a627-846b876819a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:20.931206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 555/1094] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:09:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:20.937733 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49f7d0-335f-42b7-a627-846b876819a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:20.937939 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb80a15-49b5-49f7-9497-4ae521a3db10 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:20.939239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49f7d0-335f-42b7-a627-846b876819a9 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-8b49f7d0-335f-42b7-a627-846b876819a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:09:20.964184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:20.965366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:20.966367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:20.966367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:20.966367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:09:20.966367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:09:20.966367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:09:20.966367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:09:20.966367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:09:20.966367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:09:20.966367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:09:20.966367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:20.966367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 540/1095] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Aug 29 20:09:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:20.975706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49f7d0-335f-42b7-a627-846b876819a9 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:21.005213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:21.080712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb80a15-49b5-49f7-9497-4ae521a3db10 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:21.098171 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49f7d0-335f-42b7-a627-846b876819a9 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:21.121752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:21.124425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952c503-39f1-4223-ac87-a0126a572b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:21.125238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952c503-39f1-4223-ac87-a0126a572b84 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:21.125608 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952c503-39f1-4223-ac87-a0126a572b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:21.125984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952c503-39f1-4223-ac87-a0126a572b84 None admin] PATH_INFO: `/v3/users/2e0ed1057f7b4c68832f92bd9740a947` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:21.127406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952c503-39f1-4223-ac87-a0126a572b84 None admin] RBAC: Authorizing `identity:get_user(user_id=2e0ed1057f7b4c68832f92bd9740a947)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:21.129019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952c503-39f1-4223-ac87-a0126a572b84 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:21.131166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 556/1096] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:20 2022] GET /identity/v3/users/2e0ed1057f7b4c68832f92bd9740a947 => generated 285 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:21.137647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952c503-39f1-4223-ac87-a0126a572b84 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:21.155309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fb93e-950d-44e5-8e83-9578dd3ee7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:21.156379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fb93e-950d-44e5-8e83-9578dd3ee7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:21.156865 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fb93e-950d-44e5-8e83-9578dd3ee7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:21.157500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fb93e-950d-44e5-8e83-9578dd3ee7a6 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:21.158269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fb93e-950d-44e5-8e83-9578dd3ee7a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:21.158579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fb93e-950d-44e5-8e83-9578dd3ee7a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:21.160031 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fb93e-950d-44e5-8e83-9578dd3ee7a6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:21.192594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 541/1097] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Aug 29 20:09:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:21.200313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fb93e-950d-44e5-8e83-9578dd3ee7a6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:21.268005 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952c503-39f1-4223-ac87-a0126a572b84 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:21.283915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:21.315719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e469194-7f9d-4bb9-a5fc-356d2742971a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:21.316516 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e469194-7f9d-4bb9-a5fc-356d2742971a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:21.316973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e469194-7f9d-4bb9-a5fc-356d2742971a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:21.317355 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e469194-7f9d-4bb9-a5fc-356d2742971a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:21.327983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fb93e-950d-44e5-8e83-9578dd3ee7a6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:21.376379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8f4a6-51e1-45ff-90b7-38eeeb463f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:21.376993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8f4a6-51e1-45ff-90b7-38eeeb463f2d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:21.377271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8f4a6-51e1-45ff-90b7-38eeeb463f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:21.377541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8f4a6-51e1-45ff-90b7-38eeeb463f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:21.438385 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:21.440319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e469194-7f9d-4bb9-a5fc-356d2742971a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:21.447759 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e469194-7f9d-4bb9-a5fc-356d2742971a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:21.485674 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8f4a6-51e1-45ff-90b7-38eeeb463f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:21.488236 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8f4a6-51e1-45ff-90b7-38eeeb463f2d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:21.597673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 557/1098] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:09:21.604617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e469194-7f9d-4bb9-a5fc-356d2742971a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:21.622121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:21.632782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 542/1099] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:21.638481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8f4a6-51e1-45ff-90b7-38eeeb463f2d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:21.717728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e469194-7f9d-4bb9-a5fc-356d2742971a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:21.724040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:21.762973 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8f4a6-51e1-45ff-90b7-38eeeb463f2d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:21.770253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1047e-be1d-4e3b-9815-3d37a72d34b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:21.771733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1047e-be1d-4e3b-9815-3d37a72d34b1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:21.772060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1047e-be1d-4e3b-9815-3d37a72d34b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:21.772757 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1047e-be1d-4e3b-9815-3d37a72d34b1 None admin] PATH_INFO: `/v3/projects/6677efc2b7cd401da187dcaa208c216e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:21.774988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1047e-be1d-4e3b-9815-3d37a72d34b1 None admin] RBAC: Authorizing `identity:get_project(project_id=6677efc2b7cd401da187dcaa208c216e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:21.777751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1047e-be1d-4e3b-9815-3d37a72d34b1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:21.786040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 558/1100] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:21 2022] GET /identity/v3/projects/6677efc2b7cd401da187dcaa208c216e => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:21.789785 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1047e-be1d-4e3b-9815-3d37a72d34b1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:21.806104 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d824f-5953-4900-89cb-9268fe3870ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:21.806931 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d824f-5953-4900-89cb-9268fe3870ba None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:21.807362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d824f-5953-4900-89cb-9268fe3870ba None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:21.807770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d824f-5953-4900-89cb-9268fe3870ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:21.822725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d824f-5953-4900-89cb-9268fe3870ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:21.824266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d824f-5953-4900-89cb-9268fe3870ba None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-083d824f-5953-4900-89cb-9268fe3870ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:21.841764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:21.843708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:21.845610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:21.845610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:21.845610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:21.845610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 543/1101] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:21.850604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d824f-5953-4900-89cb-9268fe3870ba None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:21.898876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:21.920903 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1047e-be1d-4e3b-9815-3d37a72d34b1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:21.973445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2014764-6d6d-409f-9387-a225f602fc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:21.974541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2014764-6d6d-409f-9387-a225f602fc20 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:21.974894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2014764-6d6d-409f-9387-a225f602fc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:21.975336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2014764-6d6d-409f-9387-a225f602fc20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:21.976617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2014764-6d6d-409f-9387-a225f602fc20 None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=6677efc2b7cd401da187dcaa208c216e, user.id=2e0ed1057f7b4c68832f92bd9740a947) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:21.977124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2014764-6d6d-409f-9387-a225f602fc20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:21.979634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2014764-6d6d-409f-9387-a225f602fc20 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:21.988558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d824f-5953-4900-89cb-9268fe3870ba None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:21.990557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 559/1102] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:21 2022] GET /identity/v3/role_assignments?user.id=2e0ed1057f7b4c68832f92bd9740a947&scope.project.id=6677efc2b7cd401da187dcaa208c216e&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:22.024176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:22.039375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab3c52-023f-4410-b369-dec3038667bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:22.040016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3c52-023f-4410-b369-dec3038667bf None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:22.040299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3c52-023f-4410-b369-dec3038667bf None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:22.044391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3c52-023f-4410-b369-dec3038667bf None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:22.044391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab3c52-023f-4410-b369-dec3038667bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:22.044391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab3c52-023f-4410-b369-dec3038667bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:22.044391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab3c52-023f-4410-b369-dec3038667bf None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:22.059388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 544/1103] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:22.066045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2014764-6d6d-409f-9387-a225f602fc20 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:22.200527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2014764-6d6d-409f-9387-a225f602fc20 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:22.239571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175715c-60ed-477e-8010-dc808823d8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:22.240536 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175715c-60ed-477e-8010-dc808823d8ac None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:22.240825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175715c-60ed-477e-8010-dc808823d8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:22.241307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175715c-60ed-477e-8010-dc808823d8ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:22.248993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175715c-60ed-477e-8010-dc808823d8ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:22.250492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175715c-60ed-477e-8010-dc808823d8ac None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b175715c-60ed-477e-8010-dc808823d8ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:09:22.263545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:22.264876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:22.265902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:09:22.265902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:09:22.265902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:09:22.265902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:09:22.265902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:09:22.265902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:09:22.265902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:09:22.265902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:09:22.265902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 560/1104] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:09:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:22.273501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab3c52-023f-4410-b369-dec3038667bf None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:22.394696 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab3c52-023f-4410-b369-dec3038667bf None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:22.436387 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60f0c-b7d8-40ed-8fa3-73a7eab777f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:22.436997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60f0c-b7d8-40ed-8fa3-73a7eab777f7 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:22.437273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60f0c-b7d8-40ed-8fa3-73a7eab777f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:22.437546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60f0c-b7d8-40ed-8fa3-73a7eab777f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:22.438308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60f0c-b7d8-40ed-8fa3-73a7eab777f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:22.438569 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60f0c-b7d8-40ed-8fa3-73a7eab777f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:22.440034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60f0c-b7d8-40ed-8fa3-73a7eab777f7 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:22.453730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 545/1105] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:09:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:22.461154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175715c-60ed-477e-8010-dc808823d8ac None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:22.465305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:22.586048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175715c-60ed-477e-8010-dc808823d8ac None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:22.622517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db7c0c-e245-43a2-844e-d4206bfe4c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:22.623127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db7c0c-e245-43a2-844e-d4206bfe4c2f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:22.623404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db7c0c-e245-43a2-844e-d4206bfe4c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:22.623671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db7c0c-e245-43a2-844e-d4206bfe4c2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:22.624396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db7c0c-e245-43a2-844e-d4206bfe4c2f None admin] RBAC: Adding query filter params (role.id=cc4a817595fc4a5abef6fa6a8660cbf8, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=30946d3b3f0f4a81b2ae5aa6e84f3920) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:22.624704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db7c0c-e245-43a2-844e-d4206bfe4c2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:22.626145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db7c0c-e245-43a2-844e-d4206bfe4c2f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:22.632965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 561/1106] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:22 2022] GET /identity/v3/role_assignments?user.id=30946d3b3f0f4a81b2ae5aa6e84f3920&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=cc4a817595fc4a5abef6fa6a8660cbf8 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:24.209133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb585766-b061-41c7-8ca8-d97fe357b1fd None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:24.209678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb585766-b061-41c7-8ca8-d97fe357b1fd None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:24.209678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb585766-b061-41c7-8ca8-d97fe357b1fd None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:24.211113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 546/1107] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:24.217103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1345171-3518-4c85-9474-4471679794b2 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:24.217601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1345171-3518-4c85-9474-4471679794b2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:24.217688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1345171-3518-4c85-9474-4471679794b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:24.238776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b1345171-3518-4c85-9474-4471679794b2 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:24.240616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b1345171-3518-4c85-9474-4471679794b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:24.311949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:24.317623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 562/1108] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:24.611235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb585766-b061-41c7-8ca8-d97fe357b1fd None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:24.664636 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:24.770516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb585766-b061-41c7-8ca8-d97fe357b1fd None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:24.828655 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfeb61-1103-429a-be83-2a4a595a6bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:24.829639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfeb61-1103-429a-be83-2a4a595a6bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:24.830034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfeb61-1103-429a-be83-2a4a595a6bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:24.830439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfeb61-1103-429a-be83-2a4a595a6bc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:24.832038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfeb61-1103-429a-be83-2a4a595a6bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:24.834573 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfeb61-1103-429a-be83-2a4a595a6bc4 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:24.837028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 547/1109] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:24.843240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1345171-3518-4c85-9474-4471679794b2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:24.962701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1345171-3518-4c85-9474-4471679794b2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:25.001174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd8653-bbc9-4281-9500-d1cda181bca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:25.001784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd8653-bbc9-4281-9500-d1cda181bca0 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:25.002066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd8653-bbc9-4281-9500-d1cda181bca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:25.002373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd8653-bbc9-4281-9500-d1cda181bca0 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:25.003050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd8653-bbc9-4281-9500-d1cda181bca0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:25.004512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd8653-bbc9-4281-9500-d1cda181bca0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:25.122313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 563/1110] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:09:24 2022] POST /identity/v3/users => generated 286 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:09:27.198723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f079fd-50e6-4f51-a066-7ac66f686e9a None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:27.199335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f079fd-50e6-4f51-a066-7ac66f686e9a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:27.199335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f079fd-50e6-4f51-a066-7ac66f686e9a None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:27.200750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 548/1111] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:27.206784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ddd24-ed0e-4edc-bbc9-b580a2eeabe6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:27.207377 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ddd24-ed0e-4edc-bbc9-b580a2eeabe6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:27.207377 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ddd24-ed0e-4edc-bbc9-b580a2eeabe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:27.229223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1f7ddd24-ed0e-4edc-bbc9-b580a2eeabe6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:27.230658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1f7ddd24-ed0e-4edc-bbc9-b580a2eeabe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:27.291044 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:27.311054 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 564/1112] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:27.586137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f079fd-50e6-4f51-a066-7ac66f686e9a None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:27.705089 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f079fd-50e6-4f51-a066-7ac66f686e9a None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:27.718094 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:27.744481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4af56-8dbb-45dd-ae87-c4c880ecc6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:27.745140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4af56-8dbb-45dd-ae87-c4c880ecc6ea None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:27.745424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4af56-8dbb-45dd-ae87-c4c880ecc6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:27.745700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4af56-8dbb-45dd-ae87-c4c880ecc6ea None admin] PATH_INFO: `/v3/roles/3b2b994bb5314391bf684502bd09e733` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:27.747198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4af56-8dbb-45dd-ae87-c4c880ecc6ea None admin] RBAC: Authorizing `identity:get_role(role_id=3b2b994bb5314391bf684502bd09e733)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:27.748594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4af56-8dbb-45dd-ae87-c4c880ecc6ea None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:27.749990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 549/1113] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:27 2022] GET /identity/v3/roles/3b2b994bb5314391bf684502bd09e733 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:27.760904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ddd24-ed0e-4edc-bbc9-b580a2eeabe6 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:27.878141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ddd24-ed0e-4edc-bbc9-b580a2eeabe6 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:27.920555 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e9844-9c2d-46dd-ac6b-f9136d89d57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:27.921253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e9844-9c2d-46dd-ac6b-f9136d89d57c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:27.921752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e9844-9c2d-46dd-ac6b-f9136d89d57c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:27.922060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e9844-9c2d-46dd-ac6b-f9136d89d57c None admin] PATH_INFO: `/v3/users/878d1de2412f420eaa9cb75101d1dc68` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:27.938442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e9844-9c2d-46dd-ac6b-f9136d89d57c None admin] RBAC: Authorizing `identity:get_user(user_id=878d1de2412f420eaa9cb75101d1dc68)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:27.939918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e9844-9c2d-46dd-ac6b-f9136d89d57c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:27.941689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 565/1114] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:27 2022] GET /identity/v3/users/878d1de2412f420eaa9cb75101d1dc68 => generated 286 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:27.949258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4af56-8dbb-45dd-ae87-c4c880ecc6ea None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:28.072083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4af56-8dbb-45dd-ae87-c4c880ecc6ea None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:28.113169 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6825ff-ce28-4326-ad40-a1c22597e710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:28.113787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6825ff-ce28-4326-ad40-a1c22597e710 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:28.114065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6825ff-ce28-4326-ad40-a1c22597e710 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:28.114473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6825ff-ce28-4326-ad40-a1c22597e710 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:28.168485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:28.194314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6825ff-ce28-4326-ad40-a1c22597e710 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:28.195813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6825ff-ce28-4326-ad40-a1c22597e710 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:28.312756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 550/1115] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:28.319287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e9844-9c2d-46dd-ac6b-f9136d89d57c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:28.373599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:28.445359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e9844-9c2d-46dd-ac6b-f9136d89d57c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:28.493775 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee27bc4-1b4a-4d00-bce4-a1dc5635e680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:28.494557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee27bc4-1b4a-4d00-bce4-a1dc5635e680 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:28.494793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee27bc4-1b4a-4d00-bce4-a1dc5635e680 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:28.495015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee27bc4-1b4a-4d00-bce4-a1dc5635e680 None admin] PATH_INFO: `/v3/projects/6677efc2b7cd401da187dcaa208c216e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:28.496244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee27bc4-1b4a-4d00-bce4-a1dc5635e680 None admin] RBAC: Authorizing `identity:get_project(project_id=6677efc2b7cd401da187dcaa208c216e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:28.497709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee27bc4-1b4a-4d00-bce4-a1dc5635e680 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:28.499486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 566/1116] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:28 2022] GET /identity/v3/projects/6677efc2b7cd401da187dcaa208c216e => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:28.505996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6825ff-ce28-4326-ad40-a1c22597e710 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:28.597837 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:28.624327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6825ff-ce28-4326-ad40-a1c22597e710 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:28.665350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72412a41-9f64-4bc4-b879-2f7d80ccba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:28.665970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72412a41-9f64-4bc4-b879-2f7d80ccba2d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:28.666272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72412a41-9f64-4bc4-b879-2f7d80ccba2d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:28.666541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72412a41-9f64-4bc4-b879-2f7d80ccba2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:28.667287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72412a41-9f64-4bc4-b879-2f7d80ccba2d None admin] RBAC: Adding query filter params (role.id=3b2b994bb5314391bf684502bd09e733, scope.project.id=6677efc2b7cd401da187dcaa208c216e, user.id=878d1de2412f420eaa9cb75101d1dc68) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:28.667594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72412a41-9f64-4bc4-b879-2f7d80ccba2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:28.669037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72412a41-9f64-4bc4-b879-2f7d80ccba2d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:28.675637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 551/1117] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:28 2022] GET /identity/v3/role_assignments?user.id=878d1de2412f420eaa9cb75101d1dc68&scope.project.id=6677efc2b7cd401da187dcaa208c216e&role.id=3b2b994bb5314391bf684502bd09e733 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:30.718406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff0ce6-8592-405e-a02a-be6798db794d None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:30.718978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff0ce6-8592-405e-a02a-be6798db794d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:30.718978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff0ce6-8592-405e-a02a-be6798db794d None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:30.720430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 567/1118] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:30.726527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf009c-2b93-4d38-8b2d-2127ba5e1439 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:30.727074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf009c-2b93-4d38-8b2d-2127ba5e1439 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:30.727074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf009c-2b93-4d38-8b2d-2127ba5e1439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:30.747169 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-7edf009c-2b93-4d38-8b2d-2127ba5e1439 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:30.748398 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7edf009c-2b93-4d38-8b2d-2127ba5e1439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:30.839126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 552/1119] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:31.121989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff0ce6-8592-405e-a02a-be6798db794d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:31.238158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff0ce6-8592-405e-a02a-be6798db794d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:31.251757 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:31.277081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e36607-1141-4653-9ad1-07afb4cea621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:31.277727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e36607-1141-4653-9ad1-07afb4cea621 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:31.277998 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e36607-1141-4653-9ad1-07afb4cea621 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:31.278289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e36607-1141-4653-9ad1-07afb4cea621 None admin] PATH_INFO: `/v3/roles/3b2b994bb5314391bf684502bd09e733` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:31.279751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e36607-1141-4653-9ad1-07afb4cea621 None admin] RBAC: Authorizing `identity:get_role(role_id=3b2b994bb5314391bf684502bd09e733)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:31.281116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e36607-1141-4653-9ad1-07afb4cea621 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:31.282504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 568/1120] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:31 2022] GET /identity/v3/roles/3b2b994bb5314391bf684502bd09e733 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:31.289388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf009c-2b93-4d38-8b2d-2127ba5e1439 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:31.370788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:31.407240 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf009c-2b93-4d38-8b2d-2127ba5e1439 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:31.457269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecc627-8986-4df9-b398-aa54efa8a4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:31.457909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecc627-8986-4df9-b398-aa54efa8a4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:31.458775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecc627-8986-4df9-b398-aa54efa8a4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:31.459059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecc627-8986-4df9-b398-aa54efa8a4e7 None admin] PATH_INFO: `/v3/users/878d1de2412f420eaa9cb75101d1dc68` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:31.460306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecc627-8986-4df9-b398-aa54efa8a4e7 None admin] RBAC: Authorizing `identity:get_user(user_id=878d1de2412f420eaa9cb75101d1dc68)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:31.461752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecc627-8986-4df9-b398-aa54efa8a4e7 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:31.463434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 553/1121] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:31 2022] GET /identity/v3/users/878d1de2412f420eaa9cb75101d1dc68 => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:31.472321 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e36607-1141-4653-9ad1-07afb4cea621 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:31.609374 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e36607-1141-4653-9ad1-07afb4cea621 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:31.649609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab18890-f1cd-4cc7-bc45-be1e1392c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:31.650276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab18890-f1cd-4cc7-bc45-be1e1392c57e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:31.650549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab18890-f1cd-4cc7-bc45-be1e1392c57e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:31.650882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab18890-f1cd-4cc7-bc45-be1e1392c57e None admin] PATH_INFO: `/v3/projects/6677efc2b7cd401da187dcaa208c216e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:31.651991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab18890-f1cd-4cc7-bc45-be1e1392c57e None admin] RBAC: Authorizing `identity:get_project(project_id=6677efc2b7cd401da187dcaa208c216e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:31.653439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab18890-f1cd-4cc7-bc45-be1e1392c57e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:31.655347 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 569/1122] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:31 2022] GET /identity/v3/projects/6677efc2b7cd401da187dcaa208c216e => generated 311 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:31.665113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecc627-8986-4df9-b398-aa54efa8a4e7 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:31.782986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecc627-8986-4df9-b398-aa54efa8a4e7 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:31.821372 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2f3a9-2243-4e2b-b257-a4a6262f8ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:31.822052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2f3a9-2243-4e2b-b257-a4a6262f8ed8 None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:31.822359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2f3a9-2243-4e2b-b257-a4a6262f8ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:31.822631 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2f3a9-2243-4e2b-b257-a4a6262f8ed8 None admin] PATH_INFO: `/v3/projects/6677efc2b7cd401da187dcaa208c216e/users/878d1de2412f420eaa9cb75101d1dc68/roles/3b2b994bb5314391bf684502bd09e733` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:31.824960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2f3a9-2243-4e2b-b257-a4a6262f8ed8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6677efc2b7cd401da187dcaa208c216e, user_id=878d1de2412f420eaa9cb75101d1dc68, role_id=3b2b994bb5314391bf684502bd09e733)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:31.826470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2f3a9-2243-4e2b-b257-a4a6262f8ed8 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:31.913576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:31.918873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 554/1123] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:09:31 2022] PUT /identity/v3/projects/6677efc2b7cd401da187dcaa208c216e/users/878d1de2412f420eaa9cb75101d1dc68/roles/3b2b994bb5314391bf684502bd09e733 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:09:34.052884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a19a0d-fc55-4246-b905-41f3f02061c0 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:34.054002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a19a0d-fc55-4246-b905-41f3f02061c0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:34.054002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a19a0d-fc55-4246-b905-41f3f02061c0 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:34.054911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 570/1124] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:34.065571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71dc86-5f60-4c6a-be3c-b1026ad6ec9c None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:34.066144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71dc86-5f60-4c6a-be3c-b1026ad6ec9c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:34.066144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71dc86-5f60-4c6a-be3c-b1026ad6ec9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:34.086376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-bf71dc86-5f60-4c6a-be3c-b1026ad6ec9c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:34.087802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bf71dc86-5f60-4c6a-be3c-b1026ad6ec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:34.170065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 555/1125] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:34.448948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a19a0d-fc55-4246-b905-41f3f02061c0 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:34.511631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:34.577121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a19a0d-fc55-4246-b905-41f3f02061c0 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:34.617974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa5df0-7212-40cf-ae87-7e2574bc38ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:34.618553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa5df0-7212-40cf-ae87-7e2574bc38ee None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:34.618832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa5df0-7212-40cf-ae87-7e2574bc38ee None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:34.619105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa5df0-7212-40cf-ae87-7e2574bc38ee None admin] PATH_INFO: `/v3/roles/3b2b994bb5314391bf684502bd09e733` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:34.620629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa5df0-7212-40cf-ae87-7e2574bc38ee None admin] RBAC: Authorizing `identity:get_role(role_id=3b2b994bb5314391bf684502bd09e733)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:34.622034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa5df0-7212-40cf-ae87-7e2574bc38ee None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:34.623479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 571/1126] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:34 2022] GET /identity/v3/roles/3b2b994bb5314391bf684502bd09e733 => generated 223 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:34.629655 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71dc86-5f60-4c6a-be3c-b1026ad6ec9c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:34.742299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71dc86-5f60-4c6a-be3c-b1026ad6ec9c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:34.774848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:34.780972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e30a2-bf93-470e-8f7a-b3609ad29a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:34.781670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e30a2-bf93-470e-8f7a-b3609ad29a29 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:34.781998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e30a2-bf93-470e-8f7a-b3609ad29a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:34.782401 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e30a2-bf93-470e-8f7a-b3609ad29a29 None admin] PATH_INFO: `/v3/users/878d1de2412f420eaa9cb75101d1dc68` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:34.794438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e30a2-bf93-470e-8f7a-b3609ad29a29 None admin] RBAC: Authorizing `identity:get_user(user_id=878d1de2412f420eaa9cb75101d1dc68)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:34.794438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e30a2-bf93-470e-8f7a-b3609ad29a29 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:34.794438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 556/1127] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:34 2022] GET /identity/v3/users/878d1de2412f420eaa9cb75101d1dc68 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:34.794835 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa5df0-7212-40cf-ae87-7e2574bc38ee None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:34.913049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa5df0-7212-40cf-ae87-7e2574bc38ee None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:34.930044 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:34.951655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7d19-7cef-4827-b0bf-fcc0c41ee743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:34.952315 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7d19-7cef-4827-b0bf-fcc0c41ee743 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:34.952628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7d19-7cef-4827-b0bf-fcc0c41ee743 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:34.952933 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7d19-7cef-4827-b0bf-fcc0c41ee743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:35.033813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7d19-7cef-4827-b0bf-fcc0c41ee743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:35.035312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7d19-7cef-4827-b0bf-fcc0c41ee743 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:35.157423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 572/1128] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:35.165203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e30a2-bf93-470e-8f7a-b3609ad29a29 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:35.343244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e30a2-bf93-470e-8f7a-b3609ad29a29 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:35.387760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065886d-1fcd-48b7-b821-c89b45aaa612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:35.388540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065886d-1fcd-48b7-b821-c89b45aaa612 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:35.388869 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065886d-1fcd-48b7-b821-c89b45aaa612 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:35.389189 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065886d-1fcd-48b7-b821-c89b45aaa612 None admin] PATH_INFO: `/v3/projects/6677efc2b7cd401da187dcaa208c216e` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:35.390462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065886d-1fcd-48b7-b821-c89b45aaa612 None admin] RBAC: Authorizing `identity:get_project(project_id=6677efc2b7cd401da187dcaa208c216e)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:35.391981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065886d-1fcd-48b7-b821-c89b45aaa612 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:35.393759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 557/1129] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:35 2022] GET /identity/v3/projects/6677efc2b7cd401da187dcaa208c216e => generated 311 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:35.401296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7d19-7cef-4827-b0bf-fcc0c41ee743 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:35.417974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:35.514791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7d19-7cef-4827-b0bf-fcc0c41ee743 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:35.554040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1740ed-59cb-4e6e-b27d-cc9a7eb5530d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:35.554816 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1740ed-59cb-4e6e-b27d-cc9a7eb5530d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:35.555165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1740ed-59cb-4e6e-b27d-cc9a7eb5530d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:35.555492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1740ed-59cb-4e6e-b27d-cc9a7eb5530d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:35.556235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1740ed-59cb-4e6e-b27d-cc9a7eb5530d None admin] RBAC: Adding query filter params (role.id=3b2b994bb5314391bf684502bd09e733, scope.project.id=6677efc2b7cd401da187dcaa208c216e, user.id=878d1de2412f420eaa9cb75101d1dc68) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:35.556545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1740ed-59cb-4e6e-b27d-cc9a7eb5530d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:35.558354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1740ed-59cb-4e6e-b27d-cc9a7eb5530d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:35.565208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 573/1130] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:35 2022] GET /identity/v3/role_assignments?user.id=878d1de2412f420eaa9cb75101d1dc68&scope.project.id=6677efc2b7cd401da187dcaa208c216e&role.id=3b2b994bb5314391bf684502bd09e733 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:37.647788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e496d2-e654-4995-888c-5809bdef989c None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:37.648394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e496d2-e654-4995-888c-5809bdef989c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:37.648394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e496d2-e654-4995-888c-5809bdef989c None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:37.649724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 558/1131] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:37.655959 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc28fb-4e70-4620-9530-111ff6e77c3a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:37.656508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc28fb-4e70-4620-9530-111ff6e77c3a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:37.656508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc28fb-4e70-4620-9530-111ff6e77c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:37.677983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-facc28fb-4e70-4620-9530-111ff6e77c3a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:37.679276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-facc28fb-4e70-4620-9530-111ff6e77c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:37.756679 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 574/1132] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:38.037361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e496d2-e654-4995-888c-5809bdef989c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:38.117516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:38.160128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e496d2-e654-4995-888c-5809bdef989c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:38.201359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359188e0-f13e-43b5-ac24-7524d8ab0095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:38.202020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359188e0-f13e-43b5-ac24-7524d8ab0095 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:38.202331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359188e0-f13e-43b5-ac24-7524d8ab0095 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:38.202602 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359188e0-f13e-43b5-ac24-7524d8ab0095 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:38.203781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359188e0-f13e-43b5-ac24-7524d8ab0095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:38.205276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359188e0-f13e-43b5-ac24-7524d8ab0095 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:38.207115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 559/1133] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:38.213350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc28fb-4e70-4620-9530-111ff6e77c3a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:38.224467 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:38.329099 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc28fb-4e70-4620-9530-111ff6e77c3a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:38.375159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e37266-8041-41d4-89cc-745c845679dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:38.376195 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e37266-8041-41d4-89cc-745c845679dd None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:38.376688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e37266-8041-41d4-89cc-745c845679dd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:38.377169 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e37266-8041-41d4-89cc-745c845679dd None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:38.378354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e37266-8041-41d4-89cc-745c845679dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:38.380372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e37266-8041-41d4-89cc-745c845679dd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:38.496266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 575/1134] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:09:38 2022] POST /identity/v3/projects => generated 311 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:09:40.816625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9d869-5c7f-4036-ada2-5bdeab956e8b None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:40.817268 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9d869-5c7f-4036-ada2-5bdeab956e8b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:40.817268 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9d869-5c7f-4036-ada2-5bdeab956e8b None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:40.818640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 560/1135] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:40.824712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ef340-fb1a-4aa2-83a5-bca2f0e687c6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:40.825252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ef340-fb1a-4aa2-83a5-bca2f0e687c6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:40.825430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ef340-fb1a-4aa2-83a5-bca2f0e687c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:40.845202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6b2ef340-fb1a-4aa2-83a5-bca2f0e687c6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:40.846701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6b2ef340-fb1a-4aa2-83a5-bca2f0e687c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:40.916192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:40.929571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 576/1136] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:41.208791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9d869-5c7f-4036-ada2-5bdeab956e8b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:41.357839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9d869-5c7f-4036-ada2-5bdeab956e8b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:41.401057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca339d52-d89e-4eb8-b2ff-31cfb9afb340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:41.401829 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339d52-d89e-4eb8-b2ff-31cfb9afb340 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:41.402108 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339d52-d89e-4eb8-b2ff-31cfb9afb340 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:41.402412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339d52-d89e-4eb8-b2ff-31cfb9afb340 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:41.403601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca339d52-d89e-4eb8-b2ff-31cfb9afb340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:41.405273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca339d52-d89e-4eb8-b2ff-31cfb9afb340 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:41.406990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 561/1137] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:41.415222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ef340-fb1a-4aa2-83a5-bca2f0e687c6 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:41.579320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ef340-fb1a-4aa2-83a5-bca2f0e687c6 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:41.619935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a45b6-d8bd-4e99-a820-44c4d9f5c2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:41.620631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a45b6-d8bd-4e99-a820-44c4d9f5c2b3 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:41.620946 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a45b6-d8bd-4e99-a820-44c4d9f5c2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:41.621256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a45b6-d8bd-4e99-a820-44c4d9f5c2b3 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:41.621955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a45b6-d8bd-4e99-a820-44c4d9f5c2b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:41.623626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a45b6-d8bd-4e99-a820-44c4d9f5c2b3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:41.716665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 577/1138] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:09:41 2022] POST /identity/v3/users => generated 286 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:09:43.823138 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3432a3-dd0d-4daa-88fd-66ca88cb8a08 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:43.823989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3432a3-dd0d-4daa-88fd-66ca88cb8a08 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:43.823989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3432a3-dd0d-4daa-88fd-66ca88cb8a08 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:43.825050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 562/1139] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:43.831486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217abbd-8920-4061-833b-8e792b030005 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:43.832312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217abbd-8920-4061-833b-8e792b030005 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:43.832312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217abbd-8920-4061-833b-8e792b030005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:43.852157 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f217abbd-8920-4061-833b-8e792b030005 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:43.853408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f217abbd-8920-4061-833b-8e792b030005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:43.906298 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:43.934215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 578/1140] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:44.213870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3432a3-dd0d-4daa-88fd-66ca88cb8a08 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:44.216859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:44.436068 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3432a3-dd0d-4daa-88fd-66ca88cb8a08 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:44.475806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a0f47-5490-4a38-97c0-0e39b89c1c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:44.476359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a0f47-5490-4a38-97c0-0e39b89c1c90 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:44.476642 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a0f47-5490-4a38-97c0-0e39b89c1c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:44.476915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a0f47-5490-4a38-97c0-0e39b89c1c90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:44.491153 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a0f47-5490-4a38-97c0-0e39b89c1c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-331a0f47-5490-4a38-97c0-0e39b89c1c90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:44.496181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:44.498053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:44.499731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 563/1141] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:44.504549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217abbd-8920-4061-833b-8e792b030005 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:44.618579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217abbd-8920-4061-833b-8e792b030005 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:44.657549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462faae1-3e72-4ead-ad14-96924cd7b913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:44.658162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462faae1-3e72-4ead-ad14-96924cd7b913 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:44.658479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462faae1-3e72-4ead-ad14-96924cd7b913 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:44.658751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462faae1-3e72-4ead-ad14-96924cd7b913 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:44.659416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462faae1-3e72-4ead-ad14-96924cd7b913 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:44.659719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462faae1-3e72-4ead-ad14-96924cd7b913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:44.661349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462faae1-3e72-4ead-ad14-96924cd7b913 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:44.671189 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 579/1142] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:44.681979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a0f47-5490-4a38-97c0-0e39b89c1c90 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:44.798169 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:44.870703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a0f47-5490-4a38-97c0-0e39b89c1c90 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:44.932441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7706b81-462d-4659-b9c3-b92eb9c0b295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:44.933451 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7706b81-462d-4659-b9c3-b92eb9c0b295 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:44.933919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7706b81-462d-4659-b9c3-b92eb9c0b295 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:44.934434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7706b81-462d-4659-b9c3-b92eb9c0b295 None admin] PATH_INFO: `/v3/users/c0a55a1445b944ee8d53b2d744d42155` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:44.962010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7706b81-462d-4659-b9c3-b92eb9c0b295 None admin] RBAC: Authorizing `identity:get_user(user_id=c0a55a1445b944ee8d53b2d744d42155)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:44.964810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7706b81-462d-4659-b9c3-b92eb9c0b295 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:44.968063 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 564/1143] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:44 2022] GET /identity/v3/users/c0a55a1445b944ee8d53b2d744d42155 => generated 286 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:44.974573 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462faae1-3e72-4ead-ad14-96924cd7b913 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:45.020792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:45.089475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462faae1-3e72-4ead-ad14-96924cd7b913 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:45.126702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a32dc-85af-4d01-a457-4647e13f8b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:45.127326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a32dc-85af-4d01-a457-4647e13f8b36 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:45.127601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a32dc-85af-4d01-a457-4647e13f8b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:45.127870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a32dc-85af-4d01-a457-4647e13f8b36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:45.210141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a32dc-85af-4d01-a457-4647e13f8b36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:45.211641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a32dc-85af-4d01-a457-4647e13f8b36 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:45.258004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:45.336675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 580/1144] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:09:45.351597 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7706b81-462d-4659-b9c3-b92eb9c0b295 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:45.471839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7706b81-462d-4659-b9c3-b92eb9c0b295 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:45.499929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:45.515482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d3d61-10c5-4678-b05d-fe2efaaaff19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:45.516126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d3d61-10c5-4678-b05d-fe2efaaaff19 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:45.516403 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d3d61-10c5-4678-b05d-fe2efaaaff19 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:45.516671 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d3d61-10c5-4678-b05d-fe2efaaaff19 None admin] PATH_INFO: `/v3/projects/555bda7952d7464f934abc86f09cab8b` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:45.517881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d3d61-10c5-4678-b05d-fe2efaaaff19 None admin] RBAC: Authorizing `identity:get_project(project_id=555bda7952d7464f934abc86f09cab8b)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:45.519478 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d3d61-10c5-4678-b05d-fe2efaaaff19 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:45.521543 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 565/1145] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:45 2022] GET /identity/v3/projects/555bda7952d7464f934abc86f09cab8b => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:45.528601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a32dc-85af-4d01-a457-4647e13f8b36 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:45.647394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a32dc-85af-4d01-a457-4647e13f8b36 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:45.687105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567db26-fb33-4d0f-80ea-5871bab76e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:45.687722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567db26-fb33-4d0f-80ea-5871bab76e18 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:45.688000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567db26-fb33-4d0f-80ea-5871bab76e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:45.688274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567db26-fb33-4d0f-80ea-5871bab76e18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:45.689008 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567db26-fb33-4d0f-80ea-5871bab76e18 None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=555bda7952d7464f934abc86f09cab8b, user.id=c0a55a1445b944ee8d53b2d744d42155) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:45.689320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567db26-fb33-4d0f-80ea-5871bab76e18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:45.690813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567db26-fb33-4d0f-80ea-5871bab76e18 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:45.701662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 581/1146] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:45 2022] GET /identity/v3/role_assignments?user.id=c0a55a1445b944ee8d53b2d744d42155&scope.project.id=555bda7952d7464f934abc86f09cab8b&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:47.729826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50534ea3-0630-44da-b8a1-a50b62234608 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:47.730739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50534ea3-0630-44da-b8a1-a50b62234608 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:47.730739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50534ea3-0630-44da-b8a1-a50b62234608 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:47.731891 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 566/1147] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:47.738011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96b8a-5b45-4f2c-9bce-52d7b1530027 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:47.739366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96b8a-5b45-4f2c-9bce-52d7b1530027 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:47.739570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96b8a-5b45-4f2c-9bce-52d7b1530027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:47.746450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:47.759995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2ed96b8a-5b45-4f2c-9bce-52d7b1530027 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:47.764731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2ed96b8a-5b45-4f2c-9bce-52d7b1530027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:47.838467 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 582/1148] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:48.112183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50534ea3-0630-44da-b8a1-a50b62234608 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:48.234830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50534ea3-0630-44da-b8a1-a50b62234608 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:48.277019 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b40d26-2774-4969-a5dd-b5c5a01dad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:48.277667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b40d26-2774-4969-a5dd-b5c5a01dad35 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:48.277944 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b40d26-2774-4969-a5dd-b5c5a01dad35 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:48.278208 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b40d26-2774-4969-a5dd-b5c5a01dad35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:48.292028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b40d26-2774-4969-a5dd-b5c5a01dad35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-15b40d26-2774-4969-a5dd-b5c5a01dad35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:48.296977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:48.298721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:48.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 567/1149] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:09:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:48.309661 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed96b8a-5b45-4f2c-9bce-52d7b1530027 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:48.439481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed96b8a-5b45-4f2c-9bce-52d7b1530027 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:48.475960 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:48.481253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605531b-8a8d-488a-acac-68ff605e5ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:48.481931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605531b-8a8d-488a-acac-68ff605e5ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:48.482303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605531b-8a8d-488a-acac-68ff605e5ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:48.482621 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605531b-8a8d-488a-acac-68ff605e5ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:48.483337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605531b-8a8d-488a-acac-68ff605e5ba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:48.483675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605531b-8a8d-488a-acac-68ff605e5ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:48.485204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605531b-8a8d-488a-acac-68ff605e5ba8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:48.496109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 583/1150] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:09:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:48.502653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b40d26-2774-4969-a5dd-b5c5a01dad35 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:48.564950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:48.627512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b40d26-2774-4969-a5dd-b5c5a01dad35 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:48.671109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947422-b262-4cd5-9e49-b639a000864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:48.671866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947422-b262-4cd5-9e49-b639a000864d None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:48.672225 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947422-b262-4cd5-9e49-b639a000864d None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:48.672540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947422-b262-4cd5-9e49-b639a000864d None admin] PATH_INFO: `/v3/users/c0a55a1445b944ee8d53b2d744d42155` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:48.673890 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41947422-b262-4cd5-9e49-b639a000864d None admin] RBAC: Authorizing `identity:get_user(user_id=c0a55a1445b944ee8d53b2d744d42155)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:48.675577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41947422-b262-4cd5-9e49-b639a000864d None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:48.679690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 568/1151] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:48 2022] GET /identity/v3/users/c0a55a1445b944ee8d53b2d744d42155 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:48.686738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605531b-8a8d-488a-acac-68ff605e5ba8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:48.809029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605531b-8a8d-488a-acac-68ff605e5ba8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:48.846561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f270538-4022-4241-bed2-fb5a4a54e56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:48.847198 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f270538-4022-4241-bed2-fb5a4a54e56b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:48.847475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f270538-4022-4241-bed2-fb5a4a54e56b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:48.847794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f270538-4022-4241-bed2-fb5a4a54e56b None admin] PATH_INFO: `/v3/projects/555bda7952d7464f934abc86f09cab8b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:48.848976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f270538-4022-4241-bed2-fb5a4a54e56b None admin] RBAC: Authorizing `identity:get_project(project_id=555bda7952d7464f934abc86f09cab8b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:48.851394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f270538-4022-4241-bed2-fb5a4a54e56b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:48.853467 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 584/1152] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:48 2022] GET /identity/v3/projects/555bda7952d7464f934abc86f09cab8b => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:48.860247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947422-b262-4cd5-9e49-b639a000864d None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:48.975840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947422-b262-4cd5-9e49-b639a000864d None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:48.997018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:49.017362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06b2e3-7155-43a8-a439-cc55442edeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:49.018039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06b2e3-7155-43a8-a439-cc55442edeeb None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:49.018357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06b2e3-7155-43a8-a439-cc55442edeeb None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:49.018626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06b2e3-7155-43a8-a439-cc55442edeeb None admin] PATH_INFO: `/v3/projects/555bda7952d7464f934abc86f09cab8b/users/c0a55a1445b944ee8d53b2d744d42155/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:49.021334 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06b2e3-7155-43a8-a439-cc55442edeeb None admin] RBAC: Authorizing `identity:create_grant(project_id=555bda7952d7464f934abc86f09cab8b, user_id=c0a55a1445b944ee8d53b2d744d42155, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:49.023101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06b2e3-7155-43a8-a439-cc55442edeeb None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:49.144652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 569/1153] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:09:48 2022] PUT /identity/v3/projects/555bda7952d7464f934abc86f09cab8b/users/c0a55a1445b944ee8d53b2d744d42155/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:09:51.179103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e413f8b-89b5-436e-968e-5321752dfe29 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:51.179949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e413f8b-89b5-436e-968e-5321752dfe29 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:51.179949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e413f8b-89b5-436e-968e-5321752dfe29 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:51.181466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 585/1154] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:51.187613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf895e0-fb7e-488b-8dfe-dffb06b76515 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:51.188192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf895e0-fb7e-488b-8dfe-dffb06b76515 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:51.188192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf895e0-fb7e-488b-8dfe-dffb06b76515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:51.210272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ddf895e0-fb7e-488b-8dfe-dffb06b76515 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:51.211501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ddf895e0-fb7e-488b-8dfe-dffb06b76515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:51.291981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 570/1155] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:51.577358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e413f8b-89b5-436e-968e-5321752dfe29 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:51.650995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:51.697848 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e413f8b-89b5-436e-968e-5321752dfe29 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:51.736788 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0b679-fbcc-40dc-b2b9-398bcab7dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:51.737482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0b679-fbcc-40dc-b2b9-398bcab7dd48 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:51.737860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0b679-fbcc-40dc-b2b9-398bcab7dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:51.738746 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0b679-fbcc-40dc-b2b9-398bcab7dd48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:51.751701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0b679-fbcc-40dc-b2b9-398bcab7dd48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-a1f0b679-fbcc-40dc-b2b9-398bcab7dd48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:51.757601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:51.759418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:09:51.761067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 586/1156] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:09:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:51.766324 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf895e0-fb7e-488b-8dfe-dffb06b76515 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:51.898663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf895e0-fb7e-488b-8dfe-dffb06b76515 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:51.911234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:51.945154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d91cb-14e6-4e34-8817-a16786267eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:51.945787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d91cb-14e6-4e34-8817-a16786267eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:51.946071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d91cb-14e6-4e34-8817-a16786267eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:51.946558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d91cb-14e6-4e34-8817-a16786267eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:51.947354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d91cb-14e6-4e34-8817-a16786267eb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:51.947661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d91cb-14e6-4e34-8817-a16786267eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:51.949141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d91cb-14e6-4e34-8817-a16786267eb4 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:51.962177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 571/1157] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:09:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:51.971983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0b679-fbcc-40dc-b2b9-398bcab7dd48 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:52.130133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0b679-fbcc-40dc-b2b9-398bcab7dd48 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:52.158338 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:52.172030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a3831-f4aa-49df-a1bf-b465ec118175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:52.172700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a3831-f4aa-49df-a1bf-b465ec118175 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:52.172982 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a3831-f4aa-49df-a1bf-b465ec118175 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:52.173260 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a3831-f4aa-49df-a1bf-b465ec118175 None admin] PATH_INFO: `/v3/users/c0a55a1445b944ee8d53b2d744d42155` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:52.174594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a3831-f4aa-49df-a1bf-b465ec118175 None admin] RBAC: Authorizing `identity:get_user(user_id=c0a55a1445b944ee8d53b2d744d42155)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:52.176630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a3831-f4aa-49df-a1bf-b465ec118175 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:52.178704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 587/1158] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:51 2022] GET /identity/v3/users/c0a55a1445b944ee8d53b2d744d42155 => generated 286 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:52.185457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d91cb-14e6-4e34-8817-a16786267eb4 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:52.336008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d91cb-14e6-4e34-8817-a16786267eb4 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:52.376636 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e1cea-35f1-4b6c-ab06-a9d1accd4f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:52.377266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e1cea-35f1-4b6c-ab06-a9d1accd4f77 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:52.377544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e1cea-35f1-4b6c-ab06-a9d1accd4f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:52.377819 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e1cea-35f1-4b6c-ab06-a9d1accd4f77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:52.419153 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:52.456529 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e1cea-35f1-4b6c-ab06-a9d1accd4f77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:52.459181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e1cea-35f1-4b6c-ab06-a9d1accd4f77 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:52.573581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 572/1159] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:52.584384 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a3831-f4aa-49df-a1bf-b465ec118175 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:52.719337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a3831-f4aa-49df-a1bf-b465ec118175 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:52.757773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54000a-7146-42ff-b233-860fe171e775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:52.758443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54000a-7146-42ff-b233-860fe171e775 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:52.758720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54000a-7146-42ff-b233-860fe171e775 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:52.758987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54000a-7146-42ff-b233-860fe171e775 None admin] PATH_INFO: `/v3/projects/555bda7952d7464f934abc86f09cab8b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:52.760199 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54000a-7146-42ff-b233-860fe171e775 None admin] RBAC: Authorizing `identity:get_project(project_id=555bda7952d7464f934abc86f09cab8b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:52.761648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54000a-7146-42ff-b233-860fe171e775 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:52.763384 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 588/1160] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:52 2022] GET /identity/v3/projects/555bda7952d7464f934abc86f09cab8b => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:52.773589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e1cea-35f1-4b6c-ab06-a9d1accd4f77 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:52.849405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:52.886192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e1cea-35f1-4b6c-ab06-a9d1accd4f77 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:52.922871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124deec-d57d-40b6-aec9-fb29d9e69e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:52.923495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124deec-d57d-40b6-aec9-fb29d9e69e4f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:52.923778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124deec-d57d-40b6-aec9-fb29d9e69e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:52.924050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124deec-d57d-40b6-aec9-fb29d9e69e4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:52.924794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124deec-d57d-40b6-aec9-fb29d9e69e4f None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=555bda7952d7464f934abc86f09cab8b, user.id=c0a55a1445b944ee8d53b2d744d42155) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:52.925103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124deec-d57d-40b6-aec9-fb29d9e69e4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:52.927185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124deec-d57d-40b6-aec9-fb29d9e69e4f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:52.934834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 573/1161] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:52 2022] GET /identity/v3/role_assignments?user.id=c0a55a1445b944ee8d53b2d744d42155&scope.project.id=555bda7952d7464f934abc86f09cab8b&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:54.992591 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0591c6-ac80-4673-b485-84cd4995665c None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:54.993217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0591c6-ac80-4673-b485-84cd4995665c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:54.993217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0591c6-ac80-4673-b485-84cd4995665c None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:54.994535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 589/1162] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:55.000496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097c693-cdf7-4a36-bb0e-518994957d6b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:55.001030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097c693-cdf7-4a36-bb0e-518994957d6b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:55.001030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097c693-cdf7-4a36-bb0e-518994957d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:55.022855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a097c693-cdf7-4a36-bb0e-518994957d6b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:55.024094 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a097c693-cdf7-4a36-bb0e-518994957d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:55.102356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 574/1163] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:55.394276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0591c6-ac80-4673-b485-84cd4995665c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:55.468266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:55.514387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0591c6-ac80-4673-b485-84cd4995665c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:55.553214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fef371-084a-4872-966e-d2ec2676485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:55.553828 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fef371-084a-4872-966e-d2ec2676485f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:55.554105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fef371-084a-4872-966e-d2ec2676485f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:55.554406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fef371-084a-4872-966e-d2ec2676485f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:55.649588 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fef371-084a-4872-966e-d2ec2676485f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:55.651102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fef371-084a-4872-966e-d2ec2676485f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:55.716106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:55.766241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 590/1164] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:55.773592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097c693-cdf7-4a36-bb0e-518994957d6b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:55.849471 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:55.895370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097c693-cdf7-4a36-bb0e-518994957d6b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:55.937205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f51dc4-58cf-4980-a562-e52dbeecd263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:55.937900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f51dc4-58cf-4980-a562-e52dbeecd263 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:55.938253 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f51dc4-58cf-4980-a562-e52dbeecd263 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:55.938588 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f51dc4-58cf-4980-a562-e52dbeecd263 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:55.946789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f51dc4-58cf-4980-a562-e52dbeecd263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:55.948275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f51dc4-58cf-4980-a562-e52dbeecd263 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-f5f51dc4-58cf-4980-a562-e52dbeecd263 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:55.961803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:55.963148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:09:55.964015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 575/1165] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Aug 29 20:09:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:55.969697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fef371-084a-4872-966e-d2ec2676485f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:56.087496 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fef371-084a-4872-966e-d2ec2676485f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:56.127625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3393ba-7961-4dbb-9348-d75778050da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:56.128308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3393ba-7961-4dbb-9348-d75778050da1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:56.129224 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3393ba-7961-4dbb-9348-d75778050da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:56.129541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3393ba-7961-4dbb-9348-d75778050da1 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:56.130462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3393ba-7961-4dbb-9348-d75778050da1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:56.130806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3393ba-7961-4dbb-9348-d75778050da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:56.132318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3393ba-7961-4dbb-9348-d75778050da1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:56.140981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 591/1166] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Aug 29 20:09:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:58.149199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc618a-ebf1-457e-bffa-a8cb6973405b None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:58.149780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc618a-ebf1-457e-bffa-a8cb6973405b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:58.149780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc618a-ebf1-457e-bffa-a8cb6973405b None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:58.151251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 576/1167] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:58.157302 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977885f4-d9d5-4e88-9031-b17ed623f20b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:58.158121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977885f4-d9d5-4e88-9031-b17ed623f20b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:58.158321 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977885f4-d9d5-4e88-9031-b17ed623f20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:58.178689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-977885f4-d9d5-4e88-9031-b17ed623f20b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:58.179996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-977885f4-d9d5-4e88-9031-b17ed623f20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:58.199556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:58.255892 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 592/1168] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:58.546752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc618a-ebf1-457e-bffa-a8cb6973405b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:58.673014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc618a-ebf1-457e-bffa-a8cb6973405b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:58.701337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:58.715338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700238e-641b-46b4-8bc6-684913ae850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:58.717886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700238e-641b-46b4-8bc6-684913ae850c None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:58.717886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700238e-641b-46b4-8bc6-684913ae850c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:58.717886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700238e-641b-46b4-8bc6-684913ae850c None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:58.717886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700238e-641b-46b4-8bc6-684913ae850c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:58.718876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700238e-641b-46b4-8bc6-684913ae850c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:58.837802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 577/1169] 10.222.0.81 () {60 vars in 1138 bytes} [Mon Aug 29 20:09:58 2022] POST /identity/v3/domains => generated 267 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:10:01.018566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cedfe2-ad33-4365-9150-921586b0be0f None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:01.019403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cedfe2-ad33-4365-9150-921586b0be0f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:01.019560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cedfe2-ad33-4365-9150-921586b0be0f None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:01.021608 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 593/1170] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:10:01.028218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9868c4-e111-4201-a848-7b8cc9979bee None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:01.028803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9868c4-e111-4201-a848-7b8cc9979bee None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:01.028803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9868c4-e111-4201-a848-7b8cc9979bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:01.056784 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-1b9868c4-e111-4201-a848-7b8cc9979bee None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:01.058882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-1b9868c4-e111-4201-a848-7b8cc9979bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:01.188594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 578/1171] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:10:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:10:01.488895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cedfe2-ad33-4365-9150-921586b0be0f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:01.608084 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cedfe2-ad33-4365-9150-921586b0be0f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:01.650964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d608e4-b82f-4b10-8942-5ea53ca31411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:01.651610 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d608e4-b82f-4b10-8942-5ea53ca31411 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:01.651888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d608e4-b82f-4b10-8942-5ea53ca31411 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:01.652161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d608e4-b82f-4b10-8942-5ea53ca31411 None admin] PATH_INFO: `/v3/domains/88b26db57d5f4b65a60510d27e647adf` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:01.665532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d608e4-b82f-4b10-8942-5ea53ca31411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=88b26db57d5f4b65a60510d27e647adf)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:01.667041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d608e4-b82f-4b10-8942-5ea53ca31411 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:01.669080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 594/1172] 10.222.0.81 () {56 vars in 1183 bytes} [Mon Aug 29 20:10:01 2022] GET /identity/v3/domains/88b26db57d5f4b65a60510d27e647adf => generated 267 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:01.676052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9868c4-e111-4201-a848-7b8cc9979bee None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:01.792973 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9868c4-e111-4201-a848-7b8cc9979bee None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:01.809494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:01.834123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f00dd-a0f2-48c2-9133-76d21f5dba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:01.834782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f00dd-a0f2-48c2-9133-76d21f5dba53 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:01.835064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f00dd-a0f2-48c2-9133-76d21f5dba53 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:01.835338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f00dd-a0f2-48c2-9133-76d21f5dba53 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:01.836023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f00dd-a0f2-48c2-9133-76d21f5dba53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:01.837486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f00dd-a0f2-48c2-9133-76d21f5dba53 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:01.983715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 579/1173] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:10:01 2022] POST /identity/v3/projects => generated 361 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:10:04.074782 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c269-dbf0-48be-b606-7c544141ab1e None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:04.075485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c269-dbf0-48be-b606-7c544141ab1e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:04.075485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c269-dbf0-48be-b606-7c544141ab1e None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:04.076942 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 595/1174] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:10:04.084476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bdc3e-f281-4e58-a290-271b3af094c8 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:04.085074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bdc3e-f281-4e58-a290-271b3af094c8 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:04.085074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bdc3e-f281-4e58-a290-271b3af094c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:04.104951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-251bdc3e-f281-4e58-a290-271b3af094c8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:04.106248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-251bdc3e-f281-4e58-a290-271b3af094c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:04.187133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 580/1175] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:10:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:10:04.469757 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438c269-dbf0-48be-b606-7c544141ab1e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:04.488630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:04.593619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438c269-dbf0-48be-b606-7c544141ab1e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:04.634914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121838c0-eacc-418e-bdd4-fd7263e46f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:04.635546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121838c0-eacc-418e-bdd4-fd7263e46f3b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:04.635824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121838c0-eacc-418e-bdd4-fd7263e46f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:04.636090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121838c0-eacc-418e-bdd4-fd7263e46f3b None admin] PATH_INFO: `/v3/domains/88b26db57d5f4b65a60510d27e647adf` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:04.637222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121838c0-eacc-418e-bdd4-fd7263e46f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=88b26db57d5f4b65a60510d27e647adf)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:04.638854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121838c0-eacc-418e-bdd4-fd7263e46f3b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:04.640459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 596/1176] 10.222.0.81 () {56 vars in 1183 bytes} [Mon Aug 29 20:10:04 2022] GET /identity/v3/domains/88b26db57d5f4b65a60510d27e647adf => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:04.647505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bdc3e-f281-4e58-a290-271b3af094c8 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:04.793026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:04.805106 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bdc3e-f281-4e58-a290-271b3af094c8 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:04.856782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f54df-25fb-469e-ae5c-3477020d610c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:04.857462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f54df-25fb-469e-ae5c-3477020d610c None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:04.857778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f54df-25fb-469e-ae5c-3477020d610c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:04.858088 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f54df-25fb-469e-ae5c-3477020d610c None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:04.858852 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f54df-25fb-469e-ae5c-3477020d610c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:04.860431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f54df-25fb-469e-ae5c-3477020d610c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:04.945701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 581/1177] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:10:04 2022] POST /identity/v3/users => generated 311 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:10:07.190876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49040751-a6b3-4e7b-bfd3-4113629f78ff None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:07.191494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49040751-a6b3-4e7b-bfd3-4113629f78ff None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:07.191494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49040751-a6b3-4e7b-bfd3-4113629f78ff None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:07.192853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 597/1178] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:10:07.202411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0b935-c77c-437b-8956-0d891ecf9e32 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:07.203275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0b935-c77c-437b-8956-0d891ecf9e32 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:07.203275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0b935-c77c-437b-8956-0d891ecf9e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:07.230328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-7eb0b935-c77c-437b-8956-0d891ecf9e32 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:07.232663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7eb0b935-c77c-437b-8956-0d891ecf9e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:07.454923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 582/1179] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:10:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:10:07.727328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49040751-a6b3-4e7b-bfd3-4113629f78ff None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:07.857680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:07.880185 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49040751-a6b3-4e7b-bfd3-4113629f78ff None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:07.918971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd05512-7a79-408b-a462-0ec192153924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:07.919611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd05512-7a79-408b-a462-0ec192153924 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:07.919889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd05512-7a79-408b-a462-0ec192153924 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:07.920159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd05512-7a79-408b-a462-0ec192153924 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:07.932514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd05512-7a79-408b-a462-0ec192153924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2bd05512-7a79-408b-a462-0ec192153924 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:10:07.937439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:10:07.939445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:10:07.941953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 598/1180] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:10:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:10:07.947601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0b935-c77c-437b-8956-0d891ecf9e32 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:08.037413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:08.059493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0b935-c77c-437b-8956-0d891ecf9e32 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:08.096839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c59f96-ea70-420e-b49b-2103c010a4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:08.097608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c59f96-ea70-420e-b49b-2103c010a4fa None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:08.097987 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c59f96-ea70-420e-b49b-2103c010a4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:08.098404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c59f96-ea70-420e-b49b-2103c010a4fa None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:08.099380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c59f96-ea70-420e-b49b-2103c010a4fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:10:08.101706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c59f96-ea70-420e-b49b-2103c010a4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:08.101706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c59f96-ea70-420e-b49b-2103c010a4fa None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:08.110963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 583/1181] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:10:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:10:08.121535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd05512-7a79-408b-a462-0ec192153924 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:08.262139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd05512-7a79-408b-a462-0ec192153924 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:08.301730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1cbe0-1c68-43e7-ae4d-4589657fd35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:08.302336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1cbe0-1c68-43e7-ae4d-4589657fd35c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:08.302616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1cbe0-1c68-43e7-ae4d-4589657fd35c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:08.302886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1cbe0-1c68-43e7-ae4d-4589657fd35c None admin] PATH_INFO: `/v3/users/27aec959d018464d8dba3490714cc55f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:08.315577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:08.319324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1cbe0-1c68-43e7-ae4d-4589657fd35c None admin] RBAC: Authorizing `identity:get_user(user_id=27aec959d018464d8dba3490714cc55f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:08.320801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1cbe0-1c68-43e7-ae4d-4589657fd35c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:08.322565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 599/1182] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:10:08 2022] GET /identity/v3/users/27aec959d018464d8dba3490714cc55f => generated 311 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:08.328739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c59f96-ea70-420e-b49b-2103c010a4fa None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:08.448839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c59f96-ea70-420e-b49b-2103c010a4fa None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:08.496207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb7b77-1a1f-46b7-9012-c894e4a02f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:08.497104 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb7b77-1a1f-46b7-9012-c894e4a02f27 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:08.497517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb7b77-1a1f-46b7-9012-c894e4a02f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:08.497919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb7b77-1a1f-46b7-9012-c894e4a02f27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:08.514629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:08.590382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb7b77-1a1f-46b7-9012-c894e4a02f27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:08.591754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb7b77-1a1f-46b7-9012-c894e4a02f27 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:08.705545 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 584/1183] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:10:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:10:08.713813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1cbe0-1c68-43e7-ae4d-4589657fd35c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:08.826253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1cbe0-1c68-43e7-ae4d-4589657fd35c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:08.865683 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd9d0e-f629-4e67-8363-735520776a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:08.866276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd9d0e-f629-4e67-8363-735520776a6d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:08.866562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd9d0e-f629-4e67-8363-735520776a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:08.866837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd9d0e-f629-4e67-8363-735520776a6d None admin] PATH_INFO: `/v3/projects/645619f8bff54506a4d22089f7212039` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:08.868093 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd9d0e-f629-4e67-8363-735520776a6d None admin] RBAC: Authorizing `identity:get_project(project_id=645619f8bff54506a4d22089f7212039)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:08.869607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd9d0e-f629-4e67-8363-735520776a6d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:08.871391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 600/1184] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:10:08 2022] GET /identity/v3/projects/645619f8bff54506a4d22089f7212039 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:08.879766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb7b77-1a1f-46b7-9012-c894e4a02f27 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:08.946863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:09.014359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb7b77-1a1f-46b7-9012-c894e4a02f27 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:09.056895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf71c5-3971-4770-8d4c-7bc7ccfa2194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:09.057504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf71c5-3971-4770-8d4c-7bc7ccfa2194 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:09.057781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf71c5-3971-4770-8d4c-7bc7ccfa2194 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:09.058053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf71c5-3971-4770-8d4c-7bc7ccfa2194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:09.058834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf71c5-3971-4770-8d4c-7bc7ccfa2194 None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=645619f8bff54506a4d22089f7212039, user.id=27aec959d018464d8dba3490714cc55f) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:10:09.059144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf71c5-3971-4770-8d4c-7bc7ccfa2194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:09.060634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf71c5-3971-4770-8d4c-7bc7ccfa2194 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:09.068426 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 585/1185] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:10:08 2022] GET /identity/v3/role_assignments?user.id=27aec959d018464d8dba3490714cc55f&scope.project.id=645619f8bff54506a4d22089f7212039&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:10:11.095780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ff6d-32d9-4d87-8576-64d2059bec40 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:11.096463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ff6d-32d9-4d87-8576-64d2059bec40 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:11.096463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ff6d-32d9-4d87-8576-64d2059bec40 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:11.098603 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 601/1186] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:10:11.104546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b51a0-80f5-4c59-b69a-f036a6e7211f None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:11.105082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b51a0-80f5-4c59-b69a-f036a6e7211f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:11.105232 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b51a0-80f5-4c59-b69a-f036a6e7211f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:11.124715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-372b51a0-80f5-4c59-b69a-f036a6e7211f None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:11.125946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-372b51a0-80f5-4c59-b69a-f036a6e7211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:11.204538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 586/1187] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:10:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:10:11.484963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9ff6d-32d9-4d87-8576-64d2059bec40 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:11.562669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:11.603071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9ff6d-32d9-4d87-8576-64d2059bec40 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:11.641749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e6a8-78b2-4eaf-9221-1a99df9cbf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:11.642411 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e6a8-78b2-4eaf-9221-1a99df9cbf07 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:11.642691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e6a8-78b2-4eaf-9221-1a99df9cbf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:11.642960 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e6a8-78b2-4eaf-9221-1a99df9cbf07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:11.655101 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771e6a8-78b2-4eaf-9221-1a99df9cbf07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-e771e6a8-78b2-4eaf-9221-1a99df9cbf07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:10:11.660371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:10:11.662681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:10:11.663592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 602/1188] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:10:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:10:11.668550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b51a0-80f5-4c59-b69a-f036a6e7211f None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:11.711653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:11.787243 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b51a0-80f5-4c59-b69a-f036a6e7211f None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:11.828666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03718dbf-b1ef-42a4-806b-b46da3802c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:11.829284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718dbf-b1ef-42a4-806b-b46da3802c78 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:11.829560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718dbf-b1ef-42a4-806b-b46da3802c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:11.829828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718dbf-b1ef-42a4-806b-b46da3802c78 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:11.831363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03718dbf-b1ef-42a4-806b-b46da3802c78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:10:11.832337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03718dbf-b1ef-42a4-806b-b46da3802c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:11.834006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03718dbf-b1ef-42a4-806b-b46da3802c78 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:11.844350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 587/1189] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:10:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:11.850743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e6a8-78b2-4eaf-9221-1a99df9cbf07 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:11.974491 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e6a8-78b2-4eaf-9221-1a99df9cbf07 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:12.006202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:12.015832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198e914-3d91-4c7c-8a3b-c26d98eecd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:12.016562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198e914-3d91-4c7c-8a3b-c26d98eecd28 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:12.016943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198e914-3d91-4c7c-8a3b-c26d98eecd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:12.017212 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198e914-3d91-4c7c-8a3b-c26d98eecd28 None admin] PATH_INFO: `/v3/users/27aec959d018464d8dba3490714cc55f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:12.018511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198e914-3d91-4c7c-8a3b-c26d98eecd28 None admin] RBAC: Authorizing `identity:get_user(user_id=27aec959d018464d8dba3490714cc55f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:12.020885 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198e914-3d91-4c7c-8a3b-c26d98eecd28 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:12.021815 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 603/1190] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:10:11 2022] GET /identity/v3/users/27aec959d018464d8dba3490714cc55f => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:12.028214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03718dbf-b1ef-42a4-806b-b46da3802c78 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:12.168675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:12.175408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03718dbf-b1ef-42a4-806b-b46da3802c78 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:12.239272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1a10b-7a94-4fa3-9b64-f706a0782ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:12.240362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1a10b-7a94-4fa3-9b64-f706a0782ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:12.240881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1a10b-7a94-4fa3-9b64-f706a0782ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:12.241367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1a10b-7a94-4fa3-9b64-f706a0782ac1 None admin] PATH_INFO: `/v3/projects/645619f8bff54506a4d22089f7212039` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:12.243497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1a10b-7a94-4fa3-9b64-f706a0782ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=645619f8bff54506a4d22089f7212039)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:12.246249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1a10b-7a94-4fa3-9b64-f706a0782ac1 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:12.249576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 588/1191] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:10:12 2022] GET /identity/v3/projects/645619f8bff54506a4d22089f7212039 => generated 361 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:12.256915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198e914-3d91-4c7c-8a3b-c26d98eecd28 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:12.393137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198e914-3d91-4c7c-8a3b-c26d98eecd28 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:12.434368 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee65580-46ba-4645-939d-8f1086afd9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:12.435030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee65580-46ba-4645-939d-8f1086afd9e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:12.435307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee65580-46ba-4645-939d-8f1086afd9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:12.435576 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee65580-46ba-4645-939d-8f1086afd9e1 None admin] PATH_INFO: `/v3/projects/645619f8bff54506a4d22089f7212039/users/27aec959d018464d8dba3490714cc55f/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:12.437564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee65580-46ba-4645-939d-8f1086afd9e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=645619f8bff54506a4d22089f7212039, user_id=27aec959d018464d8dba3490714cc55f, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:12.439018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee65580-46ba-4645-939d-8f1086afd9e1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:12.584629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 604/1192] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:10:12 2022] PUT /identity/v3/projects/645619f8bff54506a4d22089f7212039/users/27aec959d018464d8dba3490714cc55f/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:10:14.621379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05984f3c-802f-45cc-ac82-0a0fef04b687 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:14.621938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05984f3c-802f-45cc-ac82-0a0fef04b687 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:14.622164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05984f3c-802f-45cc-ac82-0a0fef04b687 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:14.623665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 589/1193] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:10:14.630520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f573650-a2cd-4582-80e7-645832d54a29 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:14.631370 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f573650-a2cd-4582-80e7-645832d54a29 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:14.631540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f573650-a2cd-4582-80e7-645832d54a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:14.651481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4f573650-a2cd-4582-80e7-645832d54a29 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:14.652719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4f573650-a2cd-4582-80e7-645832d54a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:14.709793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:14.730277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 605/1194] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:10:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:10:15.040481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05984f3c-802f-45cc-ac82-0a0fef04b687 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:15.176573 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05984f3c-802f-45cc-ac82-0a0fef04b687 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:15.218240 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fcb77-d29d-453c-8381-60e471a0f911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:15.218928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fcb77-d29d-453c-8381-60e471a0f911 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:15.219213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fcb77-d29d-453c-8381-60e471a0f911 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:15.219488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fcb77-d29d-453c-8381-60e471a0f911 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:15.232965 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fcb77-d29d-453c-8381-60e471a0f911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-de2fcb77-d29d-453c-8381-60e471a0f911 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:10:15.239284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:10:15.248527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:10:15.249584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 590/1195] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:10:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:10:15.250494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f573650-a2cd-4582-80e7-645832d54a29 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:15.379574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f573650-a2cd-4582-80e7-645832d54a29 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:15.422530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07175844-69bc-4ae4-83d6-40227f8bbcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:15.423167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07175844-69bc-4ae4-83d6-40227f8bbcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:15.423443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07175844-69bc-4ae4-83d6-40227f8bbcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:15.423714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07175844-69bc-4ae4-83d6-40227f8bbcb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:15.424922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07175844-69bc-4ae4-83d6-40227f8bbcb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:10:15.425384 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07175844-69bc-4ae4-83d6-40227f8bbcb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:15.427091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07175844-69bc-4ae4-83d6-40227f8bbcb2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:15.437066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 606/1196] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:10:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:10:15.443602 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fcb77-d29d-453c-8381-60e471a0f911 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:15.478341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:15.566375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fcb77-d29d-453c-8381-60e471a0f911 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:15.616153 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe61ed-d5cd-461d-b8e9-6ffb1272e185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:15.616721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe61ed-d5cd-461d-b8e9-6ffb1272e185 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:15.617085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe61ed-d5cd-461d-b8e9-6ffb1272e185 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:15.617362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe61ed-d5cd-461d-b8e9-6ffb1272e185 None admin] PATH_INFO: `/v3/users/27aec959d018464d8dba3490714cc55f` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:15.618613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe61ed-d5cd-461d-b8e9-6ffb1272e185 None admin] RBAC: Authorizing `identity:get_user(user_id=27aec959d018464d8dba3490714cc55f)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:15.620095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe61ed-d5cd-461d-b8e9-6ffb1272e185 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:15.621793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 591/1197] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Aug 29 20:10:15 2022] GET /identity/v3/users/27aec959d018464d8dba3490714cc55f => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:15.628833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07175844-69bc-4ae4-83d6-40227f8bbcb2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:15.683540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:15.751125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07175844-69bc-4ae4-83d6-40227f8bbcb2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:15.791040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c2321-91d3-4cfe-bbf8-3e1cceed896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:15.791661 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c2321-91d3-4cfe-bbf8-3e1cceed896e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:15.791939 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c2321-91d3-4cfe-bbf8-3e1cceed896e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:15.792207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c2321-91d3-4cfe-bbf8-3e1cceed896e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:15.872814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c2321-91d3-4cfe-bbf8-3e1cceed896e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:15.874208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c2321-91d3-4cfe-bbf8-3e1cceed896e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:15.928943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:15.987531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 607/1198] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:10:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:10:15.993818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe61ed-d5cd-461d-b8e9-6ffb1272e185 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:16.104724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:16.112811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe61ed-d5cd-461d-b8e9-6ffb1272e185 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:16.151923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31985e95-90c7-4cb4-a16a-06233237c596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:16.152710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31985e95-90c7-4cb4-a16a-06233237c596 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:16.152990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31985e95-90c7-4cb4-a16a-06233237c596 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:16.153315 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31985e95-90c7-4cb4-a16a-06233237c596 None admin] PATH_INFO: `/v3/projects/645619f8bff54506a4d22089f7212039` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:16.154610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31985e95-90c7-4cb4-a16a-06233237c596 None admin] RBAC: Authorizing `identity:get_project(project_id=645619f8bff54506a4d22089f7212039)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:16.156070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31985e95-90c7-4cb4-a16a-06233237c596 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:16.157856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 592/1199] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Aug 29 20:10:15 2022] GET /identity/v3/projects/645619f8bff54506a4d22089f7212039 => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:16.164937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c2321-91d3-4cfe-bbf8-3e1cceed896e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:16.281061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c2321-91d3-4cfe-bbf8-3e1cceed896e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:16.321946 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30ceba-5567-46ae-9b8f-93b96ec56771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:16.322735 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30ceba-5567-46ae-9b8f-93b96ec56771 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:16.323009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30ceba-5567-46ae-9b8f-93b96ec56771 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:16.323275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30ceba-5567-46ae-9b8f-93b96ec56771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:16.324040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30ceba-5567-46ae-9b8f-93b96ec56771 None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=645619f8bff54506a4d22089f7212039, user.id=27aec959d018464d8dba3490714cc55f) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:10:16.324350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30ceba-5567-46ae-9b8f-93b96ec56771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:16.325807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30ceba-5567-46ae-9b8f-93b96ec56771 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:16.333570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 608/1200] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:10:16 2022] GET /identity/v3/role_assignments?user.id=27aec959d018464d8dba3490714cc55f&scope.project.id=645619f8bff54506a4d22089f7212039&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:26.147475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=19 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:26.329584 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:43.879390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cfb38-b031-4639-b8d8-bc66f1a4f4ca None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:43.880313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cfb38-b031-4639-b8d8-bc66f1a4f4ca None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:43.880313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cfb38-b031-4639-b8d8-bc66f1a4f4ca None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:43.881846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 593/1201] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:43.888088 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26a625-ab35-4434-af0c-b9dd8bc3eb15 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:43.889606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26a625-ab35-4434-af0c-b9dd8bc3eb15 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:43.889606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26a625-ab35-4434-af0c-b9dd8bc3eb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:43.908959 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1d26a625-ab35-4434-af0c-b9dd8bc3eb15 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:43.910200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1d26a625-ab35-4434-af0c-b9dd8bc3eb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:43.991642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 609/1202] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:11:44.282622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cfb38-b031-4639-b8d8-bc66f1a4f4ca None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:44.403848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cfb38-b031-4639-b8d8-bc66f1a4f4ca None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:44.444322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a3b9d-1b2e-4e87-afdc-09ae4eaa2275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:44.445136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a3b9d-1b2e-4e87-afdc-09ae4eaa2275 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:44.445524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a3b9d-1b2e-4e87-afdc-09ae4eaa2275 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:44.445856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a3b9d-1b2e-4e87-afdc-09ae4eaa2275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:44.458649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a3b9d-1b2e-4e87-afdc-09ae4eaa2275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:44.460122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a3b9d-1b2e-4e87-afdc-09ae4eaa2275 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-9d3a3b9d-1b2e-4e87-afdc-09ae4eaa2275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:44.477539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:44.480665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:44.482258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:44.482258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:44.482258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:11:44.482258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 594/1203] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:44.487347 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26a625-ab35-4434-af0c-b9dd8bc3eb15 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:44.604646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26a625-ab35-4434-af0c-b9dd8bc3eb15 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:44.637995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:44.696953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488c44f-5cb7-4d97-9cea-00c8d3aed4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:44.696953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488c44f-5cb7-4d97-9cea-00c8d3aed4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:44.696953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488c44f-5cb7-4d97-9cea-00c8d3aed4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:44.696953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488c44f-5cb7-4d97-9cea-00c8d3aed4b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:44.697600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488c44f-5cb7-4d97-9cea-00c8d3aed4b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:44.697600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488c44f-5cb7-4d97-9cea-00c8d3aed4b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:44.697600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488c44f-5cb7-4d97-9cea-00c8d3aed4b6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:44.697600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 610/1204] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:11:44.698072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a3b9d-1b2e-4e87-afdc-09ae4eaa2275 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:44.730846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:44.787122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a3b9d-1b2e-4e87-afdc-09ae4eaa2275 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:44.826186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde40453-a93c-4ad9-9ced-cbe7ae7cffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:44.826845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde40453-a93c-4ad9-9ced-cbe7ae7cffa9 None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:44.827125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde40453-a93c-4ad9-9ced-cbe7ae7cffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:44.827494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde40453-a93c-4ad9-9ced-cbe7ae7cffa9 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:44.828173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde40453-a93c-4ad9-9ced-cbe7ae7cffa9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:44.829660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde40453-a93c-4ad9-9ced-cbe7ae7cffa9 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:45.053507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 595/1205] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Aug 29 20:11:44 2022] POST /identity/v3/users => generated 251 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:11:47.126028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2880c-a003-4a02-b5e7-4b128b842c2a None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:47.126954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2880c-a003-4a02-b5e7-4b128b842c2a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:47.127120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2880c-a003-4a02-b5e7-4b128b842c2a None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:47.128721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 611/1206] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:11:47.135136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae48de4-7853-4123-bc3f-93eb40a48b3b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:47.135929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae48de4-7853-4123-bc3f-93eb40a48b3b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:47.135929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae48de4-7853-4123-bc3f-93eb40a48b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:47.156900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6ae48de4-7853-4123-bc3f-93eb40a48b3b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:47.161506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6ae48de4-7853-4123-bc3f-93eb40a48b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:47.271286 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 596/1207] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:11:47.550540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2880c-a003-4a02-b5e7-4b128b842c2a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:47.673989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2880c-a003-4a02-b5e7-4b128b842c2a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:47.716910 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826916de-f0cd-4e8d-b530-d2eb5b56dd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:47.717640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826916de-f0cd-4e8d-b530-d2eb5b56dd13 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:47.717962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826916de-f0cd-4e8d-b530-d2eb5b56dd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:47.718307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826916de-f0cd-4e8d-b530-d2eb5b56dd13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:47.733127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826916de-f0cd-4e8d-b530-d2eb5b56dd13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-826916de-f0cd-4e8d-b530-d2eb5b56dd13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:11:47.738405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:47.740280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:11:47.741991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 612/1208] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:11:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:11:47.747903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae48de4-7853-4123-bc3f-93eb40a48b3b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:47.813361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:47.908196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae48de4-7853-4123-bc3f-93eb40a48b3b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:47.949334 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946c40e-f394-4390-9ceb-abc2c656902a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:47.950726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946c40e-f394-4390-9ceb-abc2c656902a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:47.951227 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946c40e-f394-4390-9ceb-abc2c656902a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:47.951591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946c40e-f394-4390-9ceb-abc2c656902a None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:47.952405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946c40e-f394-4390-9ceb-abc2c656902a None admin] RBAC: Adding query filter params (name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:47.952755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946c40e-f394-4390-9ceb-abc2c656902a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:47.954318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946c40e-f394-4390-9ceb-abc2c656902a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:47.965042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 597/1209] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:11:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:47.972541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826916de-f0cd-4e8d-b530-d2eb5b56dd13 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:48.037942 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:48.101850 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826916de-f0cd-4e8d-b530-d2eb5b56dd13 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:48.141821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d736508-61a9-4074-80b5-cfe8a8ab235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:48.142625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d736508-61a9-4074-80b5-cfe8a8ab235f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:48.142759 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d736508-61a9-4074-80b5-cfe8a8ab235f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:48.143020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d736508-61a9-4074-80b5-cfe8a8ab235f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:48.156402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d736508-61a9-4074-80b5-cfe8a8ab235f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:48.157873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d736508-61a9-4074-80b5-cfe8a8ab235f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-3d736508-61a9-4074-80b5-cfe8a8ab235f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:48.175702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:48.177526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:48.179282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:48.179282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:48.179282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:11:48.179282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 613/1210] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:48.184618 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946c40e-f394-4390-9ceb-abc2c656902a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:48.327040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:48.330441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946c40e-f394-4390-9ceb-abc2c656902a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:48.375956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdad6d-e830-4c23-bdde-76444469084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:48.376591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdad6d-e830-4c23-bdde-76444469084e None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:48.376867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdad6d-e830-4c23-bdde-76444469084e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:48.377138 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdad6d-e830-4c23-bdde-76444469084e None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:48.377802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdad6d-e830-4c23-bdde-76444469084e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:48.378105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdad6d-e830-4c23-bdde-76444469084e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:48.379549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdad6d-e830-4c23-bdde-76444469084e None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:48.393704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 598/1211] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:48.400206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d736508-61a9-4074-80b5-cfe8a8ab235f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:48.535027 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d736508-61a9-4074-80b5-cfe8a8ab235f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:48.536873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:48.573908 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1d6ad-4dd9-4302-a2a7-8b8e31ff860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:48.575436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1d6ad-4dd9-4302-a2a7-8b8e31ff860d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:48.575720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1d6ad-4dd9-4302-a2a7-8b8e31ff860d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:48.575988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1d6ad-4dd9-4302-a2a7-8b8e31ff860d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:48.585004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1d6ad-4dd9-4302-a2a7-8b8e31ff860d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:48.586508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1d6ad-4dd9-4302-a2a7-8b8e31ff860d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-d7b1d6ad-4dd9-4302-a2a7-8b8e31ff860d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:11:48.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:48.601779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:48.602899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:48.602899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:48.602899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:11:48.602899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:11:48.602899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:11:48.602899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:11:48.602899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:11:48.602899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:11:48.602899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:48.602899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:11:48.602899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 614/1212] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:48.611393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdad6d-e830-4c23-bdde-76444469084e None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:48.734467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdad6d-e830-4c23-bdde-76444469084e None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:48.775600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14893e-593a-42aa-94dc-9f352d53abe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:48.776212 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14893e-593a-42aa-94dc-9f352d53abe7 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:48.776488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14893e-593a-42aa-94dc-9f352d53abe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:48.776755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14893e-593a-42aa-94dc-9f352d53abe7 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:48.777496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14893e-593a-42aa-94dc-9f352d53abe7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:48.778795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14893e-593a-42aa-94dc-9f352d53abe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:48.780057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14893e-593a-42aa-94dc-9f352d53abe7 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:48.800149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 599/1213] 10.222.0.81 () {56 vars in 1143 bytes} [Mon Aug 29 20:11:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:48.806591 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1d6ad-4dd9-4302-a2a7-8b8e31ff860d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:48.931321 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1d6ad-4dd9-4302-a2a7-8b8e31ff860d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:48.972629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2662ed-149b-4344-b91a-555555071e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:48.973297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2662ed-149b-4344-b91a-555555071e77 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:48.973641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2662ed-149b-4344-b91a-555555071e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:48.973953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2662ed-149b-4344-b91a-555555071e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:49.010539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:49.069635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2662ed-149b-4344-b91a-555555071e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:49.071134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2662ed-149b-4344-b91a-555555071e77 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:49.202497 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 615/1214] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:11:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:11:49.210393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14893e-593a-42aa-94dc-9f352d53abe7 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:49.234277 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:49.335346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14893e-593a-42aa-94dc-9f352d53abe7 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:49.379921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1b661-07ef-4ada-96fa-de87df5cf6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:49.380649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1b661-07ef-4ada-96fa-de87df5cf6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:49.380980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1b661-07ef-4ada-96fa-de87df5cf6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:49.381295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1b661-07ef-4ada-96fa-de87df5cf6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:49.394275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1b661-07ef-4ada-96fa-de87df5cf6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:49.395788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1b661-07ef-4ada-96fa-de87df5cf6e0 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-5be1b661-07ef-4ada-96fa-de87df5cf6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:49.413905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:49.418938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:49.420750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:49.420750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:49.420750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:11:49.420750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 600/1215] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:11:49.425268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2662ed-149b-4344-b91a-555555071e77 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:49.506833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:49.550638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2662ed-149b-4344-b91a-555555071e77 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:49.594007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd186156-8bad-4a57-8b6e-038c38e40544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:49.594792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd186156-8bad-4a57-8b6e-038c38e40544 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:49.595154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd186156-8bad-4a57-8b6e-038c38e40544 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:49.595462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd186156-8bad-4a57-8b6e-038c38e40544 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:49.596161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd186156-8bad-4a57-8b6e-038c38e40544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:49.596528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd186156-8bad-4a57-8b6e-038c38e40544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:49.598001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd186156-8bad-4a57-8b6e-038c38e40544 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:49.611805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 616/1216] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:49.617994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1b661-07ef-4ada-96fa-de87df5cf6e0 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:49.698092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:49.747448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1b661-07ef-4ada-96fa-de87df5cf6e0 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:49.806853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098ebfe-b77d-4c58-b156-ab0f22f6bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:49.807848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098ebfe-b77d-4c58-b156-ab0f22f6bf01 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:49.808334 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098ebfe-b77d-4c58-b156-ab0f22f6bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:49.809751 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098ebfe-b77d-4c58-b156-ab0f22f6bf01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:49.822568 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098ebfe-b77d-4c58-b156-ab0f22f6bf01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:49.829052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098ebfe-b77d-4c58-b156-ab0f22f6bf01 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-4098ebfe-b77d-4c58-b156-ab0f22f6bf01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:11:49.849771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:49.851654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:49.853876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:11:49.853876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:11:49.853876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:11:49.853876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:11:49.853876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:11:49.853876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:11:49.853876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:49.853876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:11:49.853876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 601/1217] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:11:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:49.859744 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd186156-8bad-4a57-8b6e-038c38e40544 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:50.002958 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd186156-8bad-4a57-8b6e-038c38e40544 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:50.049895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:50.065380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116c753-3a01-46b2-9cca-d93a8cbb7f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:50.065961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116c753-3a01-46b2-9cca-d93a8cbb7f01 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:50.066365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116c753-3a01-46b2-9cca-d93a8cbb7f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:50.066678 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116c753-3a01-46b2-9cca-d93a8cbb7f01 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:50.067511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116c753-3a01-46b2-9cca-d93a8cbb7f01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:50.067862 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116c753-3a01-46b2-9cca-d93a8cbb7f01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:50.069435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116c753-3a01-46b2-9cca-d93a8cbb7f01 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:50.084391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 617/1218] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:11:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:11:50.092908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098ebfe-b77d-4c58-b156-ab0f22f6bf01 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:50.244670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098ebfe-b77d-4c58-b156-ab0f22f6bf01 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:50.282429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:50.288708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193738f0-be4b-4396-8da1-27da964183cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:50.289326 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193738f0-be4b-4396-8da1-27da964183cf None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:50.289606 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193738f0-be4b-4396-8da1-27da964183cf None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:50.289876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193738f0-be4b-4396-8da1-27da964183cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:50.290712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193738f0-be4b-4396-8da1-27da964183cf None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=884b748550d546b7a0bb2bc5b0c614d8) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:50.291221 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193738f0-be4b-4396-8da1-27da964183cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:50.292716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193738f0-be4b-4396-8da1-27da964183cf None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:50.300257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 602/1219] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:11:50 2022] GET /identity/v3/role_assignments?user.id=884b748550d546b7a0bb2bc5b0c614d8&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:52.451687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5271cc-0cab-4802-80a2-7976f4ec8ba2 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:52.452283 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5271cc-0cab-4802-80a2-7976f4ec8ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:52.452649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5271cc-0cab-4802-80a2-7976f4ec8ba2 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:52.455267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 618/1220] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:11:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:52.461350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f31c8c-edff-4f6f-bea5-6234d52f7bd0 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:52.461891 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f31c8c-edff-4f6f-bea5-6234d52f7bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:52.461891 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f31c8c-edff-4f6f-bea5-6234d52f7bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:52.482865 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-93f31c8c-edff-4f6f-bea5-6234d52f7bd0 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:52.484353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-93f31c8c-edff-4f6f-bea5-6234d52f7bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:52.565510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 603/1221] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:11:52.859118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5271cc-0cab-4802-80a2-7976f4ec8ba2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:53.018214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5271cc-0cab-4802-80a2-7976f4ec8ba2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:53.061942 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b11dd-0d08-4088-89d6-310e971d75c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:53.062615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b11dd-0d08-4088-89d6-310e971d75c1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:53.062890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b11dd-0d08-4088-89d6-310e971d75c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:53.063154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b11dd-0d08-4088-89d6-310e971d75c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:53.076500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b11dd-0d08-4088-89d6-310e971d75c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-585b11dd-0d08-4088-89d6-310e971d75c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:11:53.081474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:53.083245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:11:53.084470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 619/1222] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:11:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:11:53.092886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f31c8c-edff-4f6f-bea5-6234d52f7bd0 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:53.266071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f31c8c-edff-4f6f-bea5-6234d52f7bd0 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:53.313848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:53.332244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f045a-9ebd-49f3-8ffb-cdd584775893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:53.332871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f045a-9ebd-49f3-8ffb-cdd584775893 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:53.333162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f045a-9ebd-49f3-8ffb-cdd584775893 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:53.333412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f045a-9ebd-49f3-8ffb-cdd584775893 None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:53.334099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f045a-9ebd-49f3-8ffb-cdd584775893 None admin] RBAC: Adding query filter params (name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:53.334431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f045a-9ebd-49f3-8ffb-cdd584775893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:53.335876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f045a-9ebd-49f3-8ffb-cdd584775893 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:53.347306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 604/1223] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:11:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:53.356137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b11dd-0d08-4088-89d6-310e971d75c1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:53.407880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:53.473395 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b11dd-0d08-4088-89d6-310e971d75c1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:53.515805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ffea2-d6bc-4c5c-bbcf-8da823477102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:53.516585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ffea2-d6bc-4c5c-bbcf-8da823477102 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:53.516806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ffea2-d6bc-4c5c-bbcf-8da823477102 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:53.517081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ffea2-d6bc-4c5c-bbcf-8da823477102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:53.529466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ffea2-d6bc-4c5c-bbcf-8da823477102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:53.531145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ffea2-d6bc-4c5c-bbcf-8da823477102 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-787ffea2-d6bc-4c5c-bbcf-8da823477102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:53.548770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:53.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:53.552711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:53.552711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:53.552711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:11:53.552711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 620/1224] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:53.556109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f045a-9ebd-49f3-8ffb-cdd584775893 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:53.676512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f045a-9ebd-49f3-8ffb-cdd584775893 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:53.718044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ea3ac-fe50-4535-a10a-b1f63c63362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:53.718881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ea3ac-fe50-4535-a10a-b1f63c63362e None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:53.719249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ea3ac-fe50-4535-a10a-b1f63c63362e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:53.719614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ea3ac-fe50-4535-a10a-b1f63c63362e None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:53.720399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ea3ac-fe50-4535-a10a-b1f63c63362e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:53.720801 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ea3ac-fe50-4535-a10a-b1f63c63362e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:53.722382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ea3ac-fe50-4535-a10a-b1f63c63362e None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:53.736857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 605/1225] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:53.742967 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ffea2-d6bc-4c5c-bbcf-8da823477102 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:53.860533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:53.868643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ffea2-d6bc-4c5c-bbcf-8da823477102 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:53.910909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba184e0-2524-4f70-9b3a-0ff23d1149ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:53.911567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba184e0-2524-4f70-9b3a-0ff23d1149ba None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:53.911849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba184e0-2524-4f70-9b3a-0ff23d1149ba None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:53.912180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba184e0-2524-4f70-9b3a-0ff23d1149ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:53.921443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba184e0-2524-4f70-9b3a-0ff23d1149ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:53.923134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba184e0-2524-4f70-9b3a-0ff23d1149ba None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-fba184e0-2524-4f70-9b3a-0ff23d1149ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:11:53.936150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:53.937882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:53.940102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:53.940102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:53.940102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:11:53.940102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:11:53.940102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:11:53.940102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:11:53.940102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:11:53.940102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:11:53.940102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:53.940102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:11:53.940102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 621/1226] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:53.945509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ea3ac-fe50-4535-a10a-b1f63c63362e None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:54.004607 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:54.065080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ea3ac-fe50-4535-a10a-b1f63c63362e None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:54.104397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf27946-f38b-47e7-b651-f2c02d562570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:54.105037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf27946-f38b-47e7-b651-f2c02d562570 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:54.105322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf27946-f38b-47e7-b651-f2c02d562570 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:54.142297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf27946-f38b-47e7-b651-f2c02d562570 None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:54.142297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf27946-f38b-47e7-b651-f2c02d562570 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:54.142297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf27946-f38b-47e7-b651-f2c02d562570 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:54.142297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf27946-f38b-47e7-b651-f2c02d562570 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:54.142297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 606/1227] 10.222.0.81 () {56 vars in 1143 bytes} [Mon Aug 29 20:11:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:11:54.142977 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba184e0-2524-4f70-9b3a-0ff23d1149ba None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:54.272003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba184e0-2524-4f70-9b3a-0ff23d1149ba None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:54.315876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5406d-5201-4ecf-9cff-a23a417293bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:54.316538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5406d-5201-4ecf-9cff-a23a417293bd None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:54.316813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5406d-5201-4ecf-9cff-a23a417293bd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:54.317080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5406d-5201-4ecf-9cff-a23a417293bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:54.330700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5406d-5201-4ecf-9cff-a23a417293bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:54.332359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5406d-5201-4ecf-9cff-a23a417293bd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b3e5406d-5201-4ecf-9cff-a23a417293bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:54.349136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:54.351151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:54.352921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:54.352921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:54.352921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:11:54.354489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 622/1228] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:54.358173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf27946-f38b-47e7-b651-f2c02d562570 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:54.524284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf27946-f38b-47e7-b651-f2c02d562570 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:54.527848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:54.577256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8f898-dc13-45b8-b181-0031aea83ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:54.578344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8f898-dc13-45b8-b181-0031aea83ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:54.578845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8f898-dc13-45b8-b181-0031aea83ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:54.579353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8f898-dc13-45b8-b181-0031aea83ea2 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:54.580513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8f898-dc13-45b8-b181-0031aea83ea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:54.581069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8f898-dc13-45b8-b181-0031aea83ea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:54.583867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8f898-dc13-45b8-b181-0031aea83ea2 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:54.606702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 607/1229] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:54.612852 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5406d-5201-4ecf-9cff-a23a417293bd None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:54.624343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:54.750573 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5406d-5201-4ecf-9cff-a23a417293bd None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:54.807098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b54f12-ee52-4d38-adc7-dabbbd50f876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:54.807668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b54f12-ee52-4d38-adc7-dabbbd50f876 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:54.807950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b54f12-ee52-4d38-adc7-dabbbd50f876 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:54.808225 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b54f12-ee52-4d38-adc7-dabbbd50f876 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:54.816228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b54f12-ee52-4d38-adc7-dabbbd50f876 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:54.817688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b54f12-ee52-4d38-adc7-dabbbd50f876 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-81b54f12-ee52-4d38-adc7-dabbbd50f876 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:11:54.830606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:54.832457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:54.839025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:11:54.839025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:11:54.839025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:11:54.839025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:11:54.839025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:11:54.839025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:11:54.839025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:54.839025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:11:54.839025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 623/1230] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:11:54.840668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8f898-dc13-45b8-b181-0031aea83ea2 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:54.994855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8f898-dc13-45b8-b181-0031aea83ea2 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:55.034630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf0fb7-35ca-4278-b69e-a0ea05492b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:55.035151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf0fb7-35ca-4278-b69e-a0ea05492b56 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:55.040645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf0fb7-35ca-4278-b69e-a0ea05492b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:55.040645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf0fb7-35ca-4278-b69e-a0ea05492b56 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:55.040645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf0fb7-35ca-4278-b69e-a0ea05492b56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:55.040645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf0fb7-35ca-4278-b69e-a0ea05492b56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:55.040645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf0fb7-35ca-4278-b69e-a0ea05492b56 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:55.052933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 608/1231] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:11:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:55.060281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b54f12-ee52-4d38-adc7-dabbbd50f876 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:55.135264 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:55.174118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b54f12-ee52-4d38-adc7-dabbbd50f876 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:55.217026 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ad966-e54c-47c6-a9e5-8330903d805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:55.218210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ad966-e54c-47c6-a9e5-8330903d805f None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:55.218772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ad966-e54c-47c6-a9e5-8330903d805f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:55.219243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ad966-e54c-47c6-a9e5-8330903d805f None admin] PATH_INFO: `/v3/projects/8e86d23a023e4db497277d055b604ebe/users/884b748550d546b7a0bb2bc5b0c614d8/roles/f9bdecb8ab28491cac0078d1452a3bef` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:55.243669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ad966-e54c-47c6-a9e5-8330903d805f None admin] RBAC: Authorizing `identity:create_grant(project_id=8e86d23a023e4db497277d055b604ebe, user_id=884b748550d546b7a0bb2bc5b0c614d8, role_id=f9bdecb8ab28491cac0078d1452a3bef)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:55.245135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ad966-e54c-47c6-a9e5-8330903d805f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:55.434677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 624/1232] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:11:55 2022] PUT /identity/v3/projects/8e86d23a023e4db497277d055b604ebe/users/884b748550d546b7a0bb2bc5b0c614d8/roles/f9bdecb8ab28491cac0078d1452a3bef => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:11:57.488124 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d67a1-32c5-40e7-80f4-aeb1ba0a4a85 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:57.488673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d67a1-32c5-40e7-80f4-aeb1ba0a4a85 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:57.488673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d67a1-32c5-40e7-80f4-aeb1ba0a4a85 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:57.490010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 609/1233] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:57.496676 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c935e6a-3719-470e-bcd4-b6f00cd7423a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:57.497281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c935e6a-3719-470e-bcd4-b6f00cd7423a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:57.497448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c935e6a-3719-470e-bcd4-b6f00cd7423a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:57.517336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0c935e6a-3719-470e-bcd4-b6f00cd7423a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:57.518603 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0c935e6a-3719-470e-bcd4-b6f00cd7423a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:57.599377 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 625/1234] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:11:57.890413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d67a1-32c5-40e7-80f4-aeb1ba0a4a85 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:57.943923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:58.044910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d67a1-32c5-40e7-80f4-aeb1ba0a4a85 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:58.084981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ad30-edbd-4dc4-aebb-8c076ced3583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:58.085637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ad30-edbd-4dc4-aebb-8c076ced3583 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:58.085954 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ad30-edbd-4dc4-aebb-8c076ced3583 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:58.086197 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ad30-edbd-4dc4-aebb-8c076ced3583 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:58.099461 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4ad30-edbd-4dc4-aebb-8c076ced3583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-d4a4ad30-edbd-4dc4-aebb-8c076ced3583 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:11:58.104609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:58.109044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:11:58.109943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 610/1235] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Aug 29 20:11:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:58.114454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c935e6a-3719-470e-bcd4-b6f00cd7423a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:58.179202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:58.254869 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c935e6a-3719-470e-bcd4-b6f00cd7423a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:58.299157 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0471a2-df8a-42bf-a02d-52663d232100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:58.299974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0471a2-df8a-42bf-a02d-52663d232100 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:58.300655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0471a2-df8a-42bf-a02d-52663d232100 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:58.301014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0471a2-df8a-42bf-a02d-52663d232100 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:58.301720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0471a2-df8a-42bf-a02d-52663d232100 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:58.302024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0471a2-df8a-42bf-a02d-52663d232100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:58.303745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0471a2-df8a-42bf-a02d-52663d232100 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:58.314854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 626/1236] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Aug 29 20:11:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:58.325214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ad30-edbd-4dc4-aebb-8c076ced3583 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:58.436770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:58.455186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ad30-edbd-4dc4-aebb-8c076ced3583 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:58.495401 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b41a1e-559f-42e7-8638-c5058e6d424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:58.496996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b41a1e-559f-42e7-8638-c5058e6d424f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:58.496996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b41a1e-559f-42e7-8638-c5058e6d424f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:58.497366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b41a1e-559f-42e7-8638-c5058e6d424f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:58.512145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b41a1e-559f-42e7-8638-c5058e6d424f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:58.513925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b41a1e-559f-42e7-8638-c5058e6d424f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-d2b41a1e-559f-42e7-8638-c5058e6d424f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:58.531898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:58.533550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:58.534720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:58.534720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:58.534720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:11:58.534720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 611/1237] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:58.539748 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0471a2-df8a-42bf-a02d-52663d232100 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:58.667119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0471a2-df8a-42bf-a02d-52663d232100 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:58.679467 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:58.709869 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952b05f-07b1-45e8-9dd8-9b645f32c9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:58.710520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952b05f-07b1-45e8-9dd8-9b645f32c9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:58.710936 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952b05f-07b1-45e8-9dd8-9b645f32c9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:58.717807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952b05f-07b1-45e8-9dd8-9b645f32c9a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:58.717807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952b05f-07b1-45e8-9dd8-9b645f32c9a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:58.717807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952b05f-07b1-45e8-9dd8-9b645f32c9a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:58.717807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952b05f-07b1-45e8-9dd8-9b645f32c9a1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:58.727317 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 627/1238] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:11:58.733789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b41a1e-559f-42e7-8638-c5058e6d424f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:58.880672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b41a1e-559f-42e7-8638-c5058e6d424f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:58.946162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cd968-a2e3-43b3-b26f-37919316a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:58.947307 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cd968-a2e3-43b3-b26f-37919316a481 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:58.947814 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cd968-a2e3-43b3-b26f-37919316a481 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:58.948321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cd968-a2e3-43b3-b26f-37919316a481 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:58.954216 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:58.964306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cd968-a2e3-43b3-b26f-37919316a481 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:58.967833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cd968-a2e3-43b3-b26f-37919316a481 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-218cd968-a2e3-43b3-b26f-37919316a481 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:11:58.992320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:58.993391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:58.994369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:58.994369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:58.994369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:11:58.994369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:11:58.994369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:11:58.994369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:11:58.994369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:11:58.994369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:11:58.994369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:58.994369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:11:58.994914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 612/1239] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:59.001628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952b05f-07b1-45e8-9dd8-9b645f32c9a1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:59.121622 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952b05f-07b1-45e8-9dd8-9b645f32c9a1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:59.167082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1caf0d-0dc2-48ae-84a4-057b84e7c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:59.168622 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1caf0d-0dc2-48ae-84a4-057b84e7c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:59.169118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1caf0d-0dc2-48ae-84a4-057b84e7c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:59.169592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1caf0d-0dc2-48ae-84a4-057b84e7c6a5 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:59.170880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1caf0d-0dc2-48ae-84a4-057b84e7c6a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:59.171370 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1caf0d-0dc2-48ae-84a4-057b84e7c6a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:59.173894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1caf0d-0dc2-48ae-84a4-057b84e7c6a5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:59.206110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 628/1240] 10.222.0.81 () {56 vars in 1143 bytes} [Mon Aug 29 20:11:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:11:59.212366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cd968-a2e3-43b3-b26f-37919316a481 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:59.339285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cd968-a2e3-43b3-b26f-37919316a481 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:59.395634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecd727-88a3-47f3-906d-5c292783580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:59.396273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecd727-88a3-47f3-906d-5c292783580a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:59.396596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecd727-88a3-47f3-906d-5c292783580a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:59.396885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecd727-88a3-47f3-906d-5c292783580a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:59.470005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:59.477597 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecd727-88a3-47f3-906d-5c292783580a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:59.479113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecd727-88a3-47f3-906d-5c292783580a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:59.606214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 613/1241] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:11:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:11:59.612349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1caf0d-0dc2-48ae-84a4-057b84e7c6a5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:59.646104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:59.743270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1caf0d-0dc2-48ae-84a4-057b84e7c6a5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:59.788476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae1bed-e395-4f8c-afad-6aee006d2e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:59.789135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae1bed-e395-4f8c-afad-6aee006d2e67 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:59.789414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae1bed-e395-4f8c-afad-6aee006d2e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:59.789686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae1bed-e395-4f8c-afad-6aee006d2e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:59.804481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae1bed-e395-4f8c-afad-6aee006d2e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:59.812316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae1bed-e395-4f8c-afad-6aee006d2e67 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-e3ae1bed-e395-4f8c-afad-6aee006d2e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:59.836609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:59.840649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:59.841551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:59.841551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:59.841551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:11:59.841551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 629/1242] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:59.845666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecd727-88a3-47f3-906d-5c292783580a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:59.963067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:59.972742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecd727-88a3-47f3-906d-5c292783580a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:00.015344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527a7d-c768-44a1-aa62-b804222cdcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:00.015983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527a7d-c768-44a1-aa62-b804222cdcd2 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:00.016264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527a7d-c768-44a1-aa62-b804222cdcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:00.016537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527a7d-c768-44a1-aa62-b804222cdcd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:00.017213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527a7d-c768-44a1-aa62-b804222cdcd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:00.017515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527a7d-c768-44a1-aa62-b804222cdcd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:00.019267 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527a7d-c768-44a1-aa62-b804222cdcd2 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:00.039439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 614/1243] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:00.047419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae1bed-e395-4f8c-afad-6aee006d2e67 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:00.173200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:00.197961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae1bed-e395-4f8c-afad-6aee006d2e67 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:00.236944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7dccc-46cc-4f25-8bc3-d0abed4574d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:00.237487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7dccc-46cc-4f25-8bc3-d0abed4574d4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:00.237764 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7dccc-46cc-4f25-8bc3-d0abed4574d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:00.238028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7dccc-46cc-4f25-8bc3-d0abed4574d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:00.245330 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7dccc-46cc-4f25-8bc3-d0abed4574d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:00.247398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7dccc-46cc-4f25-8bc3-d0abed4574d4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-93d7dccc-46cc-4f25-8bc3-d0abed4574d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:12:00.260745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:00.268229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:00.269605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:12:00.269605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:12:00.269605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:12:00.269605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:12:00.269605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:12:00.269605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:12:00.269605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:12:00.269605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:00.269605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 630/1244] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:00.270173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527a7d-c768-44a1-aa62-b804222cdcd2 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:00.424792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527a7d-c768-44a1-aa62-b804222cdcd2 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:00.471524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17cdd2-b5ae-41af-b134-2742c330ec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:00.472138 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17cdd2-b5ae-41af-b134-2742c330ec30 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:00.472413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17cdd2-b5ae-41af-b134-2742c330ec30 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:00.472697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17cdd2-b5ae-41af-b134-2742c330ec30 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:00.473380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17cdd2-b5ae-41af-b134-2742c330ec30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:00.473685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17cdd2-b5ae-41af-b134-2742c330ec30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:00.475188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17cdd2-b5ae-41af-b134-2742c330ec30 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:00.490811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 615/1245] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:00.497902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7dccc-46cc-4f25-8bc3-d0abed4574d4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:00.617332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7dccc-46cc-4f25-8bc3-d0abed4574d4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:00.659429 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a24c80-19ea-4acf-8385-bddc0822ea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:00.660053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a24c80-19ea-4acf-8385-bddc0822ea36 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:00.660332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a24c80-19ea-4acf-8385-bddc0822ea36 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:00.660604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a24c80-19ea-4acf-8385-bddc0822ea36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:00.661360 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a24c80-19ea-4acf-8385-bddc0822ea36 None admin] RBAC: Adding query filter params (role.id=f9bdecb8ab28491cac0078d1452a3bef, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=884b748550d546b7a0bb2bc5b0c614d8) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:00.661680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a24c80-19ea-4acf-8385-bddc0822ea36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:00.663466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a24c80-19ea-4acf-8385-bddc0822ea36 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:00.671884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 631/1246] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:12:00 2022] GET /identity/v3/role_assignments?user.id=884b748550d546b7a0bb2bc5b0c614d8&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=f9bdecb8ab28491cac0078d1452a3bef => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:02.767858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce883078-4ef9-484d-9192-ff42ea157c52 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:02.768932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce883078-4ef9-484d-9192-ff42ea157c52 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:02.771906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce883078-4ef9-484d-9192-ff42ea157c52 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:02.774337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 616/1247] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:12:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:12:02.780734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad771775-9c81-45f0-9253-2d704456edf8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:02.782439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad771775-9c81-45f0-9253-2d704456edf8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:02.782439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad771775-9c81-45f0-9253-2d704456edf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:02.788016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:02.802268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ad771775-9c81-45f0-9253-2d704456edf8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:02.803524 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ad771775-9c81-45f0-9253-2d704456edf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:02.892852 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 632/1248] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:12:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:12:03.200970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce883078-4ef9-484d-9192-ff42ea157c52 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:03.232348 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:03.340876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce883078-4ef9-484d-9192-ff42ea157c52 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:03.390157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77154510-9c01-4a1e-bc7b-73763fbd519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:03.391082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77154510-9c01-4a1e-bc7b-73763fbd519e None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:03.391365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77154510-9c01-4a1e-bc7b-73763fbd519e None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:03.391641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77154510-9c01-4a1e-bc7b-73763fbd519e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:03.413219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77154510-9c01-4a1e-bc7b-73763fbd519e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-77154510-9c01-4a1e-bc7b-73763fbd519e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:12:03.419870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:03.421704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:12:03.423130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 617/1249] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:12:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:03.432916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad771775-9c81-45f0-9253-2d704456edf8 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:03.583301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad771775-9c81-45f0-9253-2d704456edf8 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:03.626068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:03.635011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa99f00-abb5-4401-82ff-97d9c03b6e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:03.637107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa99f00-abb5-4401-82ff-97d9c03b6e88 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:03.637905 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa99f00-abb5-4401-82ff-97d9c03b6e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:03.638442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa99f00-abb5-4401-82ff-97d9c03b6e88 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:03.639706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa99f00-abb5-4401-82ff-97d9c03b6e88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:03.640330 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa99f00-abb5-4401-82ff-97d9c03b6e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:03.643071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa99f00-abb5-4401-82ff-97d9c03b6e88 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:03.660955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 633/1250] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:12:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:03.668412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77154510-9c01-4a1e-bc7b-73763fbd519e None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:03.784290 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:03.820946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77154510-9c01-4a1e-bc7b-73763fbd519e None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:03.870601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe3314-f688-4ade-ad4e-9f14fddddb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:03.871600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe3314-f688-4ade-ad4e-9f14fddddb6b None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:03.872072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe3314-f688-4ade-ad4e-9f14fddddb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:03.872546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe3314-f688-4ade-ad4e-9f14fddddb6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:03.892818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe3314-f688-4ade-ad4e-9f14fddddb6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:03.895953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe3314-f688-4ade-ad4e-9f14fddddb6b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-9afe3314-f688-4ade-ad4e-9f14fddddb6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:12:03.917195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:03.923249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:12:03.925341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:12:03.925341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:12:03.925341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:12:03.925341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 618/1251] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:03.927627 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa99f00-abb5-4401-82ff-97d9c03b6e88 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:04.090180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa99f00-abb5-4401-82ff-97d9c03b6e88 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:04.127747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450fec5-f4e9-44a0-a8e2-6ef5d00ee1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:04.128367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450fec5-f4e9-44a0-a8e2-6ef5d00ee1ea None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:04.128644 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450fec5-f4e9-44a0-a8e2-6ef5d00ee1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:04.128911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450fec5-f4e9-44a0-a8e2-6ef5d00ee1ea None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:04.129562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450fec5-f4e9-44a0-a8e2-6ef5d00ee1ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:04.129861 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450fec5-f4e9-44a0-a8e2-6ef5d00ee1ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:04.131319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450fec5-f4e9-44a0-a8e2-6ef5d00ee1ea None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:04.144857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 634/1252] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:04.151310 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe3314-f688-4ade-ad4e-9f14fddddb6b None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:04.267829 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe3314-f688-4ade-ad4e-9f14fddddb6b None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:04.296491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:04.305403 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dbe1b-ca2e-4bd5-8a1e-b6da1d936ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:04.306379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dbe1b-ca2e-4bd5-8a1e-b6da1d936ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:04.306696 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dbe1b-ca2e-4bd5-8a1e-b6da1d936ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:04.307000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dbe1b-ca2e-4bd5-8a1e-b6da1d936ab1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:04.317319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dbe1b-ca2e-4bd5-8a1e-b6da1d936ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:04.323625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dbe1b-ca2e-4bd5-8a1e-b6da1d936ab1 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-827dbe1b-ca2e-4bd5-8a1e-b6da1d936ab1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:12:04.344338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:04.351320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:04.353641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:04.353641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:04.353641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:12:04.353641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:12:04.353641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:12:04.353641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:12:04.353641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:12:04.353641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:12:04.353641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:12:04.353641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:12:04.353641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 619/1253] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:12:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:12:04.356961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450fec5-f4e9-44a0-a8e2-6ef5d00ee1ea None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:04.429825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:04.478665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450fec5-f4e9-44a0-a8e2-6ef5d00ee1ea None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:04.518401 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f6ba3-2ca8-4e23-931d-9f0d9f16dfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:04.519336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f6ba3-2ca8-4e23-931d-9f0d9f16dfce None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:04.519612 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f6ba3-2ca8-4e23-931d-9f0d9f16dfce None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:04.519905 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f6ba3-2ca8-4e23-931d-9f0d9f16dfce None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:04.520841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f6ba3-2ca8-4e23-931d-9f0d9f16dfce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:04.521366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f6ba3-2ca8-4e23-931d-9f0d9f16dfce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:04.523382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f6ba3-2ca8-4e23-931d-9f0d9f16dfce None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:04.548519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 635/1254] 10.222.0.81 () {56 vars in 1143 bytes} [Mon Aug 29 20:12:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:12:04.554288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dbe1b-ca2e-4bd5-8a1e-b6da1d936ab1 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:04.684276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dbe1b-ca2e-4bd5-8a1e-b6da1d936ab1 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:04.730052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3463cfc-b559-4f1b-a258-6ead090b58c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:04.731053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3463cfc-b559-4f1b-a258-6ead090b58c8 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:04.731490 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3463cfc-b559-4f1b-a258-6ead090b58c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:04.731863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3463cfc-b559-4f1b-a258-6ead090b58c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:04.806146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:04.827699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3463cfc-b559-4f1b-a258-6ead090b58c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:04.830412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3463cfc-b559-4f1b-a258-6ead090b58c8 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:04.969276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 620/1255] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:12:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:12:04.978618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f6ba3-2ca8-4e23-931d-9f0d9f16dfce None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:05.110937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f6ba3-2ca8-4e23-931d-9f0d9f16dfce None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:05.128178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:05.155571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b74ae-7abd-43ae-a1e4-3688233a0139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:05.156364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b74ae-7abd-43ae-a1e4-3688233a0139 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:05.156643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b74ae-7abd-43ae-a1e4-3688233a0139 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:05.156917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b74ae-7abd-43ae-a1e4-3688233a0139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:05.169846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b74ae-7abd-43ae-a1e4-3688233a0139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:05.171379 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b74ae-7abd-43ae-a1e4-3688233a0139 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-694b74ae-7abd-43ae-a1e4-3688233a0139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:12:05.189076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:05.190696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:12:05.192639 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:12:05.192639 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:12:05.192639 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:05.192639 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 636/1256] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:05.197399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3463cfc-b559-4f1b-a258-6ead090b58c8 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:05.317761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:05.333072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3463cfc-b559-4f1b-a258-6ead090b58c8 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:05.378940 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900bcfe-9648-4764-b7d7-c276a28be429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:05.379602 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900bcfe-9648-4764-b7d7-c276a28be429 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:05.379879 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900bcfe-9648-4764-b7d7-c276a28be429 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:05.380135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900bcfe-9648-4764-b7d7-c276a28be429 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:05.380799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900bcfe-9648-4764-b7d7-c276a28be429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:05.381097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900bcfe-9648-4764-b7d7-c276a28be429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:05.382544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900bcfe-9648-4764-b7d7-c276a28be429 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:05.398359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 621/1257] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:05.405135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b74ae-7abd-43ae-a1e4-3688233a0139 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:05.527091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b74ae-7abd-43ae-a1e4-3688233a0139 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:05.564393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf24c0-76c2-4e36-83f2-6b4ab133d718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:05.565051 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf24c0-76c2-4e36-83f2-6b4ab133d718 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:05.565297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf24c0-76c2-4e36-83f2-6b4ab133d718 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:05.565562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf24c0-76c2-4e36-83f2-6b4ab133d718 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:05.572364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf24c0-76c2-4e36-83f2-6b4ab133d718 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:05.573765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf24c0-76c2-4e36-83f2-6b4ab133d718 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2abf24c0-76c2-4e36-83f2-6b4ab133d718 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:12:05.585372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:05.586493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:05.587821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:12:05.587821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:12:05.587821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:12:05.587821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:12:05.587821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:12:05.587821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:12:05.587821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:12:05.587821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:05.587821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 637/1258] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:05.593363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900bcfe-9648-4764-b7d7-c276a28be429 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:05.706334 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900bcfe-9648-4764-b7d7-c276a28be429 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:05.741818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076da40-fbc4-4c6c-8073-be4e93c02f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:05.742468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076da40-fbc4-4c6c-8073-be4e93c02f85 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:05.742751 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076da40-fbc4-4c6c-8073-be4e93c02f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:05.743025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076da40-fbc4-4c6c-8073-be4e93c02f85 None admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:05.743736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076da40-fbc4-4c6c-8073-be4e93c02f85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:05.744042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076da40-fbc4-4c6c-8073-be4e93c02f85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:05.746266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076da40-fbc4-4c6c-8073-be4e93c02f85 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:05.760628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 622/1259] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:05.767433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf24c0-76c2-4e36-83f2-6b4ab133d718 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:05.797030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:05.880470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf24c0-76c2-4e36-83f2-6b4ab133d718 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:05.920312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c4b29-f0ea-4618-b9e0-1accc82f2634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:05.920927 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c4b29-f0ea-4618-b9e0-1accc82f2634 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:05.921209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c4b29-f0ea-4618-b9e0-1accc82f2634 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:05.921507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c4b29-f0ea-4618-b9e0-1accc82f2634 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:05.922284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c4b29-f0ea-4618-b9e0-1accc82f2634 None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=884b748550d546b7a0bb2bc5b0c614d8) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:05.922599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c4b29-f0ea-4618-b9e0-1accc82f2634 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:05.924071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c4b29-f0ea-4618-b9e0-1accc82f2634 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:05.930279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 638/1260] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:12:05 2022] GET /identity/v3/role_assignments?user.id=884b748550d546b7a0bb2bc5b0c614d8&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:07.916444 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc9a6a-a59f-4f7e-af8c-28f850e58888 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:07.917806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc9a6a-a59f-4f7e-af8c-28f850e58888 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:07.917806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc9a6a-a59f-4f7e-af8c-28f850e58888 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:07.919077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 623/1261] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:12:07.927142 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422e896-6678-4c83-9e11-e444a61f9a16 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:07.939830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422e896-6678-4c83-9e11-e444a61f9a16 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:07.939830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422e896-6678-4c83-9e11-e444a61f9a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:07.957079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7422e896-6678-4c83-9e11-e444a61f9a16 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:07.959213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7422e896-6678-4c83-9e11-e444a61f9a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:08.043983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 639/1262] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:12:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:12:08.323183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc9a6a-a59f-4f7e-af8c-28f850e58888 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:08.335239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:08.443421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc9a6a-a59f-4f7e-af8c-28f850e58888 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:08.484728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94adfcb-a048-4ac4-930e-b887a79f97d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:08.485374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94adfcb-a048-4ac4-930e-b887a79f97d6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:08.485767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94adfcb-a048-4ac4-930e-b887a79f97d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:08.486041 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94adfcb-a048-4ac4-930e-b887a79f97d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:08.498008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94adfcb-a048-4ac4-930e-b887a79f97d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-e94adfcb-a048-4ac4-930e-b887a79f97d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:12:08.503055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:08.504910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:12:08.507000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 624/1263] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:12:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:08.514727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422e896-6678-4c83-9e11-e444a61f9a16 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:08.535545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:08.624440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422e896-6678-4c83-9e11-e444a61f9a16 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:08.665049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84b8fb-b4d7-437d-b065-4cb87c2e78bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:08.665661 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84b8fb-b4d7-437d-b065-4cb87c2e78bf None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:08.665990 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84b8fb-b4d7-437d-b065-4cb87c2e78bf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:08.666200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84b8fb-b4d7-437d-b065-4cb87c2e78bf None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:08.666930 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84b8fb-b4d7-437d-b065-4cb87c2e78bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:08.667259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84b8fb-b4d7-437d-b065-4cb87c2e78bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:08.668814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84b8fb-b4d7-437d-b065-4cb87c2e78bf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:08.678402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 640/1264] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:12:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:08.684897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94adfcb-a048-4ac4-930e-b887a79f97d6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:08.765676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:08.801411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94adfcb-a048-4ac4-930e-b887a79f97d6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:08.838383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bad07-fadc-4d10-badf-4354fa6da2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:08.839435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bad07-fadc-4d10-badf-4354fa6da2ab None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:08.839794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bad07-fadc-4d10-badf-4354fa6da2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:08.840111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bad07-fadc-4d10-badf-4354fa6da2ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:08.851647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bad07-fadc-4d10-badf-4354fa6da2ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:08.853135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bad07-fadc-4d10-badf-4354fa6da2ab None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-0a2bad07-fadc-4d10-badf-4354fa6da2ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:12:08.870974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:08.874255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:12:08.875425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:12:08.875425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:12:08.875425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:12:08.875425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 625/1265] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:12:08.878451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84b8fb-b4d7-437d-b065-4cb87c2e78bf None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:08.989966 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:09.023965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84b8fb-b4d7-437d-b065-4cb87c2e78bf None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:09.064895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a79d84-6f58-4444-b22f-c2e442681630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:09.072697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a79d84-6f58-4444-b22f-c2e442681630 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:09.072697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a79d84-6f58-4444-b22f-c2e442681630 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:09.072697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a79d84-6f58-4444-b22f-c2e442681630 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:09.072697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a79d84-6f58-4444-b22f-c2e442681630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:09.072697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a79d84-6f58-4444-b22f-c2e442681630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:09.072697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a79d84-6f58-4444-b22f-c2e442681630 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:09.083081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 641/1266] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:09.089796 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bad07-fadc-4d10-badf-4354fa6da2ab None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:09.198146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bad07-fadc-4d10-badf-4354fa6da2ab None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:09.225306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:09.241287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad786052-645a-497b-b2b5-65e2e562ee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:09.241939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad786052-645a-497b-b2b5-65e2e562ee3c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:09.243386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad786052-645a-497b-b2b5-65e2e562ee3c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:09.243386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad786052-645a-497b-b2b5-65e2e562ee3c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:09.252020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad786052-645a-497b-b2b5-65e2e562ee3c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:09.253494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad786052-645a-497b-b2b5-65e2e562ee3c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-ad786052-645a-497b-b2b5-65e2e562ee3c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:12:09.266787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:09.268893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:09.270143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:09.270143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:09.270143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:12:09.270143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:12:09.270143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:12:09.270143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:12:09.270143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:12:09.270143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:12:09.270143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:12:09.270143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:12:09.270143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 626/1267] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:12:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:09.278171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a79d84-6f58-4444-b22f-c2e442681630 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:09.391372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a79d84-6f58-4444-b22f-c2e442681630 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:09.429832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b38fe4-8820-4cd4-8367-ba96250e2e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:09.430484 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b38fe4-8820-4cd4-8367-ba96250e2e83 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:09.430758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b38fe4-8820-4cd4-8367-ba96250e2e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:09.431026 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b38fe4-8820-4cd4-8367-ba96250e2e83 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:09.431773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b38fe4-8820-4cd4-8367-ba96250e2e83 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:09.432074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b38fe4-8820-4cd4-8367-ba96250e2e83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:09.434111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b38fe4-8820-4cd4-8367-ba96250e2e83 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:09.443909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:09.458760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 642/1268] 10.222.0.81 () {56 vars in 1143 bytes} [Mon Aug 29 20:12:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:09.461029 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad786052-645a-497b-b2b5-65e2e562ee3c None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:09.594023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad786052-645a-497b-b2b5-65e2e562ee3c None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:09.631776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cbb6f-075e-47ce-b89a-21ebe8c332d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:09.632421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cbb6f-075e-47ce-b89a-21ebe8c332d6 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:09.632699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cbb6f-075e-47ce-b89a-21ebe8c332d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:09.632966 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cbb6f-075e-47ce-b89a-21ebe8c332d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:09.647231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cbb6f-075e-47ce-b89a-21ebe8c332d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:09.648925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cbb6f-075e-47ce-b89a-21ebe8c332d6 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-c11cbb6f-075e-47ce-b89a-21ebe8c332d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:12:09.667703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:09.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:12:09.670812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:12:09.670812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:12:09.670812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:12:09.670812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 627/1269] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:09.679325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b38fe4-8820-4cd4-8367-ba96250e2e83 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:09.835380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b38fe4-8820-4cd4-8367-ba96250e2e83 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:09.874143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e6c88-8ccb-44a5-adf0-81509d7a25f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:09.874782 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e6c88-8ccb-44a5-adf0-81509d7a25f7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:09.875062 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e6c88-8ccb-44a5-adf0-81509d7a25f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:09.875340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e6c88-8ccb-44a5-adf0-81509d7a25f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:09.875988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e6c88-8ccb-44a5-adf0-81509d7a25f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:09.876301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e6c88-8ccb-44a5-adf0-81509d7a25f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:09.877674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e6c88-8ccb-44a5-adf0-81509d7a25f7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:09.890041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 643/1270] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:09.898850 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cbb6f-075e-47ce-b89a-21ebe8c332d6 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:09.940605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:10.021165 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cbb6f-075e-47ce-b89a-21ebe8c332d6 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:10.057912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f762-2ceb-4930-b029-2322f7e10d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:10.060140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f762-2ceb-4930-b029-2322f7e10d7b None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:10.060417 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f762-2ceb-4930-b029-2322f7e10d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:10.060684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f762-2ceb-4930-b029-2322f7e10d7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:10.069179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f762-2ceb-4930-b029-2322f7e10d7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:10.070845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f762-2ceb-4930-b029-2322f7e10d7b None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-68c4f762-2ceb-4930-b029-2322f7e10d7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:12:10.083541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:10.084637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:10.089421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:12:10.089421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:12:10.089421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:12:10.089421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:12:10.089421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:12:10.089421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:12:10.089421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:12:10.089421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:12:10.089421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 628/1271] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:12:10.091723 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e6c88-8ccb-44a5-adf0-81509d7a25f7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:10.161813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:10.214683 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e6c88-8ccb-44a5-adf0-81509d7a25f7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:10.257791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6d853-747f-44c1-887e-9ae79128f190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:10.258714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6d853-747f-44c1-887e-9ae79128f190 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:10.259048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6d853-747f-44c1-887e-9ae79128f190 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:10.259423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6d853-747f-44c1-887e-9ae79128f190 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:10.260373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6d853-747f-44c1-887e-9ae79128f190 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:10.261285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6d853-747f-44c1-887e-9ae79128f190 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:10.263604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6d853-747f-44c1-887e-9ae79128f190 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:10.281813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 644/1272] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:12:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:10.288292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f762-2ceb-4930-b029-2322f7e10d7b None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:10.430775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:10.440777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f762-2ceb-4930-b029-2322f7e10d7b None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:10.480379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d0e6e-f4d4-43d1-b618-f2e62e541491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:10.488060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d0e6e-f4d4-43d1-b618-f2e62e541491 None admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:10.488060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d0e6e-f4d4-43d1-b618-f2e62e541491 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:10.488060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d0e6e-f4d4-43d1-b618-f2e62e541491 None admin] PATH_INFO: `/v3/projects/8e86d23a023e4db497277d055b604ebe/users/884b748550d546b7a0bb2bc5b0c614d8/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:10.488060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d0e6e-f4d4-43d1-b618-f2e62e541491 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e86d23a023e4db497277d055b604ebe, user_id=884b748550d546b7a0bb2bc5b0c614d8, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:10.488060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d0e6e-f4d4-43d1-b618-f2e62e541491 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:10.584995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 629/1273] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Aug 29 20:12:10 2022] PUT /identity/v3/projects/8e86d23a023e4db497277d055b604ebe/users/884b748550d546b7a0bb2bc5b0c614d8/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:12:12.622100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298e39c-cddf-4605-94c0-4d5fc1a29ef7 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:12.622694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298e39c-cddf-4605-94c0-4d5fc1a29ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:12.622694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298e39c-cddf-4605-94c0-4d5fc1a29ef7 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:12.623978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 645/1274] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:12:12.630071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d835af5-df8c-489e-a940-78bf80c479f9 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:12.630697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d835af5-df8c-489e-a940-78bf80c479f9 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:12.630824 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d835af5-df8c-489e-a940-78bf80c479f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:12.653103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-2d835af5-df8c-489e-a940-78bf80c479f9 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:12.654404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2d835af5-df8c-489e-a940-78bf80c479f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:12.735698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 630/1275] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:12:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:12:13.017801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298e39c-cddf-4605-94c0-4d5fc1a29ef7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:13.140061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298e39c-cddf-4605-94c0-4d5fc1a29ef7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:13.161552 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:13.181134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca181cb-594b-4042-a457-d162b55d0a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:13.181693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca181cb-594b-4042-a457-d162b55d0a0d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:13.181972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca181cb-594b-4042-a457-d162b55d0a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:13.182297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca181cb-594b-4042-a457-d162b55d0a0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:13.194056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca181cb-594b-4042-a457-d162b55d0a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-bca181cb-594b-4042-a457-d162b55d0a0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:12:13.200937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:13.202957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:13.204922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 646/1276] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Aug 29 20:12:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:13.210965 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d835af5-df8c-489e-a940-78bf80c479f9 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:13.329292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:13.363141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d835af5-df8c-489e-a940-78bf80c479f9 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:13.405466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e89ab-bf87-4bd5-b4bb-eb1ef503598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:13.405978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e89ab-bf87-4bd5-b4bb-eb1ef503598f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:13.406287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e89ab-bf87-4bd5-b4bb-eb1ef503598f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:13.406563 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e89ab-bf87-4bd5-b4bb-eb1ef503598f None admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:13.407256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e89ab-bf87-4bd5-b4bb-eb1ef503598f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:13.407559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e89ab-bf87-4bd5-b4bb-eb1ef503598f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:13.409048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e89ab-bf87-4bd5-b4bb-eb1ef503598f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:13.420211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 631/1277] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Aug 29 20:12:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:12:13.426997 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca181cb-594b-4042-a457-d162b55d0a0d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:13.576683 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca181cb-594b-4042-a457-d162b55d0a0d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:13.618913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e08f5-21cb-4ac2-8a82-8c507e9ec078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:13.619471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e08f5-21cb-4ac2-8a82-8c507e9ec078 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:13.620295 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e08f5-21cb-4ac2-8a82-8c507e9ec078 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:13.620572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e08f5-21cb-4ac2-8a82-8c507e9ec078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:13.633408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e08f5-21cb-4ac2-8a82-8c507e9ec078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:13.635186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e08f5-21cb-4ac2-8a82-8c507e9ec078 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-556e08f5-21cb-4ac2-8a82-8c507e9ec078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:12:13.654839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:13.656810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:12:13.658737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:12:13.658737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:12:13.658737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:13.658737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 647/1278] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:13.664043 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e89ab-bf87-4bd5-b4bb-eb1ef503598f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:13.815318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e89ab-bf87-4bd5-b4bb-eb1ef503598f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:13.857059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008a709-495f-4921-9657-fb8626781e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:13.857858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008a709-495f-4921-9657-fb8626781e94 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:13.858284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008a709-495f-4921-9657-fb8626781e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:13.858637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008a709-495f-4921-9657-fb8626781e94 None admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:13.859489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008a709-495f-4921-9657-fb8626781e94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:13.859837 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008a709-495f-4921-9657-fb8626781e94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:13.861484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008a709-495f-4921-9657-fb8626781e94 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:13.877430 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 632/1279] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:13.883898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e08f5-21cb-4ac2-8a82-8c507e9ec078 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:13.922018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:14.002865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e08f5-21cb-4ac2-8a82-8c507e9ec078 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:14.042083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118a5a8-a81c-41ef-b908-6fcf09c2a098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:14.048314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118a5a8-a81c-41ef-b908-6fcf09c2a098 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:14.048314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118a5a8-a81c-41ef-b908-6fcf09c2a098 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:14.048314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118a5a8-a81c-41ef-b908-6fcf09c2a098 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:14.052318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118a5a8-a81c-41ef-b908-6fcf09c2a098 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:14.053842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118a5a8-a81c-41ef-b908-6fcf09c2a098 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-4118a5a8-a81c-41ef-b908-6fcf09c2a098 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:12:14.067305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:14.069253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:14.071423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:14.071423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:14.071423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:12:14.071423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:12:14.071423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:12:14.071423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:12:14.071423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:12:14.071423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:12:14.071423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:12:14.071423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:14.071423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 648/1280] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:12:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:12:14.079119 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008a709-495f-4921-9657-fb8626781e94 None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:14.083661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:14.237679 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008a709-495f-4921-9657-fb8626781e94 None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:14.287141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce5402-28a4-43e4-80dc-2595977c924c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:14.287769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5402-28a4-43e4-80dc-2595977c924c None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:14.288048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5402-28a4-43e4-80dc-2595977c924c None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:14.288322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5402-28a4-43e4-80dc-2595977c924c None admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:14.289086 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5402-28a4-43e4-80dc-2595977c924c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:14.289390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5402-28a4-43e4-80dc-2595977c924c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:14.290911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5402-28a4-43e4-80dc-2595977c924c None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:14.313500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 633/1281] 10.222.0.81 () {56 vars in 1143 bytes} [Mon Aug 29 20:12:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:12:14.322077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118a5a8-a81c-41ef-b908-6fcf09c2a098 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:14.488306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:14.505813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118a5a8-a81c-41ef-b908-6fcf09c2a098 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:14.565851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5d34c-f07a-4fd8-b243-b84b0d8a616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:14.566516 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5d34c-f07a-4fd8-b243-b84b0d8a616b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:14.566803 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5d34c-f07a-4fd8-b243-b84b0d8a616b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:14.567074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5d34c-f07a-4fd8-b243-b84b0d8a616b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:14.653452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5d34c-f07a-4fd8-b243-b84b0d8a616b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:14.655472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5d34c-f07a-4fd8-b243-b84b0d8a616b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:14.813228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:14.827771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 649/1282] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Aug 29 20:12:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:12:14.833986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce5402-28a4-43e4-80dc-2595977c924c None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:14.943836 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:14.991688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce5402-28a4-43e4-80dc-2595977c924c None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:15.033974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4270e-e6f2-44b7-b1cb-65c8a1089acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:15.034655 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4270e-e6f2-44b7-b1cb-65c8a1089acd None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:15.034934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4270e-e6f2-44b7-b1cb-65c8a1089acd None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:15.035201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4270e-e6f2-44b7-b1cb-65c8a1089acd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:15.047807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4270e-e6f2-44b7-b1cb-65c8a1089acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:15.049291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4270e-e6f2-44b7-b1cb-65c8a1089acd None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-1dd4270e-e6f2-44b7-b1cb-65c8a1089acd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:12:15.066749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:15.068581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:12:15.070686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:12:15.070686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:12:15.070686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:12:15.070686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 634/1283] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:12:15.075036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5d34c-f07a-4fd8-b243-b84b0d8a616b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:15.195976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5d34c-f07a-4fd8-b243-b84b0d8a616b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:15.238239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe814a-5dcf-40f2-a676-c37c81b06b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:15.238896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe814a-5dcf-40f2-a676-c37c81b06b63 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:15.239183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe814a-5dcf-40f2-a676-c37c81b06b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:15.239456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe814a-5dcf-40f2-a676-c37c81b06b63 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:15.240114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe814a-5dcf-40f2-a676-c37c81b06b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:15.240420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe814a-5dcf-40f2-a676-c37c81b06b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:15.242010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe814a-5dcf-40f2-a676-c37c81b06b63 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:15.256967 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 650/1284] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Aug 29 20:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:12:15.263936 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4270e-e6f2-44b7-b1cb-65c8a1089acd None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:15.405177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4270e-e6f2-44b7-b1cb-65c8a1089acd None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:15.422925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:15.449255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f7388-31fb-4cdc-9bd4-b0b886212a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:15.449636 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f7388-31fb-4cdc-9bd4-b0b886212a6f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:15.449918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f7388-31fb-4cdc-9bd4-b0b886212a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:15.450189 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f7388-31fb-4cdc-9bd4-b0b886212a6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:15.458181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f7388-31fb-4cdc-9bd4-b0b886212a6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:15.459726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f7388-31fb-4cdc-9bd4-b0b886212a6f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application [None req-250f7388-31fb-4cdc-9bd4-b0b886212a6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:12:15.473583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:15.475339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:15.477159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:12:15.477159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:12:15.477159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:12:15.477159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:12:15.477159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:12:15.477159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:12:15.477159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:12:15.477159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: ERROR keystone.server.flask.application Aug 29 20:12:15.477159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 635/1285] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Aug 29 20:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:15.482534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe814a-5dcf-40f2-a676-c37c81b06b63 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:15.547050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:15.611303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe814a-5dcf-40f2-a676-c37c81b06b63 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:15.653670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3550e-ab93-4d69-a5b2-dc938cbd2b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:15.654788 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3550e-ab93-4d69-a5b2-dc938cbd2b3d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:15.654788 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3550e-ab93-4d69-a5b2-dc938cbd2b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:15.655086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3550e-ab93-4d69-a5b2-dc938cbd2b3d None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:15.655826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3550e-ab93-4d69-a5b2-dc938cbd2b3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:15.656178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3550e-ab93-4d69-a5b2-dc938cbd2b3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:15.657927 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3550e-ab93-4d69-a5b2-dc938cbd2b3d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:15.674201 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 651/1286] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Aug 29 20:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:15.681164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f7388-31fb-4cdc-9bd4-b0b886212a6f None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:15.814122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f7388-31fb-4cdc-9bd4-b0b886212a6f None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:15.864065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4228ed-fd62-4124-abb9-fa461846e671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:15.865055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4228ed-fd62-4124-abb9-fa461846e671 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:15.865552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4228ed-fd62-4124-abb9-fa461846e671 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:15.866028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4228ed-fd62-4124-abb9-fa461846e671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:15.867498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4228ed-fd62-4124-abb9-fa461846e671 None admin] RBAC: Adding query filter params (role.id=4ec42dabc0a34ad59b829e8e5212a167, scope.project.id=8e86d23a023e4db497277d055b604ebe, user.id=884b748550d546b7a0bb2bc5b0c614d8) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:15.868049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4228ed-fd62-4124-abb9-fa461846e671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:15.871441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4228ed-fd62-4124-abb9-fa461846e671 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:15.881998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 636/1287] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Aug 29 20:12:15 2022] GET /identity/v3/role_assignments?user.id=884b748550d546b7a0bb2bc5b0c614d8&scope.project.id=8e86d23a023e4db497277d055b604ebe&role.id=4ec42dabc0a34ad59b829e8e5212a167 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:12:18.301702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c30f1-a571-4256-8b84-bd76ea706b1a None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:18.302292 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c30f1-a571-4256-8b84-bd76ea706b1a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:18.302292 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c30f1-a571-4256-8b84-bd76ea706b1a None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:18.303635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 652/1288] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:12:18.310453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436584-f2ee-4c80-a44b-6de8dfcfaa74 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:18.311244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436584-f2ee-4c80-a44b-6de8dfcfaa74 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:18.311244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436584-f2ee-4c80-a44b-6de8dfcfaa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:18.331979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-85436584-f2ee-4c80-a44b-6de8dfcfaa74 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:18.333208 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-85436584-f2ee-4c80-a44b-6de8dfcfaa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:18.368216 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:18.414777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 637/1289] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:12:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:12:18.701637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c30f1-a571-4256-8b84-bd76ea706b1a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:18.880526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c30f1-a571-4256-8b84-bd76ea706b1a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:18.895766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:18.935032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962e1be-8d3f-467e-bfaa-fbb21d9e0f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:18.935790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962e1be-8d3f-467e-bfaa-fbb21d9e0f41 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:18.936109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962e1be-8d3f-467e-bfaa-fbb21d9e0f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:18.936424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962e1be-8d3f-467e-bfaa-fbb21d9e0f41 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:18.937068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962e1be-8d3f-467e-bfaa-fbb21d9e0f41 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:18.938693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962e1be-8d3f-467e-bfaa-fbb21d9e0f41 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-4962e1be-8d3f-467e-bfaa-fbb21d9e0f41 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:18.949424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:18.951628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:18.953420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 653/1290] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Aug 29 20:12:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:18.960815 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85436584-f2ee-4c80-a44b-6de8dfcfaa74 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:19.086213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85436584-f2ee-4c80-a44b-6de8dfcfaa74 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:19.137505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eed1a-1f92-449d-bb8e-7098babbccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:19.138426 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eed1a-1f92-449d-bb8e-7098babbccea None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:19.138647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eed1a-1f92-449d-bb8e-7098babbccea None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:19.138963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eed1a-1f92-449d-bb8e-7098babbccea None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:19.139671 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96eed1a-1f92-449d-bb8e-7098babbccea None admin] RBAC: Adding query filter params (name=placement) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:19.140085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96eed1a-1f92-449d-bb8e-7098babbccea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:19.141574 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96eed1a-1f92-449d-bb8e-7098babbccea None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:19.149795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 638/1291] 10.222.0.81 () {56 vars in 1116 bytes} [Mon Aug 29 20:12:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:19.157673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962e1be-8d3f-467e-bfaa-fbb21d9e0f41 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:19.306559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962e1be-8d3f-467e-bfaa-fbb21d9e0f41 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:19.347963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475e017-3d31-4c7b-b38c-4bc93f8fff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:19.348611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475e017-3d31-4c7b-b38c-4bc93f8fff0c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:19.348884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475e017-3d31-4c7b-b38c-4bc93f8fff0c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:19.349129 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475e017-3d31-4c7b-b38c-4bc93f8fff0c None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:19.349939 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475e017-3d31-4c7b-b38c-4bc93f8fff0c None admin] RBAC: Adding query filter params (type=placement) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:19.350278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475e017-3d31-4c7b-b38c-4bc93f8fff0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:19.351686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475e017-3d31-4c7b-b38c-4bc93f8fff0c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:19.358574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 654/1292] 10.222.0.81 () {56 vars in 1116 bytes} [Mon Aug 29 20:12:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:21.470917 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39466d09-2462-4c8e-865b-947e0b6c487c None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:21.471734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39466d09-2462-4c8e-865b-947e0b6c487c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:21.471734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39466d09-2462-4c8e-865b-947e0b6c487c None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:21.472833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 639/1293] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:12:21.479421 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b479117-6520-4c7f-9eb4-ae55358506c5 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:21.480075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b479117-6520-4c7f-9eb4-ae55358506c5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:21.480075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b479117-6520-4c7f-9eb4-ae55358506c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:21.500870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6b479117-6520-4c7f-9eb4-ae55358506c5 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:21.502094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6b479117-6520-4c7f-9eb4-ae55358506c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:21.538156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:21.606639 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 655/1294] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:12:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:12:21.889563 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39466d09-2462-4c8e-865b-947e0b6c487c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:21.929805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:22.016578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39466d09-2462-4c8e-865b-947e0b6c487c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:22.071662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ed459-35df-45c9-b34c-f194fc6d90fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:22.072403 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed459-35df-45c9-b34c-f194fc6d90fa None admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:22.073330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed459-35df-45c9-b34c-f194fc6d90fa None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:22.073752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed459-35df-45c9-b34c-f194fc6d90fa None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:22.074537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ed459-35df-45c9-b34c-f194fc6d90fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:22.075982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ed459-35df-45c9-b34c-f194fc6d90fa None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:22.242315 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 640/1295] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Aug 29 20:12:21 2022] POST /identity/v3/services => generated 246 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:12:24.315457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6c488-5bc0-4d5f-aac9-8a5614336203 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:24.316028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6c488-5bc0-4d5f-aac9-8a5614336203 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:24.316028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6c488-5bc0-4d5f-aac9-8a5614336203 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:24.317414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 656/1296] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:12:24.323350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0aab2-94e6-4e68-bf3e-680564be4d8c None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:24.323892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0aab2-94e6-4e68-bf3e-680564be4d8c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:24.323892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0aab2-94e6-4e68-bf3e-680564be4d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:24.345181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-9aa0aab2-94e6-4e68-bf3e-680564be4d8c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:24.346518 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9aa0aab2-94e6-4e68-bf3e-680564be4d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:24.443079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 641/1297] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:12:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:12:24.747945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6c488-5bc0-4d5f-aac9-8a5614336203 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:24.881668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6c488-5bc0-4d5f-aac9-8a5614336203 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:24.923904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0311d8-0508-47e3-bf81-5cc21a4e734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:24.924770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0311d8-0508-47e3-bf81-5cc21a4e734a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:24.925176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0311d8-0508-47e3-bf81-5cc21a4e734a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:24.925553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0311d8-0508-47e3-bf81-5cc21a4e734a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:24.926437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0311d8-0508-47e3-bf81-5cc21a4e734a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:24.928077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0311d8-0508-47e3-bf81-5cc21a4e734a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-5a0311d8-0508-47e3-bf81-5cc21a4e734a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:24.939891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:24.941579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:24.942814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 657/1298] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Aug 29 20:12:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:24.949749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0aab2-94e6-4e68-bf3e-680564be4d8c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:24.976911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:25.084055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0aab2-94e6-4e68-bf3e-680564be4d8c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:25.123760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bacb27-9132-45f2-b3b2-a1d96d37e35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:25.124439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bacb27-9132-45f2-b3b2-a1d96d37e35a None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:25.124740 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bacb27-9132-45f2-b3b2-a1d96d37e35a None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:25.125007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bacb27-9132-45f2-b3b2-a1d96d37e35a None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:25.125701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bacb27-9132-45f2-b3b2-a1d96d37e35a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:25.126005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bacb27-9132-45f2-b3b2-a1d96d37e35a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:25.127564 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bacb27-9132-45f2-b3b2-a1d96d37e35a None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:25.133576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 642/1299] 10.222.0.81 () {56 vars in 1116 bytes} [Mon Aug 29 20:12:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:25.142011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0311d8-0508-47e3-bf81-5cc21a4e734a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:25.177073 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:25.261256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0311d8-0508-47e3-bf81-5cc21a4e734a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:25.304310 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134fa8d-3abf-4af6-a93a-78eec2a21696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:25.305068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134fa8d-3abf-4af6-a93a-78eec2a21696 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:25.305437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134fa8d-3abf-4af6-a93a-78eec2a21696 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:25.305795 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134fa8d-3abf-4af6-a93a-78eec2a21696 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:25.307324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134fa8d-3abf-4af6-a93a-78eec2a21696 None admin] RBAC: Adding query filter params (interface=public, service_id=e8f574c64ae64d9f9d020d4333422ddb, region_id=RegionOne) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:25.307751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134fa8d-3abf-4af6-a93a-78eec2a21696 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:25.309494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134fa8d-3abf-4af6-a93a-78eec2a21696 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:25.315923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 658/1300] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Aug 29 20:12:25 2022] GET /identity/v3/endpoints?service_id=e8f574c64ae64d9f9d020d4333422ddb&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:25.322863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bacb27-9132-45f2-b3b2-a1d96d37e35a None admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:25.458548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:25.490942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bacb27-9132-45f2-b3b2-a1d96d37e35a None admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:25.549950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638b4c1-757d-41b8-8190-2e46dea4f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:25.550988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638b4c1-757d-41b8-8190-2e46dea4f910 None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:25.551467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638b4c1-757d-41b8-8190-2e46dea4f910 None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:25.552142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638b4c1-757d-41b8-8190-2e46dea4f910 None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:25.553329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638b4c1-757d-41b8-8190-2e46dea4f910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:25.555755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638b4c1-757d-41b8-8190-2e46dea4f910 None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:25.569534 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 643/1301] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Aug 29 20:12:25 2022] GET /identity/v3/services => generated 2191 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:12:27.678962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055c25d-e007-48b3-8411-65407f75efea None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:27.679835 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055c25d-e007-48b3-8411-65407f75efea None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:27.679835 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055c25d-e007-48b3-8411-65407f75efea None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:27.681076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 659/1302] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:12:27.688189 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd7dad-998c-453e-98b3-5ee47ac26bcc None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:27.688723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd7dad-998c-453e-98b3-5ee47ac26bcc None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:27.688723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd7dad-998c-453e-98b3-5ee47ac26bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:27.721280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-bccd7dad-998c-453e-98b3-5ee47ac26bcc None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:27.723401 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bccd7dad-998c-453e-98b3-5ee47ac26bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:27.806066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 644/1303] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:12:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:12:28.085860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055c25d-e007-48b3-8411-65407f75efea None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:28.204163 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:28.214080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055c25d-e007-48b3-8411-65407f75efea None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:28.259259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f8d5c-b536-45b4-a8a0-1b7c2e0e33c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:28.260064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f8d5c-b536-45b4-a8a0-1b7c2e0e33c3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:28.260578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f8d5c-b536-45b4-a8a0-1b7c2e0e33c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:28.260953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f8d5c-b536-45b4-a8a0-1b7c2e0e33c3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:28.261714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f8d5c-b536-45b4-a8a0-1b7c2e0e33c3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:28.263290 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f8d5c-b536-45b4-a8a0-1b7c2e0e33c3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-0e4f8d5c-b536-45b4-a8a0-1b7c2e0e33c3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:12:28.273362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:12:28.280118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 20:12:28.282021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 660/1304] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Aug 29 20:12:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:12:28.284115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd7dad-998c-453e-98b3-5ee47ac26bcc None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:28.379724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:28.405532 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd7dad-998c-453e-98b3-5ee47ac26bcc None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:28.446144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7b65a-bf90-4ae4-bd9b-80b050f8c77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:28.447622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7b65a-bf90-4ae4-bd9b-80b050f8c77f None admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:28.448081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7b65a-bf90-4ae4-bd9b-80b050f8c77f None admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:28.448253 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7b65a-bf90-4ae4-bd9b-80b050f8c77f None admin] PATH_INFO: `/v3/services` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:28.448860 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7b65a-bf90-4ae4-bd9b-80b050f8c77f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:12:28.449209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7b65a-bf90-4ae4-bd9b-80b050f8c77f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:28.451533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7b65a-bf90-4ae4-bd9b-80b050f8c77f None admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:28.456835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 645/1305] 10.222.0.81 () {56 vars in 1116 bytes} [Mon Aug 29 20:12:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:28.463378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f8d5c-b536-45b4-a8a0-1b7c2e0e33c3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:28.580465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f8d5c-b536-45b4-a8a0-1b7c2e0e33c3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:28.624619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fc6b1-9d39-4ff4-a551-ee2d032a670e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:28.624619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fc6b1-9d39-4ff4-a551-ee2d032a670e None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:28.624619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fc6b1-9d39-4ff4-a551-ee2d032a670e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:28.624619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fc6b1-9d39-4ff4-a551-ee2d032a670e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:28.625306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fc6b1-9d39-4ff4-a551-ee2d032a670e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:28.625835 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fc6b1-9d39-4ff4-a551-ee2d032a670e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:28.738515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 661/1306] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:12:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:12:38.453291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=30 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:38.733518 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:41.888764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229956cf-5bc8-4de0-b64e-f52d964e5b11 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:41.889854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229956cf-5bc8-4de0-b64e-f52d964e5b11 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:41.890394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229956cf-5bc8-4de0-b64e-f52d964e5b11 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:41.892712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 646/1307] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:21:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:41.898731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724af0cc-1842-483a-a08d-1819dc1ffdca None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:41.899886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724af0cc-1842-483a-a08d-1819dc1ffdca None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:41.900441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724af0cc-1842-483a-a08d-1819dc1ffdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:42.147520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-724af0cc-1842-483a-a08d-1819dc1ffdca None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:42.150428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-724af0cc-1842-483a-a08d-1819dc1ffdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:42.329731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 662/1308] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:42.654630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc88de5-75e6-4bd5-a36d-ef5bed929e01 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:42.655198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc88de5-75e6-4bd5-a36d-ef5bed929e01 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:42.655480 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc88de5-75e6-4bd5-a36d-ef5bed929e01 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:42.657080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 647/1309] 10.222.0.81 () {54 vars in 965 bytes} [Mon Aug 29 20:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:42.665301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f12f-ba57-4f53-882d-e19c733c754e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:42.666090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f12f-ba57-4f53-882d-e19c733c754e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:42.666848 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f12f-ba57-4f53-882d-e19c733c754e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:42.837029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-feb0f12f-ba57-4f53-882d-e19c733c754e None None] MFA Rules not processed for user `241e34a86aba4c3a92ed9d469e6a205e`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:42.839216 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-feb0f12f-ba57-4f53-882d-e19c733c754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:42.877787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:42.943191 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 663/1310] 10.222.0.81 () {58 vars in 1062 bytes} [Mon Aug 29 20:21:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:42.959058 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc88de5-75e6-4bd5-a36d-ef5bed929e01 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:42.967000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3cc88de5-75e6-4bd5-a36d-ef5bed929e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:43.214499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc88de5-75e6-4bd5-a36d-ef5bed929e01 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:43.331705 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee961f-4ac7-4e49-99e6-fbf79594076d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:43.332415 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee961f-4ac7-4e49-99e6-fbf79594076d service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:43.332748 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee961f-4ac7-4e49-99e6-fbf79594076d service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:43.333052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee961f-4ac7-4e49-99e6-fbf79594076d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:43.337600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7aee961f-4ac7-4e49-99e6-fbf79594076d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:43.420504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:43.501494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee961f-4ac7-4e49-99e6-fbf79594076d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:43.503091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee961f-4ac7-4e49-99e6-fbf79594076d service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:43.548117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 648/1311] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:45.985147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d672-a656-4d23-8358-a8e9f489a280 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:45.985711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d672-a656-4d23-8358-a8e9f489a280 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:45.985711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d672-a656-4d23-8358-a8e9f489a280 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:45.987276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 664/1312] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:45.995208 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dbaf0-d4dc-4329-b583-0db793482b42 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:45.995769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dbaf0-d4dc-4329-b583-0db793482b42 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:45.995769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dbaf0-d4dc-4329-b583-0db793482b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:46.077592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-291dbaf0-d4dc-4329-b583-0db793482b42 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:46.078760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-291dbaf0-d4dc-4329-b583-0db793482b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:46.191239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 649/1313] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:21:46.509532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b526d9-4cc3-49a2-9551-e2bbfe02db72 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:46.509816 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b526d9-4cc3-49a2-9551-e2bbfe02db72 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:46.510092 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b526d9-4cc3-49a2-9551-e2bbfe02db72 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:46.511494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 665/1314] 10.222.0.81 () {54 vars in 965 bytes} [Mon Aug 29 20:21:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:46.518399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4eee-5391-4f0b-8807-1186cb69a486 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:46.518685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4eee-5391-4f0b-8807-1186cb69a486 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:46.518961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4eee-5391-4f0b-8807-1186cb69a486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:46.531207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:46.606065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-b44d4eee-5391-4f0b-8807-1186cb69a486 None None] MFA Rules not processed for user `241e34a86aba4c3a92ed9d469e6a205e`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:46.607255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b44d4eee-5391-4f0b-8807-1186cb69a486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:46.695934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 650/1315] 10.222.0.81 () {58 vars in 1062 bytes} [Mon Aug 29 20:21:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:46.705228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b526d9-4cc3-49a2-9551-e2bbfe02db72 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:46.706851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b8b526d9-4cc3-49a2-9551-e2bbfe02db72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:46.829685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b526d9-4cc3-49a2-9551-e2bbfe02db72 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:46.906757 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:46.909376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e55d3-3ea7-4eaf-946d-5463099acdb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:46.909974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e55d3-3ea7-4eaf-946d-5463099acdb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:46.910273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e55d3-3ea7-4eaf-946d-5463099acdb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:46.910542 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e55d3-3ea7-4eaf-946d-5463099acdb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:46.912138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1a4e55d3-3ea7-4eaf-946d-5463099acdb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:47.025153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e55d3-3ea7-4eaf-946d-5463099acdb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:47.026629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e55d3-3ea7-4eaf-946d-5463099acdb7 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:47.053170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 666/1316] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:49.856069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288544cf-c64b-43f0-9a72-b84469a86014 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.856640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288544cf-c64b-43f0-9a72-b84469a86014 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.856809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288544cf-c64b-43f0-9a72-b84469a86014 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.858904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 651/1317] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:21:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:49.865139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd5ef-cad3-4ac6-8e55-118e9370507c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.865642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd5ef-cad3-4ac6-8e55-118e9370507c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.865750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd5ef-cad3-4ac6-8e55-118e9370507c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.940741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-fc1fd5ef-cad3-4ac6-8e55-118e9370507c None None] MFA Rules not processed for user `0ffa4f559dec498ab5306648d2a6ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:49.942015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fc1fd5ef-cad3-4ac6-8e55-118e9370507c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:50.004735 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:50.052181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 667/1318] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:50.343029 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288544cf-c64b-43f0-9a72-b84469a86014 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:50.344551 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-288544cf-c64b-43f0-9a72-b84469a86014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:50.485883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288544cf-c64b-43f0-9a72-b84469a86014 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:50.491730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:50.584807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1976-6b9e-4665-8a5e-60e86711b726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:50.585811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1976-6b9e-4665-8a5e-60e86711b726 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:50.586134 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1976-6b9e-4665-8a5e-60e86711b726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:50.586441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1976-6b9e-4665-8a5e-60e86711b726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:50.588141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-01dd1976-6b9e-4665-8a5e-60e86711b726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:50.720875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd1976-6b9e-4665-8a5e-60e86711b726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:50.722415 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd1976-6b9e-4665-8a5e-60e86711b726 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:50.743185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 652/1319] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:53.902578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165104be-8eeb-4172-883e-455d9de383ad None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:53.903398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165104be-8eeb-4172-883e-455d9de383ad None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:53.903540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165104be-8eeb-4172-883e-455d9de383ad None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:53.905223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 668/1320] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:21:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:53.911642 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb892-5bb7-4ea7-8db5-c312b876b21a None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:53.912200 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb892-5bb7-4ea7-8db5-c312b876b21a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:53.912295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb892-5bb7-4ea7-8db5-c312b876b21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:53.971491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:54.001372 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-204fb892-5bb7-4ea7-8db5-c312b876b21a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:54.023796 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-204fb892-5bb7-4ea7-8db5-c312b876b21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:54.117464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 653/1321] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:54.408404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165104be-8eeb-4172-883e-455d9de383ad None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:54.410025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-165104be-8eeb-4172-883e-455d9de383ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:54.534622 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165104be-8eeb-4172-883e-455d9de383ad None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:54.621773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0acf75-681f-4543-b1a3-538d0e458c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:54.622322 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0acf75-681f-4543-b1a3-538d0e458c9a service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:54.622604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0acf75-681f-4543-b1a3-538d0e458c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:54.622875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0acf75-681f-4543-b1a3-538d0e458c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:54.624570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4d0acf75-681f-4543-b1a3-538d0e458c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:54.632443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:54.752592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0acf75-681f-4543-b1a3-538d0e458c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:54.754050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0acf75-681f-4543-b1a3-538d0e458c9a service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:54.779510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 669/1322] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:58.294851 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4626a-2935-4ca4-97ec-8ba940af9519 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:58.299994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4626a-2935-4ca4-97ec-8ba940af9519 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:58.299994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4626a-2935-4ca4-97ec-8ba940af9519 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:58.299994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 654/1323] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:58.302828 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf025c-f915-4cda-be25-98b85ff754bb None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:58.304119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf025c-f915-4cda-be25-98b85ff754bb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:58.304119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf025c-f915-4cda-be25-98b85ff754bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:58.398065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-abdf025c-f915-4cda-be25-98b85ff754bb None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:58.400369 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-abdf025c-f915-4cda-be25-98b85ff754bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:58.489997 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:58.539574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 670/1324] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:21:58.835583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4626a-2935-4ca4-97ec-8ba940af9519 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:58.837602 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-afe4626a-2935-4ca4-97ec-8ba940af9519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:58.969834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4626a-2935-4ca4-97ec-8ba940af9519 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:58.984861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:59.054510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df6442-ccb0-4b1d-b908-927e97d8032a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:59.055259 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6442-ccb0-4b1d-b908-927e97d8032a service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.055546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6442-ccb0-4b1d-b908-927e97d8032a service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.055890 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6442-ccb0-4b1d-b908-927e97d8032a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.057827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-96df6442-ccb0-4b1d-b908-927e97d8032a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:59.191423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df6442-ccb0-4b1d-b908-927e97d8032a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:59.192780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df6442-ccb0-4b1d-b908-927e97d8032a service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:59.213287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 655/1325] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:01.283163 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d2e69-79a9-4a64-943f-eecb23e0d4fc None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:01.283700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d2e69-79a9-4a64-943f-eecb23e0d4fc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:01.283700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d2e69-79a9-4a64-943f-eecb23e0d4fc None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:01.285074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 671/1326] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:01.291493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7578-1415-41de-b832-eff8661483b1 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:01.291984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7578-1415-41de-b832-eff8661483b1 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:01.292074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7578-1415-41de-b832-eff8661483b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:01.359708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:01.380773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-952c7578-1415-41de-b832-eff8661483b1 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:01.382115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-952c7578-1415-41de-b832-eff8661483b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:01.488610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 656/1327] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:01.794245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d2e69-79a9-4a64-943f-eecb23e0d4fc None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:01.796163 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-907d2e69-79a9-4a64-943f-eecb23e0d4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:01.920833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d2e69-79a9-4a64-943f-eecb23e0d4fc None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:02.015234 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f55d3-a8d8-419b-a0c8-2758143dd2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:02.015853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f55d3-a8d8-419b-a0c8-2758143dd2da service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:02.016126 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f55d3-a8d8-419b-a0c8-2758143dd2da service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:02.016390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f55d3-a8d8-419b-a0c8-2758143dd2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:02.018030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-340f55d3-a8d8-419b-a0c8-2758143dd2da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:02.041043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:02.152602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f55d3-a8d8-419b-a0c8-2758143dd2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:02.154059 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f55d3-a8d8-419b-a0c8-2758143dd2da service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:02.175430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 672/1328] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:04.332902 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02222d26-3c78-45a7-ac68-2069d947b079 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.333472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02222d26-3c78-45a7-ac68-2069d947b079 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.333472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02222d26-3c78-45a7-ac68-2069d947b079 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.335587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 657/1329] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:22:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:04.342002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0960a5-499c-48a2-8bce-e1d81f94987f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.342693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0960a5-499c-48a2-8bce-e1d81f94987f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.342693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0960a5-499c-48a2-8bce-e1d81f94987f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.425187 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6d0960a5-499c-48a2-8bce-e1d81f94987f None None] MFA Rules not processed for user `0ffa4f559dec498ab5306648d2a6ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:04.426536 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6d0960a5-499c-48a2-8bce-e1d81f94987f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:04.504883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:04.559347 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 673/1330] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:04 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:04.874905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02222d26-3c78-45a7-ac68-2069d947b079 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.876560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-02222d26-3c78-45a7-ac68-2069d947b079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:05.000740 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02222d26-3c78-45a7-ac68-2069d947b079 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:05.021885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:05.086169 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfde48f-447a-49bd-a787-7046ece7001e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:05.086738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfde48f-447a-49bd-a787-7046ece7001e service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.087015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfde48f-447a-49bd-a787-7046ece7001e service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.087281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfde48f-447a-49bd-a787-7046ece7001e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.089096 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6dfde48f-447a-49bd-a787-7046ece7001e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:05.218814 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfde48f-447a-49bd-a787-7046ece7001e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:05.220276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfde48f-447a-49bd-a787-7046ece7001e service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:05.242136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 658/1331] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:07.859651 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63979a-17a7-4fbd-b1a3-7abdba01d355 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.860173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63979a-17a7-4fbd-b1a3-7abdba01d355 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.860173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63979a-17a7-4fbd-b1a3-7abdba01d355 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.861452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 674/1332] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:07.868300 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0bd2-33e7-485c-8e13-0528b4d4d2f9 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.868867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0bd2-33e7-485c-8e13-0528b4d4d2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.869155 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0bd2-33e7-485c-8e13-0528b4d4d2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.939498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:07.942665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e2cc0bd2-33e7-485c-8e13-0528b4d4d2f9 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:07.943919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e2cc0bd2-33e7-485c-8e13-0528b4d4d2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:08.060395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 659/1333] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:08.360384 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63979a-17a7-4fbd-b1a3-7abdba01d355 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:08.362481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-db63979a-17a7-4fbd-b1a3-7abdba01d355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:08.492911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63979a-17a7-4fbd-b1a3-7abdba01d355 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:08.575924 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f37dd0-5e76-4f6a-9eff-ef609dbdb9be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:08.576548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f37dd0-5e76-4f6a-9eff-ef609dbdb9be service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:08.576827 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f37dd0-5e76-4f6a-9eff-ef609dbdb9be service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:08.577099 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f37dd0-5e76-4f6a-9eff-ef609dbdb9be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:08.578877 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c6f37dd0-5e76-4f6a-9eff-ef609dbdb9be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:08.612008 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:08.721408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f37dd0-5e76-4f6a-9eff-ef609dbdb9be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:08.722994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f37dd0-5e76-4f6a-9eff-ef609dbdb9be service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:08.744085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 675/1334] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:10.905292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c65310-0c5a-416e-a009-078bb2c4c31b None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:10.906335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c65310-0c5a-416e-a009-078bb2c4c31b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:10.906335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c65310-0c5a-416e-a009-078bb2c4c31b None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:10.908793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 660/1335] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:10.916256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700053e1-3abd-45b1-bd42-d1ea02087a82 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:10.917037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700053e1-3abd-45b1-bd42-d1ea02087a82 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:10.917223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700053e1-3abd-45b1-bd42-d1ea02087a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:10.996877 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-700053e1-3abd-45b1-bd42-d1ea02087a82 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:10.998030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-700053e1-3abd-45b1-bd42-d1ea02087a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:11.084477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:11.108853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 676/1336] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:11.413665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c65310-0c5a-416e-a009-078bb2c4c31b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:11.415268 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-08c65310-0c5a-416e-a009-078bb2c4c31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:11.538336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c65310-0c5a-416e-a009-078bb2c4c31b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:11.570907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:11.622300 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff171e2-65bf-46fb-b49f-4b9f9d0b6405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:11.622814 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff171e2-65bf-46fb-b49f-4b9f9d0b6405 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:11.623093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff171e2-65bf-46fb-b49f-4b9f9d0b6405 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:11.623360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff171e2-65bf-46fb-b49f-4b9f9d0b6405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:11.625014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4ff171e2-65bf-46fb-b49f-4b9f9d0b6405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:11.767861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff171e2-65bf-46fb-b49f-4b9f9d0b6405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:11.769597 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff171e2-65bf-46fb-b49f-4b9f9d0b6405 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:11.795087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 661/1337] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:14.634698 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38114727-84bf-49c1-b97d-9f84d498d5d5 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:14.635251 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38114727-84bf-49c1-b97d-9f84d498d5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:14.635251 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38114727-84bf-49c1-b97d-9f84d498d5d5 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:14.636686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 677/1338] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:14.642662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ad52-4d39-4445-82e6-17079eead1e7 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:14.643240 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ad52-4d39-4445-82e6-17079eead1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:14.643367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ad52-4d39-4445-82e6-17079eead1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:14.720432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f5b2ad52-4d39-4445-82e6-17079eead1e7 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:14.721644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f5b2ad52-4d39-4445-82e6-17079eead1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:14.731383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:14.837906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 662/1339] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:15.126716 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38114727-84bf-49c1-b97d-9f84d498d5d5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:15.128270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-38114727-84bf-49c1-b97d-9f84d498d5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:15.234898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38114727-84bf-49c1-b97d-9f84d498d5d5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:15.312400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc50d58-6fc0-4700-8392-34d09212cdca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:15.313001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc50d58-6fc0-4700-8392-34d09212cdca service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:15.313280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc50d58-6fc0-4700-8392-34d09212cdca service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:15.313546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc50d58-6fc0-4700-8392-34d09212cdca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:15.315204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3fc50d58-6fc0-4700-8392-34d09212cdca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:15.356725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:15.442014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc50d58-6fc0-4700-8392-34d09212cdca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:15.443542 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc50d58-6fc0-4700-8392-34d09212cdca service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:15.464576 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 678/1340] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:20.069709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5af5d4-57f0-48a5-a58f-92f990a30ba8 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:20.070335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5af5d4-57f0-48a5-a58f-92f990a30ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:20.070753 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5af5d4-57f0-48a5-a58f-92f990a30ba8 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:20.073295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 663/1341] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:22:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:20.082531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1552085-1bec-40d0-8d78-ab0e8e7aa6ae None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:20.083111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1552085-1bec-40d0-8d78-ab0e8e7aa6ae None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:20.083482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1552085-1bec-40d0-8d78-ab0e8e7aa6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:20.187576 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d1552085-1bec-40d0-8d78-ab0e8e7aa6ae None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:20.188921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d1552085-1bec-40d0-8d78-ab0e8e7aa6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:20.299340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:20.322286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 679/1342] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:20.619276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5af5d4-57f0-48a5-a58f-92f990a30ba8 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:20.620822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7f5af5d4-57f0-48a5-a58f-92f990a30ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:20.746926 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5af5d4-57f0-48a5-a58f-92f990a30ba8 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:20.789841 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:20.830873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcd440-c490-44dc-8c72-1ab0ec64c583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:20.831503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcd440-c490-44dc-8c72-1ab0ec64c583 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:20.831786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcd440-c490-44dc-8c72-1ab0ec64c583 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:20.832066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcd440-c490-44dc-8c72-1ab0ec64c583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:20.834324 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2abcd440-c490-44dc-8c72-1ab0ec64c583 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:20.969075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcd440-c490-44dc-8c72-1ab0ec64c583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:20.970611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcd440-c490-44dc-8c72-1ab0ec64c583 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:20.993855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 664/1343] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:24.497761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e31c8f-7973-492b-b7c4-96fcc1d47e64 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:24.498401 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e31c8f-7973-492b-b7c4-96fcc1d47e64 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:24.498401 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e31c8f-7973-492b-b7c4-96fcc1d47e64 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:24.499690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 680/1344] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:24.505008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f655-a772-4e41-9404-ec7f6bc87c40 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:24.505534 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f655-a772-4e41-9404-ec7f6bc87c40 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:24.505790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f655-a772-4e41-9404-ec7f6bc87c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:24.580844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-5e81f655-a772-4e41-9404-ec7f6bc87c40 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:24.582071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5e81f655-a772-4e41-9404-ec7f6bc87c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:24.603955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:24.695261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 665/1345] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:24.992873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e31c8f-7973-492b-b7c4-96fcc1d47e64 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:24.994587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a2e31c8f-7973-492b-b7c4-96fcc1d47e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:25.134882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e31c8f-7973-492b-b7c4-96fcc1d47e64 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:25.218560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b525f73-a7f7-4fe1-b427-569724e0a231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:25.219169 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b525f73-a7f7-4fe1-b427-569724e0a231 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:25.219440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b525f73-a7f7-4fe1-b427-569724e0a231 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:25.219701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b525f73-a7f7-4fe1-b427-569724e0a231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:25.221325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2b525f73-a7f7-4fe1-b427-569724e0a231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:25.278673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:25.378257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b525f73-a7f7-4fe1-b427-569724e0a231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:25.379988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b525f73-a7f7-4fe1-b427-569724e0a231 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:25.403004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 681/1346] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:22:30.125281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048e8c9-236e-4475-887c-1760736da4eb None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.126117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048e8c9-236e-4475-887c-1760736da4eb None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.126117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048e8c9-236e-4475-887c-1760736da4eb None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.128230 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 666/1347] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:22:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:30.136520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851b17-7669-48e6-ac36-a039e3f92adc None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.137274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851b17-7669-48e6-ac36-a039e3f92adc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.137924 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851b17-7669-48e6-ac36-a039e3f92adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.247397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-84851b17-7669-48e6-ac36-a039e3f92adc None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:30.249342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-84851b17-7669-48e6-ac36-a039e3f92adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:30.423359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:30.426587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 682/1348] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:30.731762 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048e8c9-236e-4475-887c-1760736da4eb None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.733321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a048e8c9-236e-4475-887c-1760736da4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:30.873472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048e8c9-236e-4475-887c-1760736da4eb None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.948761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:30.987458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfc040-c678-4002-b91a-9147761a7a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.988077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfc040-c678-4002-b91a-9147761a7a16 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.988350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfc040-c678-4002-b91a-9147761a7a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.988617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfc040-c678-4002-b91a-9147761a7a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.990644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-aedfc040-c678-4002-b91a-9147761a7a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:31.133707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfc040-c678-4002-b91a-9147761a7a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:31.135201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfc040-c678-4002-b91a-9147761a7a16 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:31.168217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 667/1349] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:22:37.227075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63a746-817a-4a72-a1d2-a5ec08f5f16b None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.227857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63a746-817a-4a72-a1d2-a5ec08f5f16b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.227857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63a746-817a-4a72-a1d2-a5ec08f5f16b None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.229367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 683/1350] 10.222.0.81 () {54 vars in 921 bytes} [Mon Aug 29 20:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:22:37.244199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7052f4-f03b-454a-b02a-690bc5b43158 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.244199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7052f4-f03b-454a-b02a-690bc5b43158 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.244199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7052f4-f03b-454a-b02a-690bc5b43158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.388180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-de7052f4-f03b-454a-b02a-690bc5b43158 None None] MFA Rules not processed for user `884b748550d546b7a0bb2bc5b0c614d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:37.389838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-de7052f4-f03b-454a-b02a-690bc5b43158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:37.413973 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:37.610473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 668/1351] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Aug 29 20:22:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:42.979100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4756-0fe3-4fa2-87f5-6022e614c22b None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:42.980006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4756-0fe3-4fa2-87f5-6022e614c22b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:42.980268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4756-0fe3-4fa2-87f5-6022e614c22b None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:42.981880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 684/1352] 10.222.0.81 () {54 vars in 921 bytes} [Mon Aug 29 20:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:42.989701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f9c72-e53c-4775-bd8d-8fa195865780 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:42.990318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f9c72-e53c-4775-bd8d-8fa195865780 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:42.990791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f9c72-e53c-4775-bd8d-8fa195865780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:43.139964 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-c16f9c72-e53c-4775-bd8d-8fa195865780 None None] MFA Rules not processed for user `884b748550d546b7a0bb2bc5b0c614d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:43.142120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c16f9c72-e53c-4775-bd8d-8fa195865780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:43.263848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:43.320842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 669/1353] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Aug 29 20:22:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:44.911209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7169-15c6-4904-b613-ba37d67061e0 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:44.916762 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7169-15c6-4904-b613-ba37d67061e0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:44.916762 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7169-15c6-4904-b613-ba37d67061e0 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:44.916762 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 685/1354] 10.222.0.81 () {54 vars in 921 bytes} [Mon Aug 29 20:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:44.919199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d15b35-cc80-4665-9d67-c990388757bf None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:44.919718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d15b35-cc80-4665-9d67-c990388757bf None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:44.919718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d15b35-cc80-4665-9d67-c990388757bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:45.014837 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-09d15b35-cc80-4665-9d67-c990388757bf None None] MFA Rules not processed for user `884b748550d546b7a0bb2bc5b0c614d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:45.016257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-09d15b35-cc80-4665-9d67-c990388757bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:45.193081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 670/1355] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Aug 29 20:22:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:48.943036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d636-7468-48db-9265-d8a54248762d None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.943975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d636-7468-48db-9265-d8a54248762d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.944451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d636-7468-48db-9265-d8a54248762d None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.946517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 686/1356] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:22:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:48.952406 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b4e70-8c3f-4fa3-adc6-a0a32770dd8f None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.953227 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b4e70-8c3f-4fa3-adc6-a0a32770dd8f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.953507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b4e70-8c3f-4fa3-adc6-a0a32770dd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.999859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:49.069542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-316b4e70-8c3f-4fa3-adc6-a0a32770dd8f None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:49.069542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-316b4e70-8c3f-4fa3-adc6-a0a32770dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:49.200994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 671/1357] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:49.543375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6081fd-1a9a-41ad-a9db-94179ce41c88 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.544043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6081fd-1a9a-41ad-a9db-94179ce41c88 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.544549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6081fd-1a9a-41ad-a9db-94179ce41c88 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.546156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 687/1358] 10.222.0.81 () {54 vars in 962 bytes} [Mon Aug 29 20:22:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:49.557831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f82e18-c0e6-425d-9f82-a54be4a7dbb5 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.558839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f82e18-c0e6-425d-9f82-a54be4a7dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.559559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f82e18-c0e6-425d-9f82-a54be4a7dbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.657900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-77f82e18-c0e6-425d-9f82-a54be4a7dbb5 None None] MFA Rules not processed for user `30946d3b3f0f4a81b2ae5aa6e84f3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:49.661039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-77f82e18-c0e6-425d-9f82-a54be4a7dbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:49.746150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:49.869202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 672/1359] 10.222.0.81 () {58 vars in 1059 bytes} [Mon Aug 29 20:22:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:49.878481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6081fd-1a9a-41ad-a9db-94179ce41c88 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:49.880166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1f6081fd-1a9a-41ad-a9db-94179ce41c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:50.050289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6081fd-1a9a-41ad-a9db-94179ce41c88 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:50.164486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:50.227349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeaaa40-d009-4f39-a5c6-c5b15c6d9ab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:50.228208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaaa40-d009-4f39-a5c6-c5b15c6d9ab5 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:50.228643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaaa40-d009-4f39-a5c6-c5b15c6d9ab5 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:50.228923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaaa40-d009-4f39-a5c6-c5b15c6d9ab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:50.230773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9aeaaa40-d009-4f39-a5c6-c5b15c6d9ab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:50.371883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeaaa40-d009-4f39-a5c6-c5b15c6d9ab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:50.373520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeaaa40-d009-4f39-a5c6-c5b15c6d9ab5 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:50.399939 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 688/1360] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:22:52.732606 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b8741-ce07-4c00-98ac-6dc31aa08449 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:52.733079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b8741-ce07-4c00-98ac-6dc31aa08449 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:52.733079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b8741-ce07-4c00-98ac-6dc31aa08449 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:52.738312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 673/1361] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:22:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:52.742953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff988f-5420-4055-86a1-44f7a43d63c2 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:52.743405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff988f-5420-4055-86a1-44f7a43d63c2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:52.743405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff988f-5420-4055-86a1-44f7a43d63c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:52.827617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-19ff988f-5420-4055-86a1-44f7a43d63c2 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:52.829205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-19ff988f-5420-4055-86a1-44f7a43d63c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:52.884454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:52.958072 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 689/1362] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:53.289577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b8741-ce07-4c00-98ac-6dc31aa08449 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:53.289577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b65b8741-ce07-4c00-98ac-6dc31aa08449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:53.516618 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b8741-ce07-4c00-98ac-6dc31aa08449 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:53.527828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:53.666543 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061509c3-beb5-43d1-a3dc-21792d1c5fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:53.667166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061509c3-beb5-43d1-a3dc-21792d1c5fde service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:53.667466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061509c3-beb5-43d1-a3dc-21792d1c5fde service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:53.667835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061509c3-beb5-43d1-a3dc-21792d1c5fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:53.669708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-061509c3-beb5-43d1-a3dc-21792d1c5fde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:53.797112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061509c3-beb5-43d1-a3dc-21792d1c5fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:53.798802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061509c3-beb5-43d1-a3dc-21792d1c5fde service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:53.820893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 674/1363] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:56.328387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93312aa-a076-4c0c-b348-d39236f940e9 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.329257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93312aa-a076-4c0c-b348-d39236f940e9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.329257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93312aa-a076-4c0c-b348-d39236f940e9 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:56.332777 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 690/1364] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:22:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:56.339865 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aae5b0-3814-44e9-9e2a-bdba5c37d347 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.340693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aae5b0-3814-44e9-9e2a-bdba5c37d347 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.340693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aae5b0-3814-44e9-9e2a-bdba5c37d347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:56.363003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:56.446405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-12aae5b0-3814-44e9-9e2a-bdba5c37d347 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:56.448124 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-12aae5b0-3814-44e9-9e2a-bdba5c37d347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:56.570830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 675/1365] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:56.883286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115951c-8a07-47e8-9fdc-59f698207f83 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.884099 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115951c-8a07-47e8-9fdc-59f698207f83 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.884771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115951c-8a07-47e8-9fdc-59f698207f83 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:56.887155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 691/1366] 10.222.0.81 () {54 vars in 962 bytes} [Mon Aug 29 20:22:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:22:56.895766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749165fe-963c-4d9c-b3c3-427c3ad1a831 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.903279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749165fe-963c-4d9c-b3c3-427c3ad1a831 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.903279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749165fe-963c-4d9c-b3c3-427c3ad1a831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:57.005199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-749165fe-963c-4d9c-b3c3-427c3ad1a831 None None] MFA Rules not processed for user `30946d3b3f0f4a81b2ae5aa6e84f3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:57.006719 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-749165fe-963c-4d9c-b3c3-427c3ad1a831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:57.055555 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:57.163406 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 676/1367] 10.222.0.81 () {58 vars in 1059 bytes} [Mon Aug 29 20:22:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:57.180790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115951c-8a07-47e8-9fdc-59f698207f83 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:57.185289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7115951c-8a07-47e8-9fdc-59f698207f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:57.449929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115951c-8a07-47e8-9fdc-59f698207f83 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:57.481574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:57.619244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b30c90-c303-4010-a3f3-b094db4a0715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:57.620691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b30c90-c303-4010-a3f3-b094db4a0715 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:57.621425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b30c90-c303-4010-a3f3-b094db4a0715 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:57.622164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b30c90-c303-4010-a3f3-b094db4a0715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:57.625537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-90b30c90-c303-4010-a3f3-b094db4a0715 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:57.756127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b30c90-c303-4010-a3f3-b094db4a0715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:57.757649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b30c90-c303-4010-a3f3-b094db4a0715 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:57.780623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 692/1368] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:58.634206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c937-e715-4e93-ad5b-0d9ac06c1cba None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:58.634206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c937-e715-4e93-ad5b-0d9ac06c1cba None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:58.634206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c937-e715-4e93-ad5b-0d9ac06c1cba None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:58.635106 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 677/1369] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:22:58.640940 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edc38d-5a91-41f8-8dff-8a0142097cc4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:58.641566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edc38d-5a91-41f8-8dff-8a0142097cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:58.641566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edc38d-5a91-41f8-8dff-8a0142097cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:58.683009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:58.726123 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d7edc38d-5a91-41f8-8dff-8a0142097cc4 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:58.727408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d7edc38d-5a91-41f8-8dff-8a0142097cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:58.864887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 693/1370] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:59.436238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a17e1-650d-4e69-b45e-1ad3f44b53c7 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:59.442726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a17e1-650d-4e69-b45e-1ad3f44b53c7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:59.442726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a17e1-650d-4e69-b45e-1ad3f44b53c7 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:59.442726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 678/1371] 10.222.0.81 () {54 vars in 964 bytes} [Mon Aug 29 20:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:59.446275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e3a48-605f-4746-bf4c-cee5f68e6150 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:59.446993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e3a48-605f-4746-bf4c-cee5f68e6150 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:59.447301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e3a48-605f-4746-bf4c-cee5f68e6150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:59.553727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4e6e3a48-605f-4746-bf4c-cee5f68e6150 None None] MFA Rules not processed for user `e128651197d840bd87220d8f5b246688`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:59.555206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4e6e3a48-605f-4746-bf4c-cee5f68e6150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:59.635978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:59.695572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 694/1372] 10.222.0.81 () {58 vars in 1061 bytes} [Mon Aug 29 20:22:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:59.703332 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a17e1-650d-4e69-b45e-1ad3f44b53c7 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:59.704833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-387a17e1-650d-4e69-b45e-1ad3f44b53c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:59.887990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a17e1-650d-4e69-b45e-1ad3f44b53c7 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:59.955581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:00.000816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a338c7-ff5d-411e-ac46-8b8e4fab14b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:00.001604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a338c7-ff5d-411e-ac46-8b8e4fab14b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:00.001938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a338c7-ff5d-411e-ac46-8b8e4fab14b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:00.002319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a338c7-ff5d-411e-ac46-8b8e4fab14b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:00.004618 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-51a338c7-ff5d-411e-ac46-8b8e4fab14b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:00.155736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a338c7-ff5d-411e-ac46-8b8e4fab14b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:00.157188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a338c7-ff5d-411e-ac46-8b8e4fab14b7 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:00.179738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 679/1373] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:00.192458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319475df-a988-4028-985b-74a5dc30717e None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:00.193004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319475df-a988-4028-985b-74a5dc30717e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:00.193550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319475df-a988-4028-985b-74a5dc30717e None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:00.196031 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 695/1374] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:23:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:00.202886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3e734-40c6-4182-8b7f-55011de9a015 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:00.203174 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3e734-40c6-4182-8b7f-55011de9a015 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:00.203455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3e734-40c6-4182-8b7f-55011de9a015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:00.313237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-35a3e734-40c6-4182-8b7f-55011de9a015 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:00.315529 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-35a3e734-40c6-4182-8b7f-55011de9a015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:00.345632 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:00.449441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 680/1375] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:00.766303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319475df-a988-4028-985b-74a5dc30717e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:00.767884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-319475df-a988-4028-985b-74a5dc30717e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:00.951275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319475df-a988-4028-985b-74a5dc30717e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:01.011331 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:01.131645 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468374f-4984-4800-a861-f907cd3fc06e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:01.132261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468374f-4984-4800-a861-f907cd3fc06e service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:01.132538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468374f-4984-4800-a861-f907cd3fc06e service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:01.132816 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468374f-4984-4800-a861-f907cd3fc06e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:01.134501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8468374f-4984-4800-a861-f907cd3fc06e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:01.237626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468374f-4984-4800-a861-f907cd3fc06e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:01.239628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468374f-4984-4800-a861-f907cd3fc06e service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:01.258441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 696/1376] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:03.528563 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462e027-9aed-42a2-957d-93830483ae59 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:03.529128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462e027-9aed-42a2-957d-93830483ae59 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:03.529128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462e027-9aed-42a2-957d-93830483ae59 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:03.530477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 681/1377] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:03.537296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af936bfd-59c3-42a9-bf89-2b24264d39ae None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:03.537820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af936bfd-59c3-42a9-bf89-2b24264d39ae None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:03.537926 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af936bfd-59c3-42a9-bf89-2b24264d39ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:03.641840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-af936bfd-59c3-42a9-bf89-2b24264d39ae None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:03.643314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-af936bfd-59c3-42a9-bf89-2b24264d39ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:03.653409 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:03.833493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 697/1378] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:04.141574 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462e027-9aed-42a2-957d-93830483ae59 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:04.143288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c462e027-9aed-42a2-957d-93830483ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:04.458954 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462e027-9aed-42a2-957d-93830483ae59 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:04.472398 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:04.612049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa035e1-5aa2-41ff-88db-beb91aeb6198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:04.613719 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa035e1-5aa2-41ff-88db-beb91aeb6198 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:04.613719 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa035e1-5aa2-41ff-88db-beb91aeb6198 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:04.614196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa035e1-5aa2-41ff-88db-beb91aeb6198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:04.616001 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3fa035e1-5aa2-41ff-88db-beb91aeb6198 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:04.753425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa035e1-5aa2-41ff-88db-beb91aeb6198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:04.757114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa035e1-5aa2-41ff-88db-beb91aeb6198 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:04.781569 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 682/1379] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:07.091856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585708fc-bae0-4121-b2d3-77eaa5c3536f None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:07.092381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585708fc-bae0-4121-b2d3-77eaa5c3536f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:07.092381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585708fc-bae0-4121-b2d3-77eaa5c3536f None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:07.093743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 698/1380] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:07.100152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc69490-1028-4545-919b-27876424ff96 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:07.100705 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc69490-1028-4545-919b-27876424ff96 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:07.101495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc69490-1028-4545-919b-27876424ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:07.123883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:07.216051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-4cc69490-1028-4545-919b-27876424ff96 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:07.217655 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4cc69490-1028-4545-919b-27876424ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:07.382309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 683/1381] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:07.705734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585708fc-bae0-4121-b2d3-77eaa5c3536f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:07.707417 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-585708fc-bae0-4121-b2d3-77eaa5c3536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:07.905653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:07.918417 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585708fc-bae0-4121-b2d3-77eaa5c3536f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:08.127526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe2917-34e0-4356-b566-8bd68d428d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:08.129092 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe2917-34e0-4356-b566-8bd68d428d1a service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:08.129596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe2917-34e0-4356-b566-8bd68d428d1a service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:08.130066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe2917-34e0-4356-b566-8bd68d428d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:08.133227 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-34fe2917-34e0-4356-b566-8bd68d428d1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:08.270944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe2917-34e0-4356-b566-8bd68d428d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:08.272557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe2917-34e0-4356-b566-8bd68d428d1a service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:08.283602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:08.293898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 699/1382] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:10.529062 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77310290-de67-435a-a57e-95e764fc4058 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.529620 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77310290-de67-435a-a57e-95e764fc4058 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.530120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77310290-de67-435a-a57e-95e764fc4058 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.532842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 684/1383] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:23:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:10.542970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce09f2c-b581-49ab-8f58-ac5b12b49e35 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.543552 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce09f2c-b581-49ab-8f58-ac5b12b49e35 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.543552 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce09f2c-b581-49ab-8f58-ac5b12b49e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.632145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-cce09f2c-b581-49ab-8f58-ac5b12b49e35 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:10.634292 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cce09f2c-b581-49ab-8f58-ac5b12b49e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:10.788173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 700/1384] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:11.099513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77310290-de67-435a-a57e-95e764fc4058 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.101114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-77310290-de67-435a-a57e-95e764fc4058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:11.234101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:11.334030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77310290-de67-435a-a57e-95e764fc4058 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.505098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b828b-37e3-487d-b4a7-90ce0041cb1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.505892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b828b-37e3-487d-b4a7-90ce0041cb1c service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.506184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b828b-37e3-487d-b4a7-90ce0041cb1c service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.506496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b828b-37e3-487d-b4a7-90ce0041cb1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.508295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-0b0b828b-37e3-487d-b4a7-90ce0041cb1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:11.579959 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:11.633634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b828b-37e3-487d-b4a7-90ce0041cb1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.635590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b828b-37e3-487d-b4a7-90ce0041cb1c service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.662502 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 685/1385] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:13.962262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb84bb-182a-47b7-8671-39b3a9446740 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.963391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb84bb-182a-47b7-8671-39b3a9446740 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.963391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb84bb-182a-47b7-8671-39b3a9446740 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.964039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 701/1386] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:13.970144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe528d-aff1-4136-8a77-42232d3552e0 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.970808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe528d-aff1-4136-8a77-42232d3552e0 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.970808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe528d-aff1-4136-8a77-42232d3552e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:14.069985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-7ffe528d-aff1-4136-8a77-42232d3552e0 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:14.071541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7ffe528d-aff1-4136-8a77-42232d3552e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:14.275150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 686/1387] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:14.622898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb84bb-182a-47b7-8671-39b3a9446740 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:14.624483 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0ecb84bb-182a-47b7-8671-39b3a9446740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:14.755885 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:14.844712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb84bb-182a-47b7-8671-39b3a9446740 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:15.017108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ea59f-bee3-4b9a-88af-4b5cb76e4f8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:15.017866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ea59f-bee3-4b9a-88af-4b5cb76e4f8b service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:15.018095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ea59f-bee3-4b9a-88af-4b5cb76e4f8b service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:15.018739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ea59f-bee3-4b9a-88af-4b5cb76e4f8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:15.021266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ba5ea59f-bee3-4b9a-88af-4b5cb76e4f8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:15.081614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:15.180838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ea59f-bee3-4b9a-88af-4b5cb76e4f8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:15.183884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ea59f-bee3-4b9a-88af-4b5cb76e4f8b service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:15.226162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 702/1388] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:17.726102 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b090-0c4b-4d51-8d3d-7516b45e3843 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:17.726759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b090-0c4b-4d51-8d3d-7516b45e3843 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:17.726759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b090-0c4b-4d51-8d3d-7516b45e3843 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:17.728250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 687/1389] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:17.733884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee43d3-9be1-4eba-bf2e-0d211424bb77 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:17.734635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee43d3-9be1-4eba-bf2e-0d211424bb77 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:17.734635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee43d3-9be1-4eba-bf2e-0d211424bb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:17.814036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ecee43d3-9be1-4eba-bf2e-0d211424bb77 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:17.815462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ecee43d3-9be1-4eba-bf2e-0d211424bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:17.944146 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 703/1390] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:18.249121 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b090-0c4b-4d51-8d3d-7516b45e3843 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:18.250942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7e20b090-0c4b-4d51-8d3d-7516b45e3843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:18.288646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:18.435648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b090-0c4b-4d51-8d3d-7516b45e3843 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:18.557430 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:18.572424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27403423-fa4f-476d-a748-ec7a78f5b1cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:18.573243 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27403423-fa4f-476d-a748-ec7a78f5b1cc service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:18.573669 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27403423-fa4f-476d-a748-ec7a78f5b1cc service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:18.574003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27403423-fa4f-476d-a748-ec7a78f5b1cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:18.575906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-27403423-fa4f-476d-a748-ec7a78f5b1cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:18.591280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b1a4-c8ec-4283-8164-d3c6af5760c8 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:18.591655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b1a4-c8ec-4283-8164-d3c6af5760c8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:18.592109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b1a4-c8ec-4283-8164-d3c6af5760c8 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:18.593778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 704/1391] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:18.600306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dfdfd-97bc-4ad8-a7c1-4a3d2757c5be None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:18.600586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dfdfd-97bc-4ad8-a7c1-4a3d2757c5be None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:18.600849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dfdfd-97bc-4ad8-a7c1-4a3d2757c5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:18.618768 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:18.683650 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-507dfdfd-97bc-4ad8-a7c1-4a3d2757c5be None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:18.684951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-507dfdfd-97bc-4ad8-a7c1-4a3d2757c5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:18.703392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27403423-fa4f-476d-a748-ec7a78f5b1cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:18.705152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27403423-fa4f-476d-a748-ec7a78f5b1cc service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:18.729781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 688/1392] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:18.806338 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 705/1393] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:19.116080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba9f0f-499a-4548-8f2e-3a9d41b64cd6 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:19.116417 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba9f0f-499a-4548-8f2e-3a9d41b64cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:19.116641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba9f0f-499a-4548-8f2e-3a9d41b64cd6 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:19.118056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 689/1394] 10.222.0.81 () {54 vars in 967 bytes} [Mon Aug 29 20:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:19.123570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580ebd-2110-41c5-951f-ae39988655e3 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:19.123870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580ebd-2110-41c5-951f-ae39988655e3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:19.124137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580ebd-2110-41c5-951f-ae39988655e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:19.213963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-07580ebd-2110-41c5-951f-ae39988655e3 None None] MFA Rules not processed for user `7c841f03880c4fb1b402bac6ecce25fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:19.215232 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-07580ebd-2110-41c5-951f-ae39988655e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:19.256108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:19.318539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 706/1395] 10.222.0.81 () {58 vars in 1064 bytes} [Mon Aug 29 20:23:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:19.335072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba9f0f-499a-4548-8f2e-3a9d41b64cd6 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:19.337216 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-44ba9f0f-499a-4548-8f2e-3a9d41b64cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:19.457886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba9f0f-499a-4548-8f2e-3a9d41b64cd6 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:19.472613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:19.545477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2004b-1c67-40ad-9598-b6431993cccc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c841f03880c4fb1b402bac6ecce25fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:19.546520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2004b-1c67-40ad-9598-b6431993cccc service glance] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:19.546816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2004b-1c67-40ad-9598-b6431993cccc service glance] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:19.547091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2004b-1c67-40ad-9598-b6431993cccc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:19.548764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-31d2004b-1c67-40ad-9598-b6431993cccc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:19.699899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2004b-1c67-40ad-9598-b6431993cccc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:19.701542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2004b-1c67-40ad-9598-b6431993cccc service glance] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:19.728210 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 690/1396] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:20.810397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067e9ac-65f2-49cc-a2a6-c55cbd189dce None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:20.811238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067e9ac-65f2-49cc-a2a6-c55cbd189dce None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:20.811436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067e9ac-65f2-49cc-a2a6-c55cbd189dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:20.901812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7067e9ac-65f2-49cc-a2a6-c55cbd189dce None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:20.903174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7067e9ac-65f2-49cc-a2a6-c55cbd189dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:21.011185 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 707/1397] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:23:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:21.057534 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba341a-bcf6-475c-8dd9-d5393e1cb776 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.058065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba341a-bcf6-475c-8dd9-d5393e1cb776 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.058065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba341a-bcf6-475c-8dd9-d5393e1cb776 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.059507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 691/1398] 10.222.0.81 () {54 vars in 943 bytes} [Mon Aug 29 20:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:21.072595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c070845-35bf-42bf-8089-eac92ea65004 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.072595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c070845-35bf-42bf-8089-eac92ea65004 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.072595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c070845-35bf-42bf-8089-eac92ea65004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.076499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea56e32-3915-4c59-b5a5-e5555c8fbda0 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.076786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea56e32-3915-4c59-b5a5-e5555c8fbda0 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.077062 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea56e32-3915-4c59-b5a5-e5555c8fbda0 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.078439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 692/1399] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:21.084041 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a508cf-8948-4c5f-9e61-bdc6104abd80 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.084371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a508cf-8948-4c5f-9e61-bdc6104abd80 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.084644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a508cf-8948-4c5f-9e61-bdc6104abd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.135503 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:21.152505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:21.163233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3c070845-35bf-42bf-8089-eac92ea65004 None None] MFA Rules not processed for user `829ac711e3d84e018404cf6dabeb3845`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:21.164789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3c070845-35bf-42bf-8089-eac92ea65004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:21.166243 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-73a508cf-8948-4c5f-9e61-bdc6104abd80 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:21.167467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-73a508cf-8948-4c5f-9e61-bdc6104abd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:21.304698 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 708/1400] 10.222.0.81 () {58 vars in 1040 bytes} [Mon Aug 29 20:23:21 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:21.313192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 693/1401] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:21.314382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c070845-35bf-42bf-8089-eac92ea65004 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:21.325644 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c070845-35bf-42bf-8089-eac92ea65004 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:21.450743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:21.456719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc8f74-f0f1-4de6-aac9-1755c7e7fc9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:21.457460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8f74-f0f1-4de6-aac9-1755c7e7fc9d service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.457747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8f74-f0f1-4de6-aac9-1755c7e7fc9d service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.458017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8f74-f0f1-4de6-aac9-1755c7e7fc9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.459717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3dbc8f74-f0f1-4de6-aac9-1755c7e7fc9d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:21.554576 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc8f74-f0f1-4de6-aac9-1755c7e7fc9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:21.557513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc8f74-f0f1-4de6-aac9-1755c7e7fc9d service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:21.571558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 709/1402] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:23:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 20:23:21.626614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a508cf-8948-4c5f-9e61-bdc6104abd80 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:21.628007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-73a508cf-8948-4c5f-9e61-bdc6104abd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:21.767981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a508cf-8948-4c5f-9e61-bdc6104abd80 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:21.783315 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:21.920648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fb8cf-8358-4692-8578-edf8b855d267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:21.921668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fb8cf-8358-4692-8578-edf8b855d267 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.922076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fb8cf-8358-4692-8578-edf8b855d267 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.922496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fb8cf-8358-4692-8578-edf8b855d267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.925244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6c9fb8cf-8358-4692-8578-edf8b855d267 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:22.046841 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fb8cf-8358-4692-8578-edf8b855d267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:22.048370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fb8cf-8358-4692-8578-edf8b855d267 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:22.069470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 694/1403] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:24.280025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c64a-16a9-4458-888b-5af98b450ae9 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.280583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c64a-16a9-4458-888b-5af98b450ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.280694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c64a-16a9-4458-888b-5af98b450ae9 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.286137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 710/1404] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:24.287972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4d1c0-8254-45bc-a7a3-3cd2d6c0e18d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.288447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4d1c0-8254-45bc-a7a3-3cd2d6c0e18d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.288532 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4d1c0-8254-45bc-a7a3-3cd2d6c0e18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.309589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:24.367726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-c5d4d1c0-8254-45bc-a7a3-3cd2d6c0e18d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:24.369062 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c5d4d1c0-8254-45bc-a7a3-3cd2d6c0e18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:24.513260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 695/1405] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:24.827689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8c64a-16a9-4458-888b-5af98b450ae9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:24.830035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-33e8c64a-16a9-4458-888b-5af98b450ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:25.026598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:25.039295 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8c64a-16a9-4458-888b-5af98b450ae9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:25.186820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cba07c-030d-48a6-871c-d33ff846b57b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:25.187587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cba07c-030d-48a6-871c-d33ff846b57b service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:25.188058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cba07c-030d-48a6-871c-d33ff846b57b service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:25.188388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cba07c-030d-48a6-871c-d33ff846b57b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:25.192235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c0cba07c-030d-48a6-871c-d33ff846b57b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:25.306806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cba07c-030d-48a6-871c-d33ff846b57b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:25.310582 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cba07c-030d-48a6-871c-d33ff846b57b service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:25.334779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 711/1406] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:25.680596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:27.567790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a3ba-50ea-44b3-af13-f04bca6b073d None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:27.573111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a3ba-50ea-44b3-af13-f04bca6b073d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:27.573111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a3ba-50ea-44b3-af13-f04bca6b073d None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:27.573111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 696/1407] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:27.575213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c383e7-2702-4acb-837e-a40395d9fa48 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:27.575685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c383e7-2702-4acb-837e-a40395d9fa48 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:27.575802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c383e7-2702-4acb-837e-a40395d9fa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:27.649395 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f5c383e7-2702-4acb-837e-a40395d9fa48 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:27.650727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f5c383e7-2702-4acb-837e-a40395d9fa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:27.770496 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 712/1408] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:28.091152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768a3ba-50ea-44b3-af13-f04bca6b073d None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:28.092667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c768a3ba-50ea-44b3-af13-f04bca6b073d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:28.197797 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:28.285431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768a3ba-50ea-44b3-af13-f04bca6b073d None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:28.482871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee59ad-3e75-4c1d-996c-9ff5a1e3ead4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:28.484254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee59ad-3e75-4c1d-996c-9ff5a1e3ead4 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:28.488095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee59ad-3e75-4c1d-996c-9ff5a1e3ead4 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:28.488095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee59ad-3e75-4c1d-996c-9ff5a1e3ead4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:28.497085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-efee59ad-3e75-4c1d-996c-9ff5a1e3ead4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:28.583866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:28.630639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee59ad-3e75-4c1d-996c-9ff5a1e3ead4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:28.630639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee59ad-3e75-4c1d-996c-9ff5a1e3ead4 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:28.657306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 697/1409] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:37.760881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=67 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:38.652505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=20 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:46.807062 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb155e-28da-47fa-b090-9a587e30efaf None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:46.807723 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb155e-28da-47fa-b090-9a587e30efaf None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:46.807723 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb155e-28da-47fa-b090-9a587e30efaf None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:46.809014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 713/1410] 10.222.0.81 () {54 vars in 918 bytes} [Mon Aug 29 20:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:46.815322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93258b7a-0749-4b2e-8cc2-54466af90932 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:46.816143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93258b7a-0749-4b2e-8cc2-54466af90932 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:46.816304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93258b7a-0749-4b2e-8cc2-54466af90932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:46.910939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-93258b7a-0749-4b2e-8cc2-54466af90932 None None] MFA Rules not processed for user `884b748550d546b7a0bb2bc5b0c614d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:46.912484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-93258b7a-0749-4b2e-8cc2-54466af90932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:47.088534 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 698/1411] 10.222.0.81 () {58 vars in 1015 bytes} [Mon Aug 29 20:23:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:47.110698 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e96f8-c6c3-4ab4-b7de-d8a2d087004e None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:47.111567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e96f8-c6c3-4ab4-b7de-d8a2d087004e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:47.111889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e96f8-c6c3-4ab4-b7de-d8a2d087004e None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:47.113540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 714/1412] 10.222.0.81 () {54 vars in 918 bytes} [Mon Aug 29 20:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:47.119168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07877e4-4175-43d3-bb37-968d8d3c98a6 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:47.119497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07877e4-4175-43d3-bb37-968d8d3c98a6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:47.119822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07877e4-4175-43d3-bb37-968d8d3c98a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:47.223120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:47.226772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a07877e4-4175-43d3-bb37-968d8d3c98a6 None None] MFA Rules not processed for user `30946d3b3f0f4a81b2ae5aa6e84f3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:47.228025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a07877e4-4175-43d3-bb37-968d8d3c98a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:47.376105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 699/1413] 10.222.0.81 () {58 vars in 1015 bytes} [Mon Aug 29 20:23:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:50.006901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce5cc-3e7a-4acc-97fc-b1791527f08a None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:50.007516 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce5cc-3e7a-4acc-97fc-b1791527f08a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:50.007516 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce5cc-3e7a-4acc-97fc-b1791527f08a None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:50.008901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:23:50.015138 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999df60-6fda-4bd2-9623-46eef0bb9374 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:50.015707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999df60-6fda-4bd2-9623-46eef0bb9374 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:50.015707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999df60-6fda-4bd2-9623-46eef0bb9374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:50.128486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6999df60-6fda-4bd2-9623-46eef0bb9374 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:50.130375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6999df60-6fda-4bd2-9623-46eef0bb9374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:50.223096 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:50.270072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:50.571957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce5cc-3e7a-4acc-97fc-b1791527f08a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:50.573747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5dbce5cc-3e7a-4acc-97fc-b1791527f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:50.786328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce5cc-3e7a-4acc-97fc-b1791527f08a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:50.884548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:50.936230 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02304e-65bb-4ea5-92cc-c8f4cea2d958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:50.936881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02304e-65bb-4ea5-92cc-c8f4cea2d958 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:50.937144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02304e-65bb-4ea5-92cc-c8f4cea2d958 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:50.937415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02304e-65bb-4ea5-92cc-c8f4cea2d958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:50.939775 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5b02304e-65bb-4ea5-92cc-c8f4cea2d958 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:51.044954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02304e-65bb-4ea5-92cc-c8f4cea2d958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:51.046606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02304e-65bb-4ea5-92cc-c8f4cea2d958 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:51.071303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 716/1416] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:52.043107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302a8e-2244-4630-9569-e5c840cf31c2 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:52.043718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302a8e-2244-4630-9569-e5c840cf31c2 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:52.043826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302a8e-2244-4630-9569-e5c840cf31c2 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:52.045210 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:52.051889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ea65e-32bd-4538-9fde-c12672a2f4e8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:52.052403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ea65e-32bd-4538-9fde-c12672a2f4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:52.052524 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ea65e-32bd-4538-9fde-c12672a2f4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:52.138790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d82ea65e-32bd-4538-9fde-c12672a2f4e8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:52.141459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d82ea65e-32bd-4538-9fde-c12672a2f4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:52.172122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:52.248057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:52.402726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302a8e-2244-4630-9569-e5c840cf31c2 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:52.405620 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-12302a8e-2244-4630-9569-e5c840cf31c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:52.580375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302a8e-2244-4630-9569-e5c840cf31c2 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:52.626907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:52.723738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc68a1-f4c9-4b86-ba2e-190bf5befa49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:52.724365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc68a1-f4c9-4b86-ba2e-190bf5befa49 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:52.724648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc68a1-f4c9-4b86-ba2e-190bf5befa49 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:52.724921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc68a1-f4c9-4b86-ba2e-190bf5befa49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:52.726640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-20fc68a1-f4c9-4b86-ba2e-190bf5befa49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:52.838296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc68a1-f4c9-4b86-ba2e-190bf5befa49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:52.839954 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc68a1-f4c9-4b86-ba2e-190bf5befa49 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:52.859262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 702/1419] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:53.891563 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcd49c-b1ce-44b9-bc55-250b813204fa None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:53.893145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcd49c-b1ce-44b9-bc55-250b813204fa None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:53.893145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcd49c-b1ce-44b9-bc55-250b813204fa None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:53.894638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:23:53.900800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f96ac-3f3f-4d2a-bca8-5d71cbc13376 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:53.901344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f96ac-3f3f-4d2a-bca8-5d71cbc13376 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:53.901344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f96ac-3f3f-4d2a-bca8-5d71cbc13376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:53.974812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:54.003983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a82f96ac-3f3f-4d2a-bca8-5d71cbc13376 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:54.005212 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a82f96ac-3f3f-4d2a-bca8-5d71cbc13376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:54.122390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:54.279273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcd49c-b1ce-44b9-bc55-250b813204fa None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:54.280845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7edcd49c-b1ce-44b9-bc55-250b813204fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:54.479420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcd49c-b1ce-44b9-bc55-250b813204fa None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:54.495562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:54.620689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e9248-7878-4bdd-8231-ecb546a438b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:54.621297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e9248-7878-4bdd-8231-ecb546a438b1 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:54.621575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e9248-7878-4bdd-8231-ecb546a438b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:54.621844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e9248-7878-4bdd-8231-ecb546a438b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:54.623561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-578e9248-7878-4bdd-8231-ecb546a438b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:54.734027 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e9248-7878-4bdd-8231-ecb546a438b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:54.734889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e9248-7878-4bdd-8231-ecb546a438b1 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:54.756732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 719/1422] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:55.669993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde80cfe-6d59-4caf-998a-5b0b61a0b2f0 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:55.670644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde80cfe-6d59-4caf-998a-5b0b61a0b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:55.670644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde80cfe-6d59-4caf-998a-5b0b61a0b2f0 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:55.671937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:55.680264 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e49a9-2000-4963-a8d2-ff14b24c60b0 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:55.680811 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e49a9-2000-4963-a8d2-ff14b24c60b0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:55.681222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e49a9-2000-4963-a8d2-ff14b24c60b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:55.707973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:55.785642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-be5e49a9-2000-4963-a8d2-ff14b24c60b0 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:55.786998 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-be5e49a9-2000-4963-a8d2-ff14b24c60b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:55.944752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:56.102537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde80cfe-6d59-4caf-998a-5b0b61a0b2f0 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:56.104106 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bde80cfe-6d59-4caf-998a-5b0b61a0b2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:56.231543 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:56.276306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde80cfe-6d59-4caf-998a-5b0b61a0b2f0 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:56.435375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25364bb8-1baa-466c-82a4-c4555350d1f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:56.435993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25364bb8-1baa-466c-82a4-c4555350d1f6 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:56.436272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25364bb8-1baa-466c-82a4-c4555350d1f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:56.436542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25364bb8-1baa-466c-82a4-c4555350d1f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:56.438300 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-25364bb8-1baa-466c-82a4-c4555350d1f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:56.536010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:56.552115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25364bb8-1baa-466c-82a4-c4555350d1f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:56.553874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25364bb8-1baa-466c-82a4-c4555350d1f6 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:56.576803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 705/1425] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:57.594559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473ed43-371f-43a2-8e1f-ef1f7c335eb8 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:57.596062 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473ed43-371f-43a2-8e1f-ef1f7c335eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:57.596062 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473ed43-371f-43a2-8e1f-ef1f7c335eb8 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:57.597605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:57.603729 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1539c6-a8f0-45e9-8af6-3e25abaca0b7 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:57.604301 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1539c6-a8f0-45e9-8af6-3e25abaca0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:57.604452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1539c6-a8f0-45e9-8af6-3e25abaca0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:57.725245 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-4e1539c6-a8f0-45e9-8af6-3e25abaca0b7 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:57.727957 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4e1539c6-a8f0-45e9-8af6-3e25abaca0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:57.858155 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:58.015587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473ed43-371f-43a2-8e1f-ef1f7c335eb8 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:58.017252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b473ed43-371f-43a2-8e1f-ef1f7c335eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:58.124158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:58.198765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473ed43-371f-43a2-8e1f-ef1f7c335eb8 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:58.351080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3e5d3-7848-4f54-8db2-0acdb2f585e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:58.352254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3e5d3-7848-4f54-8db2-0acdb2f585e0 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:58.352254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3e5d3-7848-4f54-8db2-0acdb2f585e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:58.352507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3e5d3-7848-4f54-8db2-0acdb2f585e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:58.354216 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6ce3e5d3-7848-4f54-8db2-0acdb2f585e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:58.415797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:58.461222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3e5d3-7848-4f54-8db2-0acdb2f585e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:58.463336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3e5d3-7848-4f54-8db2-0acdb2f585e0 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:58.490929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 722/1428] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:59.466647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea47aa4-5487-4157-b7c3-42786dfeaeb6 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.467400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea47aa4-5487-4157-b7c3-42786dfeaeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.467400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea47aa4-5487-4157-b7c3-42786dfeaeb6 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.468657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:59.475624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e30e3-a835-4c66-80d2-1963a49a2771 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.476492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e30e3-a835-4c66-80d2-1963a49a2771 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.476659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e30e3-a835-4c66-80d2-1963a49a2771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.568324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a07e30e3-a835-4c66-80d2-1963a49a2771 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:59.569485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a07e30e3-a835-4c66-80d2-1963a49a2771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:59.712295 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:59.874174 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea47aa4-5487-4157-b7c3-42786dfeaeb6 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:59.875741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-cea47aa4-5487-4157-b7c3-42786dfeaeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:59.933021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:00.071600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea47aa4-5487-4157-b7c3-42786dfeaeb6 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:00.227248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc2c42-4ce0-4548-9e01-b2b40681d2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:00.227776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc2c42-4ce0-4548-9e01-b2b40681d2e2 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.228053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc2c42-4ce0-4548-9e01-b2b40681d2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.228329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc2c42-4ce0-4548-9e01-b2b40681d2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.230938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-27bc2c42-4ce0-4548-9e01-b2b40681d2e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.247684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:00.366353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc2c42-4ce0-4548-9e01-b2b40681d2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:00.368005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc2c42-4ce0-4548-9e01-b2b40681d2e2 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:00.391238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 708/1431] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:01.405880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b0ea-fa0b-4302-83b7-d1a23b1de133 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.406506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b0ea-fa0b-4302-83b7-d1a23b1de133 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.406506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b0ea-fa0b-4302-83b7-d1a23b1de133 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.407957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:24:01.414903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fac7c-c221-4fd0-9ba4-6ce220ee1a16 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.415470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fac7c-c221-4fd0-9ba4-6ce220ee1a16 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.415470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fac7c-c221-4fd0-9ba4-6ce220ee1a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.516348 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-c62fac7c-c221-4fd0-9ba4-6ce220ee1a16 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:01.518319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c62fac7c-c221-4fd0-9ba4-6ce220ee1a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:01.601468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:01.635665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:01.796207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715b0ea-fa0b-4302-83b7-d1a23b1de133 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.798326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7715b0ea-fa0b-4302-83b7-d1a23b1de133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:01.819618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:01.974836 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715b0ea-fa0b-4302-83b7-d1a23b1de133 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:02.100777 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:02.135132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56bf46-8ea6-41ac-8e6b-6301411e866d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:02.135780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56bf46-8ea6-41ac-8e6b-6301411e866d service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.136071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56bf46-8ea6-41ac-8e6b-6301411e866d service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.136575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56bf46-8ea6-41ac-8e6b-6301411e866d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.138368 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-af56bf46-8ea6-41ac-8e6b-6301411e866d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:02.241432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56bf46-8ea6-41ac-8e6b-6301411e866d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:02.243613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56bf46-8ea6-41ac-8e6b-6301411e866d service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:02.268437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 725/1434] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:03.282595 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81cf90-8240-431b-b5e7-eee629dc6bd4 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:03.283538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81cf90-8240-431b-b5e7-eee629dc6bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:03.283826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81cf90-8240-431b-b5e7-eee629dc6bd4 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:03.285259 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:24:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:24:03.291666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78e2d3-082d-40d6-a44c-1cea2b05ce9d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:03.292211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78e2d3-082d-40d6-a44c-1cea2b05ce9d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:03.292551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78e2d3-082d-40d6-a44c-1cea2b05ce9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:03.398863 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0d78e2d3-082d-40d6-a44c-1cea2b05ce9d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:03.401162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0d78e2d3-082d-40d6-a44c-1cea2b05ce9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:03.467856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:03.567572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:03.746823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81cf90-8240-431b-b5e7-eee629dc6bd4 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:03.748599 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6a81cf90-8240-431b-b5e7-eee629dc6bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:03.932152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81cf90-8240-431b-b5e7-eee629dc6bd4 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:03.990955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:04.068709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7c81c-0759-4bcd-ba86-6221f8288bed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:04.069418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7c81c-0759-4bcd-ba86-6221f8288bed service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:04.069779 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7c81c-0759-4bcd-ba86-6221f8288bed service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:04.070156 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7c81c-0759-4bcd-ba86-6221f8288bed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:04.072060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4fc7c81c-0759-4bcd-ba86-6221f8288bed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:04.179074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7c81c-0759-4bcd-ba86-6221f8288bed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:04.180746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7c81c-0759-4bcd-ba86-6221f8288bed service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:04.201783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 711/1437] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:05.113851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a455b1-9d08-4cba-8d32-2f9f297d96fd None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:05.114637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a455b1-9d08-4cba-8d32-2f9f297d96fd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:05.114637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a455b1-9d08-4cba-8d32-2f9f297d96fd None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:05.115914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:05.121405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda586-6fff-4f66-9e4c-df8ac8526188 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:05.121926 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda586-6fff-4f66-9e4c-df8ac8526188 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:05.122189 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda586-6fff-4f66-9e4c-df8ac8526188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:05.232118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d4fda586-6fff-4f66-9e4c-df8ac8526188 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:05.233539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d4fda586-6fff-4f66-9e4c-df8ac8526188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:05.236710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:05.356478 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:05.527574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a455b1-9d08-4cba-8d32-2f9f297d96fd None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:05.529678 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a8a455b1-9d08-4cba-8d32-2f9f297d96fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:05.706147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a455b1-9d08-4cba-8d32-2f9f297d96fd None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:05.736204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:05.833772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c53eb-d1be-4cb2-8cc2-2813d9311d82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:05.834533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c53eb-d1be-4cb2-8cc2-2813d9311d82 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:05.834695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c53eb-d1be-4cb2-8cc2-2813d9311d82 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:05.834962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c53eb-d1be-4cb2-8cc2-2813d9311d82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:05.836574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f01c53eb-d1be-4cb2-8cc2-2813d9311d82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:05.951686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c53eb-d1be-4cb2-8cc2-2813d9311d82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:05.954177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c53eb-d1be-4cb2-8cc2-2813d9311d82 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:05.988491 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 728/1440] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:07.900172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0134b0-fdf1-417d-b0de-210696881d2a None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:07.900785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0134b0-fdf1-417d-b0de-210696881d2a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:07.900785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0134b0-fdf1-417d-b0de-210696881d2a None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:07.902109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:07.908686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff42962-958f-4081-8a89-8172bf6ffc94 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:07.909267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff42962-958f-4081-8a89-8172bf6ffc94 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:07.909267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff42962-958f-4081-8a89-8172bf6ffc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:07.964211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:07.996602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5ff42962-958f-4081-8a89-8172bf6ffc94 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:07.997940 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5ff42962-958f-4081-8a89-8172bf6ffc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:08.105135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:08.394826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0134b0-fdf1-417d-b0de-210696881d2a None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:08.396972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7a0134b0-fdf1-417d-b0de-210696881d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:08.536380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0134b0-fdf1-417d-b0de-210696881d2a None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:08.573077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:08.620339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee9228-0d80-4080-b3d6-c6d4887039fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:08.620949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee9228-0d80-4080-b3d6-c6d4887039fa service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:08.621228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee9228-0d80-4080-b3d6-c6d4887039fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:08.621501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee9228-0d80-4080-b3d6-c6d4887039fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:08.623178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-83ee9228-0d80-4080-b3d6-c6d4887039fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:08.760767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee9228-0d80-4080-b3d6-c6d4887039fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:08.762327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee9228-0d80-4080-b3d6-c6d4887039fa service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:08.785367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 714/1443] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:11.007395 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2b238-716a-4d51-b493-4e57c6781ed5 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:11.007923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2b238-716a-4d51-b493-4e57c6781ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:11.007923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2b238-716a-4d51-b493-4e57c6781ed5 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:11.009226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:11.016143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e72d9-fdf7-47d0-84b5-f320f1985cb9 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:11.016714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e72d9-fdf7-47d0-84b5-f320f1985cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:11.016714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e72d9-fdf7-47d0-84b5-f320f1985cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:11.090810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ea0e72d9-fdf7-47d0-84b5-f320f1985cb9 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:11.092060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ea0e72d9-fdf7-47d0-84b5-f320f1985cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:11.106892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:11.218667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:11.512157 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2b238-716a-4d51-b493-4e57c6781ed5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:11.513714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9bb2b238-716a-4d51-b493-4e57c6781ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:11.643890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2b238-716a-4d51-b493-4e57c6781ed5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:11.657749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:11.738361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d16282-8a59-4f15-b010-265c5c487469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:11.738979 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d16282-8a59-4f15-b010-265c5c487469 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:11.739266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d16282-8a59-4f15-b010-265c5c487469 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:11.739563 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d16282-8a59-4f15-b010-265c5c487469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:11.741339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-05d16282-8a59-4f15-b010-265c5c487469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:11.869649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d16282-8a59-4f15-b010-265c5c487469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:11.871129 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d16282-8a59-4f15-b010-265c5c487469 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:11.892141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 731/1446] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:14.427406 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a2d4b-75d4-44d5-8d8f-8b0a4bba771f None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:14.427976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a2d4b-75d4-44d5-8d8f-8b0a4bba771f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:14.427976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a2d4b-75d4-44d5-8d8f-8b0a4bba771f None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:14.429326 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:14.436366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a537f3-a166-4693-ade6-5bcd6aee9282 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:14.437221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a537f3-a166-4693-ade6-5bcd6aee9282 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:14.437785 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a537f3-a166-4693-ade6-5bcd6aee9282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:14.498776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:14.520857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-34a537f3-a166-4693-ade6-5bcd6aee9282 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:14.522142 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-34a537f3-a166-4693-ade6-5bcd6aee9282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:14.636632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:14.932093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a2d4b-75d4-44d5-8d8f-8b0a4bba771f None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:14.933695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bd5a2d4b-75d4-44d5-8d8f-8b0a4bba771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:15.075827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a2d4b-75d4-44d5-8d8f-8b0a4bba771f None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:15.139445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:15.195933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55742672-0741-4e6a-94cc-63d0e83deaf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:15.196452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55742672-0741-4e6a-94cc-63d0e83deaf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:15.196736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55742672-0741-4e6a-94cc-63d0e83deaf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:15.197013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55742672-0741-4e6a-94cc-63d0e83deaf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:15.198759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-55742672-0741-4e6a-94cc-63d0e83deaf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:15.344513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55742672-0741-4e6a-94cc-63d0e83deaf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:15.346282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55742672-0741-4e6a-94cc-63d0e83deaf7 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:15.369026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 717/1449] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:17.665528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5715a45-ffeb-4cdc-adec-8d6e16f83122 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:17.666263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5715a45-ffeb-4cdc-adec-8d6e16f83122 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:17.666750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5715a45-ffeb-4cdc-adec-8d6e16f83122 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:17.668178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:17.675226 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd6041-7249-4d88-9514-a2cbb50f482d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:17.675773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd6041-7249-4d88-9514-a2cbb50f482d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:17.675871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd6041-7249-4d88-9514-a2cbb50f482d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:17.774925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e3dd6041-7249-4d88-9514-a2cbb50f482d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:17.776371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e3dd6041-7249-4d88-9514-a2cbb50f482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:17.803040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:17.912798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:18.249313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5715a45-ffeb-4cdc-adec-8d6e16f83122 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:18.252995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f5715a45-ffeb-4cdc-adec-8d6e16f83122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:18.466895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5715a45-ffeb-4cdc-adec-8d6e16f83122 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:18.501074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:18.601036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89717fb2-a2ea-4f4d-a222-431d739831cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:18.602092 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89717fb2-a2ea-4f4d-a222-431d739831cf service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:18.602642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89717fb2-a2ea-4f4d-a222-431d739831cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:18.603141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89717fb2-a2ea-4f4d-a222-431d739831cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:18.606398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-89717fb2-a2ea-4f4d-a222-431d739831cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:18.802149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89717fb2-a2ea-4f4d-a222-431d739831cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:18.804117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89717fb2-a2ea-4f4d-a222-431d739831cf service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:18.824875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 734/1452] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:20.984598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a48bb-a4ff-48df-be2f-db1c22ce1e91 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:20.985150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a48bb-a4ff-48df-be2f-db1c22ce1e91 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:20.985386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a48bb-a4ff-48df-be2f-db1c22ce1e91 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:20.986853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:20.993498 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2144965-8f0a-4ce5-95f6-a954ccb58c1a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:20.994076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2144965-8f0a-4ce5-95f6-a954ccb58c1a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:20.994076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2144965-8f0a-4ce5-95f6-a954ccb58c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:21.069948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:21.073700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c2144965-8f0a-4ce5-95f6-a954ccb58c1a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:21.075482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c2144965-8f0a-4ce5-95f6-a954ccb58c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:21.208893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:21.722279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a48bb-a4ff-48df-be2f-db1c22ce1e91 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:21.723849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2e2a48bb-a4ff-48df-be2f-db1c22ce1e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:21.852564 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a48bb-a4ff-48df-be2f-db1c22ce1e91 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:21.908703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:21.939895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3e5ae-99fc-4920-b4e7-a1f592ac323f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:21.940512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3e5ae-99fc-4920-b4e7-a1f592ac323f service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:21.940788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3e5ae-99fc-4920-b4e7-a1f592ac323f service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:21.941049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3e5ae-99fc-4920-b4e7-a1f592ac323f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:21.942777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e3b3e5ae-99fc-4920-b4e7-a1f592ac323f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:22.077903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3e5ae-99fc-4920-b4e7-a1f592ac323f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:22.079472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3e5ae-99fc-4920-b4e7-a1f592ac323f service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:22.100917 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 720/1455] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:24.207077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008a07-803e-4f2b-9252-f09941c8a2d0 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:24.207677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008a07-803e-4f2b-9252-f09941c8a2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:24.207677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008a07-803e-4f2b-9252-f09941c8a2d0 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:24.209025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:24.217128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb337b-9629-458c-b24a-71d2dbb778f7 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:24.217681 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb337b-9629-458c-b24a-71d2dbb778f7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:24.217681 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb337b-9629-458c-b24a-71d2dbb778f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:24.291567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-c5bb337b-9629-458c-b24a-71d2dbb778f7 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:24.292783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c5bb337b-9629-458c-b24a-71d2dbb778f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:24.323597 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:24.404740 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:24.707824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008a07-803e-4f2b-9252-f09941c8a2d0 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:24.709694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6d008a07-803e-4f2b-9252-f09941c8a2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:24.832981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008a07-803e-4f2b-9252-f09941c8a2d0 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:24.863543 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:24.914650 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c0a61-136b-47d4-bd4d-2ed827713067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:24.915270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0a61-136b-47d4-bd4d-2ed827713067 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:24.915548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0a61-136b-47d4-bd4d-2ed827713067 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:24.915817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0a61-136b-47d4-bd4d-2ed827713067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:24.917522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-158c0a61-136b-47d4-bd4d-2ed827713067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:25.038676 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c0a61-136b-47d4-bd4d-2ed827713067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:25.040045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c0a61-136b-47d4-bd4d-2ed827713067 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:25.059666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 737/1458] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:27.144365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721674e-a5af-45d2-8491-128f567668a9 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.144968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721674e-a5af-45d2-8491-128f567668a9 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.145068 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721674e-a5af-45d2-8491-128f567668a9 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.146435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:27.152365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa94633-bbe5-4a2b-b29d-5c756e2f6138 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.153078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa94633-bbe5-4a2b-b29d-5c756e2f6138 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.153078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa94633-bbe5-4a2b-b29d-5c756e2f6138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.230337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3aa94633-bbe5-4a2b-b29d-5c756e2f6138 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:27.231578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3aa94633-bbe5-4a2b-b29d-5c756e2f6138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:27.241301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:27.357346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:27.656177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721674e-a5af-45d2-8491-128f567668a9 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:27.658660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5721674e-a5af-45d2-8491-128f567668a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:27.801161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721674e-a5af-45d2-8491-128f567668a9 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:27.865299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:27.889007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d28298-656a-4e9b-b006-d9a7d48a5afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:27.889721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d28298-656a-4e9b-b006-d9a7d48a5afc service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.890250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d28298-656a-4e9b-b006-d9a7d48a5afc service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.890777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d28298-656a-4e9b-b006-d9a7d48a5afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.894993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b4d28298-656a-4e9b-b006-d9a7d48a5afc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:28.038375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d28298-656a-4e9b-b006-d9a7d48a5afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:28.039847 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d28298-656a-4e9b-b006-d9a7d48a5afc service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:28.061615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 723/1461] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:30.122257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3b1ef-8eac-4135-ba2e-880b2c5921c4 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:30.123109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3b1ef-8eac-4135-ba2e-880b2c5921c4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:30.123109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3b1ef-8eac-4135-ba2e-880b2c5921c4 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:30.124159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:30.130816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1458d-ad78-42b8-a169-ac0035c13cc6 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:30.131431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1458d-ad78-42b8-a169-ac0035c13cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:30.131431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1458d-ad78-42b8-a169-ac0035c13cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:30.217265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-12f1458d-ad78-42b8-a169-ac0035c13cc6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:30.218595 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-12f1458d-ad78-42b8-a169-ac0035c13cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:30.264965 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:30.336925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:30.626734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3b1ef-8eac-4135-ba2e-880b2c5921c4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:30.628312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-22b3b1ef-8eac-4135-ba2e-880b2c5921c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:30.748456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3b1ef-8eac-4135-ba2e-880b2c5921c4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:30.796098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:30.841514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae103f0-5ed2-4e9e-9866-1a66dcb52c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:30.842166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae103f0-5ed2-4e9e-9866-1a66dcb52c34 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:30.842482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae103f0-5ed2-4e9e-9866-1a66dcb52c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:30.842755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae103f0-5ed2-4e9e-9866-1a66dcb52c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:30.844774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cae103f0-5ed2-4e9e-9866-1a66dcb52c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:30.992114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae103f0-5ed2-4e9e-9866-1a66dcb52c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:30.995041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae103f0-5ed2-4e9e-9866-1a66dcb52c34 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:31.029459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 740/1464] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:33.040120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b55f0-f9a1-45de-b39c-d8c5747c3394 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:33.040691 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b55f0-f9a1-45de-b39c-d8c5747c3394 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:33.040691 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b55f0-f9a1-45de-b39c-d8c5747c3394 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:33.042163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:33.047746 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04881a99-a547-4c29-ae3a-13ea111af049 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:33.048255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04881a99-a547-4c29-ae3a-13ea111af049 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:33.048255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04881a99-a547-4c29-ae3a-13ea111af049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:33.126154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-04881a99-a547-4c29-ae3a-13ea111af049 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:33.127433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-04881a99-a547-4c29-ae3a-13ea111af049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:33.148048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:33.360330 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:33.647318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b55f0-f9a1-45de-b39c-d8c5747c3394 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:33.650142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d27b55f0-f9a1-45de-b39c-d8c5747c3394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:33.784075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b55f0-f9a1-45de-b39c-d8c5747c3394 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:33.854592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:33.861320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e807db1-473f-4e9d-913f-0c535ba2e779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:33.861923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e807db1-473f-4e9d-913f-0c535ba2e779 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:33.862200 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e807db1-473f-4e9d-913f-0c535ba2e779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:33.862568 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e807db1-473f-4e9d-913f-0c535ba2e779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:33.864274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9e807db1-473f-4e9d-913f-0c535ba2e779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:33.990165 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e807db1-473f-4e9d-913f-0c535ba2e779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:33.991597 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e807db1-473f-4e9d-913f-0c535ba2e779 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:34.012968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 726/1467] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:36.034008 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844cf25-28c8-4948-832a-fb135df6fb89 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:36.034646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844cf25-28c8-4948-832a-fb135df6fb89 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:36.034646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844cf25-28c8-4948-832a-fb135df6fb89 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:36.035976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:24:36.043081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21be3-87a2-4ad3-b9b2-fb1377c5908a None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:36.043648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21be3-87a2-4ad3-b9b2-fb1377c5908a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:36.043648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21be3-87a2-4ad3-b9b2-fb1377c5908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:36.117618 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-06f21be3-87a2-4ad3-b9b2-fb1377c5908a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:36.118858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-06f21be3-87a2-4ad3-b9b2-fb1377c5908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:36.174491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:36.232962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:36.524046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844cf25-28c8-4948-832a-fb135df6fb89 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:36.525650 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0844cf25-28c8-4948-832a-fb135df6fb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:36.644166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844cf25-28c8-4948-832a-fb135df6fb89 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:36.694868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:36.723211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32b837-3c79-4046-9c7b-a6807cfa8308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:36.725119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32b837-3c79-4046-9c7b-a6807cfa8308 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:36.725119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32b837-3c79-4046-9c7b-a6807cfa8308 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:36.725119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32b837-3c79-4046-9c7b-a6807cfa8308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:36.726277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bc32b837-3c79-4046-9c7b-a6807cfa8308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:36.846979 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32b837-3c79-4046-9c7b-a6807cfa8308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:36.848494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32b837-3c79-4046-9c7b-a6807cfa8308 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:36.869084 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 743/1470] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:24:46.230967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=22 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:46.866684 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=66 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:57.576749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741345-940e-46af-865a-91a888050167 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.577343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741345-940e-46af-865a-91a888050167 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.577343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741345-940e-46af-865a-91a888050167 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.578745 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 728/1471] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:57.584372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4cad4-a256-4032-a4fc-82f029002856 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.584844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4cad4-a256-4032-a4fc-82f029002856 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.584945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4cad4-a256-4032-a4fc-82f029002856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.653498 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d9e4cad4-a256-4032-a4fc-82f029002856 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:57.654788 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d9e4cad4-a256-4032-a4fc-82f029002856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:57.760130 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 744/1472] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:58.058683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f1eeb-a77b-4666-8683-3fc3dabc088a None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:58.058958 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f1eeb-a77b-4666-8683-3fc3dabc088a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:58.059234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f1eeb-a77b-4666-8683-3fc3dabc088a None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:58.060574 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 729/1473] 10.222.0.81 () {54 vars in 967 bytes} [Mon Aug 29 20:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:58.066395 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66f7c9-1633-4e8d-85fa-ce2f52cede6d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:58.066679 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66f7c9-1633-4e8d-85fa-ce2f52cede6d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:58.066951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66f7c9-1633-4e8d-85fa-ce2f52cede6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:58.148754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-db66f7c9-1633-4e8d-85fa-ce2f52cede6d None None] MFA Rules not processed for user `7c841f03880c4fb1b402bac6ecce25fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:58.150068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-db66f7c9-1633-4e8d-85fa-ce2f52cede6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:58.173970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:58.235876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 745/1474] 10.222.0.81 () {58 vars in 1064 bytes} [Mon Aug 29 20:24:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:58.243720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f1eeb-a77b-4666-8683-3fc3dabc088a None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:58.245249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-cc0f1eeb-a77b-4666-8683-3fc3dabc088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:58.352967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f1eeb-a77b-4666-8683-3fc3dabc088a None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:58.428514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a496-a605-46ad-902b-fa37458eedb6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c841f03880c4fb1b402bac6ecce25fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:58.429126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a496-a605-46ad-902b-fa37458eedb6 service glance] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:58.429402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a496-a605-46ad-902b-fa37458eedb6 service glance] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:58.429685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a496-a605-46ad-902b-fa37458eedb6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:58.431337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-1f37a496-a605-46ad-902b-fa37458eedb6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:58.487406 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:58.548453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a496-a605-46ad-902b-fa37458eedb6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:58.549901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a496-a605-46ad-902b-fa37458eedb6 service glance] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:58.570946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 730/1475] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:00.661403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbecdc-ff45-43c1-91c4-4d0b762bacfd None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:00.662032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbecdc-ff45-43c1-91c4-4d0b762bacfd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:00.662032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbecdc-ff45-43c1-91c4-4d0b762bacfd None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:00.663382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 746/1476] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:00.669639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcca083-c4f6-427e-9404-db752fdd1ffa None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:00.670198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcca083-c4f6-427e-9404-db752fdd1ffa None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:00.670198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcca083-c4f6-427e-9404-db752fdd1ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:00.743472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-fbcca083-c4f6-427e-9404-db752fdd1ffa None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:00.744853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-fbcca083-c4f6-427e-9404-db752fdd1ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:00.850771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 731/1477] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:01.127531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbecdc-ff45-43c1-91c4-4d0b762bacfd None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:01.129120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5afbecdc-ff45-43c1-91c4-4d0b762bacfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:01.257847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbecdc-ff45-43c1-91c4-4d0b762bacfd None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:01.311155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:01.359759 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d431e-d37a-492d-a40b-0952c15c79a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:01.360359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d431e-d37a-492d-a40b-0952c15c79a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:01.360632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d431e-d37a-492d-a40b-0952c15c79a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:01.360898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d431e-d37a-492d-a40b-0952c15c79a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:01.361527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d431e-d37a-492d-a40b-0952c15c79a6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:01.363274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-492d431e-d37a-492d-a40b-0952c15c79a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:25:01.363274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 20:25:01.363274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: Aug 29 20:25:01.364403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d431e-d37a-492d-a40b-0952c15c79a6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:01.383821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 747/1478] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Aug 29 20:25:01 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:25:03.346686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f4ca8-e377-4519-b2d3-eb7da4b7a68c None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:03.347256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f4ca8-e377-4519-b2d3-eb7da4b7a68c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:03.347256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f4ca8-e377-4519-b2d3-eb7da4b7a68c None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:03.348617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 732/1479] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:03.355589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de29e9-7fa8-4127-ba4e-eccf5f15e78e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:03.356136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de29e9-7fa8-4127-ba4e-eccf5f15e78e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:03.356136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de29e9-7fa8-4127-ba4e-eccf5f15e78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:03.434726 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-46de29e9-7fa8-4127-ba4e-eccf5f15e78e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:03.436593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-46de29e9-7fa8-4127-ba4e-eccf5f15e78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:03.559363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 748/1480] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:03.862508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f4ca8-e377-4519-b2d3-eb7da4b7a68c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:03.864117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-100f4ca8-e377-4519-b2d3-eb7da4b7a68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:03.874584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:04.039679 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f4ca8-e377-4519-b2d3-eb7da4b7a68c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:04.134316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:04.174147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00734e-fb4a-4a6e-90b5-b6b24b976c5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:04.174811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00734e-fb4a-4a6e-90b5-b6b24b976c5e service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:04.175093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00734e-fb4a-4a6e-90b5-b6b24b976c5e service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:04.175367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00734e-fb4a-4a6e-90b5-b6b24b976c5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:04.177023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8d00734e-fb4a-4a6e-90b5-b6b24b976c5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:04.278446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00734e-fb4a-4a6e-90b5-b6b24b976c5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:04.280103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00734e-fb4a-4a6e-90b5-b6b24b976c5e service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:04.301648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 733/1481] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:06.517556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993192-0e4e-4705-af93-e0a30ea523b0 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:06.518442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993192-0e4e-4705-af93-e0a30ea523b0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:06.518442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993192-0e4e-4705-af93-e0a30ea523b0 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:06.520076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 749/1482] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:06.525263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d4a49-489e-416e-81aa-cd28e2943a7a None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:06.525714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d4a49-489e-416e-81aa-cd28e2943a7a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:06.525905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d4a49-489e-416e-81aa-cd28e2943a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:06.595124 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-654d4a49-489e-416e-81aa-cd28e2943a7a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:06.596363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-654d4a49-489e-416e-81aa-cd28e2943a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:06.646515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:06.703685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 734/1483] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:07.003037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993192-0e4e-4705-af93-e0a30ea523b0 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:07.004584 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-10993192-0e4e-4705-af93-e0a30ea523b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:07.029014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:07.120117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993192-0e4e-4705-af93-e0a30ea523b0 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:07.200019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721d516-7f62-4f1c-a6c5-80878b546e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:07.200634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721d516-7f62-4f1c-a6c5-80878b546e8f service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:07.200913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721d516-7f62-4f1c-a6c5-80878b546e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:07.201187 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721d516-7f62-4f1c-a6c5-80878b546e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:07.202860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e721d516-7f62-4f1c-a6c5-80878b546e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:07.281443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:07.318671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721d516-7f62-4f1c-a6c5-80878b546e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:07.320087 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721d516-7f62-4f1c-a6c5-80878b546e8f service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:07.339097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 750/1484] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:09.381030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262cd7d-2234-4b19-b0e4-060c5b5d0c88 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:09.381618 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262cd7d-2234-4b19-b0e4-060c5b5d0c88 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:09.381618 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262cd7d-2234-4b19-b0e4-060c5b5d0c88 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:09.382955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 735/1485] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:09.388493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7070a7e-ccd6-4890-b4b8-898f53476b2a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:09.389175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7070a7e-ccd6-4890-b4b8-898f53476b2a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:09.389287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7070a7e-ccd6-4890-b4b8-898f53476b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:09.460810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d7070a7e-ccd6-4890-b4b8-898f53476b2a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:09.462118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d7070a7e-ccd6-4890-b4b8-898f53476b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:09.580060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 751/1486] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:09.873680 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262cd7d-2234-4b19-b0e4-060c5b5d0c88 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:09.875336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f262cd7d-2234-4b19-b0e4-060c5b5d0c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:09.986065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262cd7d-2234-4b19-b0e4-060c5b5d0c88 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:10.060735 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:10.062521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb48256-a8f6-43cb-b7f0-6ca32cc327fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:10.063133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48256-a8f6-43cb-b7f0-6ca32cc327fa service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:10.063414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48256-a8f6-43cb-b7f0-6ca32cc327fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:10.063688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48256-a8f6-43cb-b7f0-6ca32cc327fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:10.065349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2fb48256-a8f6-43cb-b7f0-6ca32cc327fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:10.184136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb48256-a8f6-43cb-b7f0-6ca32cc327fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:10.186276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb48256-a8f6-43cb-b7f0-6ca32cc327fa service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:10.205622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 736/1487] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:12.331016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6f4b-3132-4d43-a4a4-ae43f7578f35 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:12.331634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6f4b-3132-4d43-a4a4-ae43f7578f35 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:12.331634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6f4b-3132-4d43-a4a4-ae43f7578f35 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:12.332983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 752/1488] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:12.339262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3c043-75cd-469a-9756-212ab6f12efe None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:12.339798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3c043-75cd-469a-9756-212ab6f12efe None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:12.339798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3c043-75cd-469a-9756-212ab6f12efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:12.411469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-fbe3c043-75cd-469a-9756-212ab6f12efe None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:12.412768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-fbe3c043-75cd-469a-9756-212ab6f12efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:12.477845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:12.527121 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 737/1489] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:12.837223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a6f4b-3132-4d43-a4a4-ae43f7578f35 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:12.838827 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-480a6f4b-3132-4d43-a4a4-ae43f7578f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:12.881145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:12.985627 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a6f4b-3132-4d43-a4a4-ae43f7578f35 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:13.087449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fe930-4c6f-47e3-b8fd-15fd1dbbc4e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:13.087950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe930-4c6f-47e3-b8fd-15fd1dbbc4e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:13.088227 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe930-4c6f-47e3-b8fd-15fd1dbbc4e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:13.088498 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe930-4c6f-47e3-b8fd-15fd1dbbc4e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:13.090141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-660fe930-4c6f-47e3-b8fd-15fd1dbbc4e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:13.186242 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:13.230411 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fe930-4c6f-47e3-b8fd-15fd1dbbc4e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:13.235390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fe930-4c6f-47e3-b8fd-15fd1dbbc4e3 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:13.261069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 753/1490] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:15.739803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd77b41-38f5-43e6-9a89-2b3ddf0c649c None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:15.740379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd77b41-38f5-43e6-9a89-2b3ddf0c649c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:15.740379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd77b41-38f5-43e6-9a89-2b3ddf0c649c None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:15.741766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 738/1491] 10.222.0.81 () {54 vars in 927 bytes} [Mon Aug 29 20:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:15.747461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3d51c-ef36-4e7c-876a-8d0381ea9718 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:15.748615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3d51c-ef36-4e7c-876a-8d0381ea9718 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:15.748615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3d51c-ef36-4e7c-876a-8d0381ea9718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:15.824077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-cad3d51c-ef36-4e7c-876a-8d0381ea9718 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:15.825306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cad3d51c-ef36-4e7c-876a-8d0381ea9718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:15.929112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 754/1492] 10.222.0.81 () {58 vars in 1024 bytes} [Mon Aug 29 20:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:25:16.237891 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd77b41-38f5-43e6-9a89-2b3ddf0c649c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:16.239505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7bd77b41-38f5-43e6-9a89-2b3ddf0c649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:16.354079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd77b41-38f5-43e6-9a89-2b3ddf0c649c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:16.431231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf2789-ff45-4668-a028-4d8acfc886b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:16.431838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf2789-ff45-4668-a028-4d8acfc886b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:16.432120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf2789-ff45-4668-a028-4d8acfc886b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:16.432389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf2789-ff45-4668-a028-4d8acfc886b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:16.433998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-10bf2789-ff45-4668-a028-4d8acfc886b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:16.444466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:16.550009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf2789-ff45-4668-a028-4d8acfc886b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:16.551527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf2789-ff45-4668-a028-4d8acfc886b3 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:16.570547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 739/1493] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:25:25.927266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=82 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:26.568182 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=50 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:44.028889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663c55-aaa1-40a8-87ad-863ffd98c258 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:44.029507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663c55-aaa1-40a8-87ad-863ffd98c258 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:44.029507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663c55-aaa1-40a8-87ad-863ffd98c258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:44.132602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-66663c55-aaa1-40a8-87ad-863ffd98c258 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:44.134013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-66663c55-aaa1-40a8-87ad-863ffd98c258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:44.266706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 755/1494] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:44.275497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae75d-d03f-4dae-a240-bda9eb492874 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:44.276947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae75d-d03f-4dae-a240-bda9eb492874 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:44.276947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae75d-d03f-4dae-a240-bda9eb492874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:44.298627 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-160ae75d-d03f-4dae-a240-bda9eb492874 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:44.299783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-160ae75d-d03f-4dae-a240-bda9eb492874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:44.311440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 740/1495] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:44.316934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66663c55-aaa1-40a8-87ad-863ffd98c258 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:44.334957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66663c55-aaa1-40a8-87ad-863ffd98c258 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:44.341039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434b0f4-9455-4b1d-9b8c-1f76639f6ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:44.341669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434b0f4-9455-4b1d-9b8c-1f76639f6ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:44.341946 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434b0f4-9455-4b1d-9b8c-1f76639f6ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:44.342212 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434b0f4-9455-4b1d-9b8c-1f76639f6ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:44.342907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434b0f4-9455-4b1d-9b8c-1f76639f6ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:26:44.343245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434b0f4-9455-4b1d-9b8c-1f76639f6ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:44.344283 dv-cinder-852009-5-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-d434b0f4-9455-4b1d-9b8c-1f76639f6ba7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:26:44.344283 dv-cinder-852009-5-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 20:26:44.344283 dv-cinder-852009-5-smb devstack@keystone.service[81954]: Aug 29 20:26:44.345181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434b0f4-9455-4b1d-9b8c-1f76639f6ba7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:44.359951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 756/1496] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:26:44.368166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae75d-d03f-4dae-a240-bda9eb492874 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:44.378886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae75d-d03f-4dae-a240-bda9eb492874 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:44.383495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59d2d1-a6f5-47e2-92b4-9c737eff9232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:44.384108 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59d2d1-a6f5-47e2-92b4-9c737eff9232 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:44.384384 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59d2d1-a6f5-47e2-92b4-9c737eff9232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:44.384811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59d2d1-a6f5-47e2-92b4-9c737eff9232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:44.385917 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59d2d1-a6f5-47e2-92b4-9c737eff9232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:44.387808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: WARNING py.warnings [None req-3a59d2d1-a6f5-47e2-92b4-9c737eff9232 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:26:44.387808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: warnings.warn(msg) Aug 29 20:26:44.387808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: Aug 29 20:26:44.389012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59d2d1-a6f5-47e2-92b4-9c737eff9232 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:44.510036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 741/1497] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:26:44 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:26:44.515196 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434b0f4-9455-4b1d-9b8c-1f76639f6ba7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:44.526443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434b0f4-9455-4b1d-9b8c-1f76639f6ba7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:44.583621 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:44.591205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c792d5-5c97-43be-9bde-1b4cbbb590fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:44.596342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c792d5-5c97-43be-9bde-1b4cbbb590fb admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:44.596342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c792d5-5c97-43be-9bde-1b4cbbb590fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:44.596342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c792d5-5c97-43be-9bde-1b4cbbb590fb admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:44.596342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c792d5-5c97-43be-9bde-1b4cbbb590fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:44.596342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-c0c792d5-5c97-43be-9bde-1b4cbbb590fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:26:44.596342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 20:26:44.596342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: Aug 29 20:26:44.596909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c792d5-5c97-43be-9bde-1b4cbbb590fb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:44.674206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 757/1498] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:26:44 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:26:44.678443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59d2d1-a6f5-47e2-92b4-9c737eff9232 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:44.689208 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59d2d1-a6f5-47e2-92b4-9c737eff9232 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:44.693823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f971099-1ab0-4f9a-a661-d3fab7618cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:44.705462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f971099-1ab0-4f9a-a661-d3fab7618cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:44.705462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f971099-1ab0-4f9a-a661-d3fab7618cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:44.705462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f971099-1ab0-4f9a-a661-d3fab7618cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:44.705462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f971099-1ab0-4f9a-a661-d3fab7618cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:44.705462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: WARNING py.warnings [None req-8f971099-1ab0-4f9a-a661-d3fab7618cc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:26:44.705462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: warnings.warn(msg) Aug 29 20:26:44.705462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: Aug 29 20:26:44.706450 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f971099-1ab0-4f9a-a661-d3fab7618cc5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:44.712514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 742/1499] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:26:44.717369 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c792d5-5c97-43be-9bde-1b4cbbb590fb admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:44.728170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c792d5-5c97-43be-9bde-1b4cbbb590fb admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:44.734050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1257fdc-8252-41b4-807b-49002e25741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:44.734753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257fdc-8252-41b4-807b-49002e25741a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:44.735036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257fdc-8252-41b4-807b-49002e25741a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:44.735309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257fdc-8252-41b4-807b-49002e25741a admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:44.735965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1257fdc-8252-41b4-807b-49002e25741a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:44.737007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-e1257fdc-8252-41b4-807b-49002e25741a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:26:44.737007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 20:26:44.737007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: Aug 29 20:26:44.737906 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1257fdc-8252-41b4-807b-49002e25741a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:44.753179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 758/1500] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:26:44.758158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f971099-1ab0-4f9a-a661-d3fab7618cc5 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:44.769315 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f971099-1ab0-4f9a-a661-d3fab7618cc5 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:44.775038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fccf1-3830-4f95-bc97-2fb6f7626c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:44.777003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fccf1-3830-4f95-bc97-2fb6f7626c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:44.777285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fccf1-3830-4f95-bc97-2fb6f7626c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:44.777617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fccf1-3830-4f95-bc97-2fb6f7626c4f admin admin] PATH_INFO: `/v3/projects/7ebea834746b40d3b29a079560dd7a6b/users/fae83d11f0b94721a792e693093b9fd8/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:44.799019 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fccf1-3830-4f95-bc97-2fb6f7626c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebea834746b40d3b29a079560dd7a6b, user_id=fae83d11f0b94721a792e693093b9fd8, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:44.800683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: WARNING py.warnings [None req-1f6fccf1-3830-4f95-bc97-2fb6f7626c4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:26:44.800683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: warnings.warn(msg) Aug 29 20:26:44.800683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: Aug 29 20:26:44.804828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fccf1-3830-4f95-bc97-2fb6f7626c4f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:44.885534 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 743/1501] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:26:44 2022] PUT /identity/v3/projects/7ebea834746b40d3b29a079560dd7a6b/users/fae83d11f0b94721a792e693093b9fd8/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:26:44.898381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a61fc-bdf2-4762-bc29-2af8ee7a5b5b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:44.898670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a61fc-bdf2-4762-bc29-2af8ee7a5b5b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:44.898945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a61fc-bdf2-4762-bc29-2af8ee7a5b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:44.929715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-361a61fc-bdf2-4762-bc29-2af8ee7a5b5b None None] MFA Rules not processed for user `fae83d11f0b94721a792e693093b9fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:44.931113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-361a61fc-bdf2-4762-bc29-2af8ee7a5b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:45.000577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 759/1502] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:26:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:45.019309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00774c17-3d84-45b9-968c-de9ec5256d78 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:45.019626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00774c17-3d84-45b9-968c-de9ec5256d78 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:45.019908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00774c17-3d84-45b9-968c-de9ec5256d78 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:45.021302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 744/1503] 10.222.0.81 () {54 vars in 964 bytes} [Mon Aug 29 20:26:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:26:45.027282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77436c64-872b-4a88-9b37-40f547c6aec4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:45.027574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77436c64-872b-4a88-9b37-40f547c6aec4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:45.027848 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77436c64-872b-4a88-9b37-40f547c6aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:45.090830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-77436c64-872b-4a88-9b37-40f547c6aec4 None None] MFA Rules not processed for user `e128651197d840bd87220d8f5b246688`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:45.094424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-77436c64-872b-4a88-9b37-40f547c6aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:45.175030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 760/1504] 10.222.0.81 () {58 vars in 1061 bytes} [Mon Aug 29 20:26:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:45.183020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00774c17-3d84-45b9-968c-de9ec5256d78 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:45.194194 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00774c17-3d84-45b9-968c-de9ec5256d78 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:45.198406 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5543bf-b290-4bd9-acfd-8b0c1fdfc647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:45.199013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5543bf-b290-4bd9-acfd-8b0c1fdfc647 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:45.199295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5543bf-b290-4bd9-acfd-8b0c1fdfc647 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:45.199563 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5543bf-b290-4bd9-acfd-8b0c1fdfc647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:45.215351 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5543bf-b290-4bd9-acfd-8b0c1fdfc647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:45.216859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5543bf-b290-4bd9-acfd-8b0c1fdfc647 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:45.226285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 745/1505] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:26:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:26:45.273989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a528b5-4ea5-400c-9816-0e4bde8650f3 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:45.274418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a528b5-4ea5-400c-9816-0e4bde8650f3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:45.274709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a528b5-4ea5-400c-9816-0e4bde8650f3 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:45.276986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 761/1506] 10.222.0.81 () {52 vars in 830 bytes} [Mon Aug 29 20:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:26:45.281098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5543bf-b290-4bd9-acfd-8b0c1fdfc647 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:45.357211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5543bf-b290-4bd9-acfd-8b0c1fdfc647 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:45.363470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:45.364122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:45.364404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:45.364677 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] PATH_INFO: `/v3/users/fae83d11f0b94721a792e693093b9fd8` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:45.365862 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae83d11f0b94721a792e693093b9fd8)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:45.366933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: WARNING py.warnings [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:26:45.366933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: warnings.warn(msg) Aug 29 20:26:45.366933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: Aug 29 20:26:45.368162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:45.696654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae83d11f0b94721a792e693093b9fd8'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:45.717453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae83d11f0b94721a792e693093b9fd8'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:45.718244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae83d11f0b94721a792e693093b9fd8'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:45.769928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae83d11f0b94721a792e693093b9fd8'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:45.793506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:45.801353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae83d11f0b94721a792e693093b9fd8'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:45.809449 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 746/1507] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:26:45 2022] DELETE /identity/v3/users/fae83d11f0b94721a792e693093b9fd8 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:26:45.814189 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341fd31-7767-4675-acf9-9fd3fa376f89 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:45.814510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341fd31-7767-4675-acf9-9fd3fa376f89 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:45.814789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341fd31-7767-4675-acf9-9fd3fa376f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:45.835606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3341fd31-7767-4675-acf9-9fd3fa376f89 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:45.836973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3341fd31-7767-4675-acf9-9fd3fa376f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:45.851456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:45.929602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 762/1508] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:45.941919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:45.943512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:46.033700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15027ff-b75d-4ae6-b54d-41d2763fef18 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:46.039460 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66161e1e-2abf-4f32-a1ff-57748e1568bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:46.040454 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66161e1e-2abf-4f32-a1ff-57748e1568bf service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:46.040983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66161e1e-2abf-4f32-a1ff-57748e1568bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:46.041459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66161e1e-2abf-4f32-a1ff-57748e1568bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:46.059049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66161e1e-2abf-4f32-a1ff-57748e1568bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:46.061831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66161e1e-2abf-4f32-a1ff-57748e1568bf service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:46.081473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 747/1509] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:46.617715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341fd31-7767-4675-acf9-9fd3fa376f89 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:46.620117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3341fd31-7767-4675-acf9-9fd3fa376f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:46.634983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341fd31-7767-4675-acf9-9fd3fa376f89 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:46.643036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:46.643689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:46.644777 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:46.644777 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] PATH_INFO: `/v3/projects/7ebea834746b40d3b29a079560dd7a6b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:46.645870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebea834746b40d3b29a079560dd7a6b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:46.647024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:26:46.647024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 20:26:46.647024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: Aug 29 20:26:46.648279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:46.801148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebea834746b40d3b29a079560dd7a6b', 'request_id': 'req-404196cd-c762-4ab8-8c36-56e7f339606a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:46.815347 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebea834746b40d3b29a079560dd7a6b', 'request_id': 'req-404196cd-c762-4ab8-8c36-56e7f339606a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:46.907046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebea834746b40d3b29a079560dd7a6b', 'request_id': 'req-404196cd-c762-4ab8-8c36-56e7f339606a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:46.919986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] The token cache is being invalidate because project 7ebea834746b40d3b29a079560dd7a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:26:46.920268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:46.921293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-404196cd-c762-4ab8-8c36-56e7f339606a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:46.923582 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 763/1510] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:26:46 2022] DELETE /identity/v3/projects/7ebea834746b40d3b29a079560dd7a6b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:26:56.072106 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:56.916791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:38.580643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaa7e7-a91f-471f-b34f-7c4ce8d0675e None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:38.581263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaa7e7-a91f-471f-b34f-7c4ce8d0675e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:38.581263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaa7e7-a91f-471f-b34f-7c4ce8d0675e None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:38.582624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:28:38.588724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb906-20f2-4ada-930e-f87449b421d1 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:38.589589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb906-20f2-4ada-930e-f87449b421d1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:38.589589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb906-20f2-4ada-930e-f87449b421d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:38.610774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-69feb906-20f2-4ada-930e-f87449b421d1 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:28:38.612022 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-69feb906-20f2-4ada-930e-f87449b421d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:28:38.680585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:28:38.838346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaa7e7-a91f-471f-b34f-7c4ce8d0675e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:28:38.847479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ceeaa7e7-a91f-471f-b34f-7c4ce8d0675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:28:38.962050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaa7e7-a91f-471f-b34f-7c4ce8d0675e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:28:38.968147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996e762-7273-4b9f-883b-acb4ab9e545b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:28:38.968808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996e762-7273-4b9f-883b-acb4ab9e545b service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:38.969088 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996e762-7273-4b9f-883b-acb4ab9e545b service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:38.969360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996e762-7273-4b9f-883b-acb4ab9e545b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:38.979783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996e762-7273-4b9f-883b-acb4ab9e545b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:28:38.981508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996e762-7273-4b9f-883b-acb4ab9e545b service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:28:38.992901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 749/1513] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:28:39.944658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcdd65-bc5f-4171-ad7e-0c26295d47f0 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:39.945205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcdd65-bc5f-4171-ad7e-0c26295d47f0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:39.945205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcdd65-bc5f-4171-ad7e-0c26295d47f0 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:39.946703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:28:39.952575 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f08b61-2a47-4b69-8562-96b411bf1f88 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:39.953172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f08b61-2a47-4b69-8562-96b411bf1f88 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:39.953172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f08b61-2a47-4b69-8562-96b411bf1f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:39.974601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-97f08b61-2a47-4b69-8562-96b411bf1f88 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:28:39.975828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-97f08b61-2a47-4b69-8562-96b411bf1f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:28:39.984473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:28:40.149579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcdd65-bc5f-4171-ad7e-0c26295d47f0 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:28:40.166143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcdd65-bc5f-4171-ad7e-0c26295d47f0 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:28:40.171738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259137ed-eef7-468a-9e9c-bd0f3de5a7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:28:40.172348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259137ed-eef7-468a-9e9c-bd0f3de5a7ab service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:40.172626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259137ed-eef7-468a-9e9c-bd0f3de5a7ab service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:40.172897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259137ed-eef7-468a-9e9c-bd0f3de5a7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:40.183365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259137ed-eef7-468a-9e9c-bd0f3de5a7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:28:40.184984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259137ed-eef7-468a-9e9c-bd0f3de5a7ab service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:28:40.196738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 766/1516] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:28:42.896756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c6f14-9577-4f64-a3a8-9f28b2a7370b None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:42.897635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c6f14-9577-4f64-a3a8-9f28b2a7370b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:42.897635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c6f14-9577-4f64-a3a8-9f28b2a7370b None None] PATH_INFO: `/v3` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:42.898652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 751/1517] 10.222.0.117 () {54 vars in 926 bytes} [Mon Aug 29 20:28:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:28:42.908656 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f954e4b-0f0a-4e1b-9ec0-3ad420fd07e5 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:42.909496 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f954e4b-0f0a-4e1b-9ec0-3ad420fd07e5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:42.909692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f954e4b-0f0a-4e1b-9ec0-3ad420fd07e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:42.971581 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9f954e4b-0f0a-4e1b-9ec0-3ad420fd07e5 None None] MFA Rules not processed for user `884b748550d546b7a0bb2bc5b0c614d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:28:42.972902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9f954e4b-0f0a-4e1b-9ec0-3ad420fd07e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:28:43.063329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 767/1518] 10.222.0.117 () {58 vars in 1016 bytes} [Mon Aug 29 20:28:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:28:49.968871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=49 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:51.506407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988c947-d068-426d-ad0a-3c6f3adeb07e None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:51.507101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988c947-d068-426d-ad0a-3c6f3adeb07e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:51.507101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988c947-d068-426d-ad0a-3c6f3adeb07e None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:51.508295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 752/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:28:51.513994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1095cc-e4ad-4592-ad5a-52468a87f254 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:51.514545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1095cc-e4ad-4592-ad5a-52468a87f254 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:51.514641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1095cc-e4ad-4592-ad5a-52468a87f254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:51.539367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6a1095cc-e4ad-4592-ad5a-52468a87f254 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:28:51.540759 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6a1095cc-e4ad-4592-ad5a-52468a87f254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:28:51.549736 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 768/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:28:51.711679 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988c947-d068-426d-ad0a-3c6f3adeb07e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:28:51.727880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988c947-d068-426d-ad0a-3c6f3adeb07e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:28:51.733930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e348d48-6cfe-463f-856b-8d16203d0bdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:28:51.734899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e348d48-6cfe-463f-856b-8d16203d0bdd service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:51.735026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e348d48-6cfe-463f-856b-8d16203d0bdd service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:51.735237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e348d48-6cfe-463f-856b-8d16203d0bdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:51.747495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e348d48-6cfe-463f-856b-8d16203d0bdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:28:51.747495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e348d48-6cfe-463f-856b-8d16203d0bdd service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:28:51.758532 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 753/1521] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:28:52.653426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45075fe7-16aa-4563-b2ca-4303959b22f2 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:52.654037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45075fe7-16aa-4563-b2ca-4303959b22f2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:52.654037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45075fe7-16aa-4563-b2ca-4303959b22f2 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:52.655655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:28:52.663995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2ad22-d837-4c8b-b06b-2735a1b319a3 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:52.664593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2ad22-d837-4c8b-b06b-2735a1b319a3 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:52.664975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2ad22-d837-4c8b-b06b-2735a1b319a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:52.686817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e7a2ad22-d837-4c8b-b06b-2735a1b319a3 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:28:52.688080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e7a2ad22-d837-4c8b-b06b-2735a1b319a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:28:52.696503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:28:52.864219 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45075fe7-16aa-4563-b2ca-4303959b22f2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:28:52.885212 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45075fe7-16aa-4563-b2ca-4303959b22f2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:28:52.891453 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604203d0-6eba-48ba-8263-ce2a62ce1eb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:28:52.892076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604203d0-6eba-48ba-8263-ce2a62ce1eb4 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:52.892349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604203d0-6eba-48ba-8263-ce2a62ce1eb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:52.892613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604203d0-6eba-48ba-8263-ce2a62ce1eb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:52.903259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604203d0-6eba-48ba-8263-ce2a62ce1eb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:28:52.905351 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604203d0-6eba-48ba-8263-ce2a62ce1eb4 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:28:52.916648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 770/1524] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:28:55.367080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2eef6-183a-4442-9ac5-355526f1ade3 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:55.367614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2eef6-183a-4442-9ac5-355526f1ade3 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:55.367614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2eef6-183a-4442-9ac5-355526f1ade3 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:55.369008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 755/1525] 10.222.0.81 () {54 vars in 961 bytes} [Mon Aug 29 20:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:28:55.374104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a762a-99bc-44dc-b1a9-b0cd4e6ad8b6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:55.374751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a762a-99bc-44dc-b1a9-b0cd4e6ad8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:55.374751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a762a-99bc-44dc-b1a9-b0cd4e6ad8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:55.395696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1a0a762a-99bc-44dc-b1a9-b0cd4e6ad8b6 None None] MFA Rules not processed for user `884b748550d546b7a0bb2bc5b0c614d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:28:55.397041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1a0a762a-99bc-44dc-b1a9-b0cd4e6ad8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:28:55.405838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 771/1526] 10.222.0.81 () {58 vars in 1058 bytes} [Mon Aug 29 20:28:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:28:55.413989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2eef6-183a-4442-9ac5-355526f1ade3 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:28:55.429880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2eef6-183a-4442-9ac5-355526f1ade3 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:28:55.435174 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a17f00-36e1-4da0-b9b8-146f79777354 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:28:55.435799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a17f00-36e1-4da0-b9b8-146f79777354 service placement] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:55.436084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a17f00-36e1-4da0-b9b8-146f79777354 service placement] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:55.436362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a17f00-36e1-4da0-b9b8-146f79777354 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:55.445921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a17f00-36e1-4da0-b9b8-146f79777354 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:28:55.447645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a17f00-36e1-4da0-b9b8-146f79777354 service placement] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:28:55.459635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 756/1527] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:28:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:04.265687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbcbdb-6bbd-47c1-ac93-1914e8e01a4f None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:04.266359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbcbdb-6bbd-47c1-ac93-1914e8e01a4f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:04.266359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbcbdb-6bbd-47c1-ac93-1914e8e01a4f None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:04.267629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:04.273335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e5b4b-0e42-4943-9a4d-3fb761bd91a3 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:04.273920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e5b4b-0e42-4943-9a4d-3fb761bd91a3 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:04.273920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e5b4b-0e42-4943-9a4d-3fb761bd91a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:04.297207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-991e5b4b-0e42-4943-9a4d-3fb761bd91a3 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:04.298504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-991e5b4b-0e42-4943-9a4d-3fb761bd91a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:04.308154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:04.468440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbcbdb-6bbd-47c1-ac93-1914e8e01a4f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:04.493400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbcbdb-6bbd-47c1-ac93-1914e8e01a4f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:04.502859 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3eb1c-dab6-4279-a40d-a68811f7b6fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:04.504468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3eb1c-dab6-4279-a40d-a68811f7b6fd service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:04.504971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3eb1c-dab6-4279-a40d-a68811f7b6fd service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:04.505476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3eb1c-dab6-4279-a40d-a68811f7b6fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:04.518093 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3eb1c-dab6-4279-a40d-a68811f7b6fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:04.519596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3eb1c-dab6-4279-a40d-a68811f7b6fd service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:04.530250 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 773/1530] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:05.391301 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964798e7-447f-4cf4-9838-af2f5e070e6e None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.391911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964798e7-447f-4cf4-9838-af2f5e070e6e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.392155 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964798e7-447f-4cf4-9838-af2f5e070e6e None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.395464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:29:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:05.400649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755606f-ff99-48e9-bba4-41e5e5a9b3ae None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.401155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755606f-ff99-48e9-bba4-41e5e5a9b3ae None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.401257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755606f-ff99-48e9-bba4-41e5e5a9b3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.421815 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5755606f-ff99-48e9-bba4-41e5e5a9b3ae None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:05.423113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5755606f-ff99-48e9-bba4-41e5e5a9b3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:05.431565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:05.593686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964798e7-447f-4cf4-9838-af2f5e070e6e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:05.608482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964798e7-447f-4cf4-9838-af2f5e070e6e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:05.613950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aceb19-8d6d-4ca9-826d-02edddabd1d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:05.614579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aceb19-8d6d-4ca9-826d-02edddabd1d0 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.614858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aceb19-8d6d-4ca9-826d-02edddabd1d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.615127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aceb19-8d6d-4ca9-826d-02edddabd1d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.623715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aceb19-8d6d-4ca9-826d-02edddabd1d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:05.625297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aceb19-8d6d-4ca9-826d-02edddabd1d0 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:05.635692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 759/1533] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:09.819175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971c07e-0993-47f4-a9b1-6f8c52108302 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:09.819753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971c07e-0993-47f4-a9b1-6f8c52108302 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:09.819753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971c07e-0993-47f4-a9b1-6f8c52108302 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:09.821065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:29:09.826774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1fd3f-b4da-4661-84b0-e043b80807c7 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:09.827284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1fd3f-b4da-4661-84b0-e043b80807c7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:09.827405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1fd3f-b4da-4661-84b0-e043b80807c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:09.848912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-add1fd3f-b4da-4661-84b0-e043b80807c7 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:09.850182 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-add1fd3f-b4da-4661-84b0-e043b80807c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:09.858082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:10.147239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971c07e-0993-47f4-a9b1-6f8c52108302 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:10.148985 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f971c07e-0993-47f4-a9b1-6f8c52108302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:10.154956 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:10.207037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971c07e-0993-47f4-a9b1-6f8c52108302 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:10.210697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7ccc6-de0f-4258-8455-ca73975c1ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:10.211310 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7ccc6-de0f-4258-8455-ca73975c1ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:10.211617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7ccc6-de0f-4258-8455-ca73975c1ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:10.211890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7ccc6-de0f-4258-8455-ca73975c1ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:10.222130 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7ccc6-de0f-4258-8455-ca73975c1ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:10.225133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7ccc6-de0f-4258-8455-ca73975c1ef2 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:10.233949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 776/1536] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:12.276392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a1d35-3bf7-4da3-aaa8-5d83194ef721 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:12.276935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a1d35-3bf7-4da3-aaa8-5d83194ef721 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:12.276935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a1d35-3bf7-4da3-aaa8-5d83194ef721 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:12.278295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:12.283488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b95d4d-3d02-458b-979a-6d7eb549b89e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:12.284042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b95d4d-3d02-458b-979a-6d7eb549b89e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:12.284900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b95d4d-3d02-458b-979a-6d7eb549b89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:12.304904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-66b95d4d-3d02-458b-979a-6d7eb549b89e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:12.306127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-66b95d4d-3d02-458b-979a-6d7eb549b89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:12.314077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:12.607649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a1d35-3bf7-4da3-aaa8-5d83194ef721 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:12.619177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a1d35-3bf7-4da3-aaa8-5d83194ef721 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:12.622639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c4268-bedf-4346-993d-fbcfd8975bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:12.623229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c4268-bedf-4346-993d-fbcfd8975bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:12.623504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c4268-bedf-4346-993d-fbcfd8975bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:12.623766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c4268-bedf-4346-993d-fbcfd8975bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:12.632776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c4268-bedf-4346-993d-fbcfd8975bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:12.634239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c4268-bedf-4346-993d-fbcfd8975bb3 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:12.643938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 762/1539] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:16.323609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0a45-e513-4db5-8cf1-ff09b84773d9 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:16.324186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0a45-e513-4db5-8cf1-ff09b84773d9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:16.324186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0a45-e513-4db5-8cf1-ff09b84773d9 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:16.325698 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 778/1540] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:16.332116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de8d4d-ab75-4bb5-9312-5fccdd33fd21 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:16.332701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de8d4d-ab75-4bb5-9312-5fccdd33fd21 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:16.332701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de8d4d-ab75-4bb5-9312-5fccdd33fd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:16.354199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d7de8d4d-ab75-4bb5-9312-5fccdd33fd21 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:16.355465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d7de8d4d-ab75-4bb5-9312-5fccdd33fd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:16.364485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 763/1541] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:16.957597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec0a45-e513-4db5-8cf1-ff09b84773d9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:16.959422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a8ec0a45-e513-4db5-8cf1-ff09b84773d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:17.028779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec0a45-e513-4db5-8cf1-ff09b84773d9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:17.032408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9307718-9aa9-4664-a444-b46ae54f6bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:17.037280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9307718-9aa9-4664-a444-b46ae54f6bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:17.037280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9307718-9aa9-4664-a444-b46ae54f6bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:17.037280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9307718-9aa9-4664-a444-b46ae54f6bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:17.043372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9307718-9aa9-4664-a444-b46ae54f6bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:17.044862 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9307718-9aa9-4664-a444-b46ae54f6bd1 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:17.055213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 779/1542] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:19.047162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e708c47-daa2-4d09-8d22-d92af3c1a157 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:19.047742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e708c47-daa2-4d09-8d22-d92af3c1a157 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:19.047985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e708c47-daa2-4d09-8d22-d92af3c1a157 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:19.051132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 764/1543] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:29:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:19.057192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45033f-53d8-44ed-b81a-572d105b2eb3 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:19.057799 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45033f-53d8-44ed-b81a-572d105b2eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:19.057799 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45033f-53d8-44ed-b81a-572d105b2eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:19.084167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-dd45033f-53d8-44ed-b81a-572d105b2eb3 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:19.085393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dd45033f-53d8-44ed-b81a-572d105b2eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:19.093314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 780/1544] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:19.668357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e708c47-daa2-4d09-8d22-d92af3c1a157 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:19.670038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8e708c47-daa2-4d09-8d22-d92af3c1a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:19.683463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e708c47-daa2-4d09-8d22-d92af3c1a157 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:19.686993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810056d-6136-4c1e-8e09-54ded04b90dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:19.687673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810056d-6136-4c1e-8e09-54ded04b90dc service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:19.687951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810056d-6136-4c1e-8e09-54ded04b90dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:19.688220 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810056d-6136-4c1e-8e09-54ded04b90dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:19.699313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810056d-6136-4c1e-8e09-54ded04b90dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:19.700777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810056d-6136-4c1e-8e09-54ded04b90dc service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:19.711042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 765/1545] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:29.077823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=57 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:29.706779 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=42 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:58.132372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc385-38e7-4715-97e8-e182b083c472 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:58.134029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc385-38e7-4715-97e8-e182b083c472 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:58.134512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc385-38e7-4715-97e8-e182b083c472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:58.164067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f42fc385-38e7-4715-97e8-e182b083c472 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:58.165476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f42fc385-38e7-4715-97e8-e182b083c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:58.176751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 781/1546] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:58.187643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089f549-0f6e-4cc1-ab71-f54344e6ba7d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:58.188775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089f549-0f6e-4cc1-ab71-f54344e6ba7d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:58.189313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089f549-0f6e-4cc1-ab71-f54344e6ba7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:58.222367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-8089f549-0f6e-4cc1-ab71-f54344e6ba7d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:58.224005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8089f549-0f6e-4cc1-ab71-f54344e6ba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:58.238076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 766/1547] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:30:58.243736 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fc385-38e7-4715-97e8-e182b083c472 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:58.264096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fc385-38e7-4715-97e8-e182b083c472 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:58.272691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bc847-eff7-4bd3-8f93-3adbd0df7d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:58.273762 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bc847-eff7-4bd3-8f93-3adbd0df7d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:58.274286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bc847-eff7-4bd3-8f93-3adbd0df7d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:58.274792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bc847-eff7-4bd3-8f93-3adbd0df7d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:58.276017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bc847-eff7-4bd3-8f93-3adbd0df7d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:30:58.276583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bc847-eff7-4bd3-8f93-3adbd0df7d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:58.280655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bc847-eff7-4bd3-8f93-3adbd0df7d63 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:58.305604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 782/1548] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:30:58.315676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089f549-0f6e-4cc1-ab71-f54344e6ba7d None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:58.328025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089f549-0f6e-4cc1-ab71-f54344e6ba7d None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:58.339537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ce80-c15f-4722-8d51-157586f0f9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:58.340837 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ce80-c15f-4722-8d51-157586f0f9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:58.341361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ce80-c15f-4722-8d51-157586f0f9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:58.341862 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ce80-c15f-4722-8d51-157586f0f9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:58.342842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ce80-c15f-4722-8d51-157586f0f9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:58.345433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ce80-c15f-4722-8d51-157586f0f9c9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:58.558045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089e53a-f5a1-4b0d-b2e0-7aab60af6526 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:58.558814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089e53a-f5a1-4b0d-b2e0-7aab60af6526 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:58.559326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089e53a-f5a1-4b0d-b2e0-7aab60af6526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:58.582749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0089e53a-f5a1-4b0d-b2e0-7aab60af6526 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:58.585244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0089e53a-f5a1-4b0d-b2e0-7aab60af6526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:58.601232 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 783/1549] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:30:58.611453 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16731af-9fd4-4e35-8903-7184758fadb1 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:58.612195 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16731af-9fd4-4e35-8903-7184758fadb1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:58.612759 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16731af-9fd4-4e35-8903-7184758fadb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:58.649824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f16731af-9fd4-4e35-8903-7184758fadb1 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:58.649935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 767/1550] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:30:58 2022] POST /identity/v3/projects => generated 367 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:30:58.650020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f16731af-9fd4-4e35-8903-7184758fadb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:58.655361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ce80-c15f-4722-8d51-157586f0f9c9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:58.731070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 784/1551] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:30:58.736967 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16731af-9fd4-4e35-8903-7184758fadb1 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:58.753037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16731af-9fd4-4e35-8903-7184758fadb1 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:58.768717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f4cad-d100-4a1b-be3a-9f426de58545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:58.768717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f4cad-d100-4a1b-be3a-9f426de58545 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:58.768717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f4cad-d100-4a1b-be3a-9f426de58545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:58.768717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f4cad-d100-4a1b-be3a-9f426de58545 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:58.770546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f4cad-d100-4a1b-be3a-9f426de58545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:30:58.770546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f4cad-d100-4a1b-be3a-9f426de58545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:58.770546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f4cad-d100-4a1b-be3a-9f426de58545 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:58.787447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ce80-c15f-4722-8d51-157586f0f9c9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:58.799127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 785/1552] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:30:58.801813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4357cf-d1dc-4a1c-9232-98ab5b7b23db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:58.803079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4357cf-d1dc-4a1c-9232-98ab5b7b23db admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:58.804303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4357cf-d1dc-4a1c-9232-98ab5b7b23db admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:58.805096 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4357cf-d1dc-4a1c-9232-98ab5b7b23db admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:58.805984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4357cf-d1dc-4a1c-9232-98ab5b7b23db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:58.807356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: WARNING py.warnings [None req-cc4357cf-d1dc-4a1c-9232-98ab5b7b23db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:30:58.807356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: warnings.warn(msg) Aug 29 20:30:58.807356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: Aug 29 20:30:58.809383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f4cad-d100-4a1b-be3a-9f426de58545 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:58.811479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4357cf-d1dc-4a1c-9232-98ab5b7b23db admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:58.836139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f4cad-d100-4a1b-be3a-9f426de58545 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:58.844113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098d187-187a-4a73-8e0c-001bf674675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:58.845153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d187-187a-4a73-8e0c-001bf674675b admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:58.846102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d187-187a-4a73-8e0c-001bf674675b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:58.846636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d187-187a-4a73-8e0c-001bf674675b admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:58.847510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098d187-187a-4a73-8e0c-001bf674675b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:58.848835 dv-cinder-852009-5-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-b098d187-187a-4a73-8e0c-001bf674675b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:30:58.848835 dv-cinder-852009-5-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 20:30:58.848835 dv-cinder-852009-5-smb devstack@keystone.service[81954]: Aug 29 20:30:58.850466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098d187-187a-4a73-8e0c-001bf674675b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:58.958722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 768/1553] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:30:58 2022] POST /identity/v3/users => generated 284 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:30:58.960736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0224e3-84f5-4a77-8864-d88695ae6916 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:58.961311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0224e3-84f5-4a77-8864-d88695ae6916 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:58.961823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0224e3-84f5-4a77-8864-d88695ae6916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:58.990868 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6b0224e3-84f5-4a77-8864-d88695ae6916 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:58.992648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6b0224e3-84f5-4a77-8864-d88695ae6916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:59.005413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 769/1554] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:59.008210 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804ed58-9133-4e67-96ab-b1111d356da3 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.009189 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804ed58-9133-4e67-96ab-b1111d356da3 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.009723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804ed58-9133-4e67-96ab-b1111d356da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.025451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 786/1555] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:30:58 2022] POST /identity/v3/projects => generated 369 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:30:59.032001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52f7f4-754c-4102-a8bf-1aef9ec18743 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.032363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52f7f4-754c-4102-a8bf-1aef9ec18743 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.032613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52f7f4-754c-4102-a8bf-1aef9ec18743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.039407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-8804ed58-9133-4e67-96ab-b1111d356da3 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:59.040971 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8804ed58-9133-4e67-96ab-b1111d356da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:59.057147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-fc52f7f4-754c-4102-a8bf-1aef9ec18743 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:59.058525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fc52f7f4-754c-4102-a8bf-1aef9ec18743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:59.111986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 770/1556] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:59.113124 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804ed58-9133-4e67-96ab-b1111d356da3 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.124166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804ed58-9133-4e67-96ab-b1111d356da3 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.128928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335213a2-97f2-4e4d-bc62-b7368a4f2694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.129630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335213a2-97f2-4e4d-bc62-b7368a4f2694 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.129840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335213a2-97f2-4e4d-bc62-b7368a4f2694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.130156 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335213a2-97f2-4e4d-bc62-b7368a4f2694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.130441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 787/1557] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:59.130907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335213a2-97f2-4e4d-bc62-b7368a4f2694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.132518 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335213a2-97f2-4e4d-bc62-b7368a4f2694 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.133059 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0e38c-6aa0-4cf0-9832-134904e7066c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.134596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0e38c-6aa0-4cf0-9832-134904e7066c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.134866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0e38c-6aa0-4cf0-9832-134904e7066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.148331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 771/1558] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:30:59.149799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3b757-172e-4d6a-9edf-449a3fa2e322 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.149799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3b757-172e-4d6a-9edf-449a3fa2e322 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.150124 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3b757-172e-4d6a-9edf-449a3fa2e322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.162656 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-06b0e38c-6aa0-4cf0-9832-134904e7066c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:59.164052 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-06b0e38c-6aa0-4cf0-9832-134904e7066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:59.171396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e0a3b757-172e-4d6a-9edf-449a3fa2e322 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:59.172922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e0a3b757-172e-4d6a-9edf-449a3fa2e322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:59.182051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 772/1559] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:59.183476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb0b6-77bb-4c23-bb5b-e1c04d38710a None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.187020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb0b6-77bb-4c23-bb5b-e1c04d38710a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.187020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb0b6-77bb-4c23-bb5b-e1c04d38710a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.187461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 788/1560] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:59.189181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0e38c-6aa0-4cf0-9832-134904e7066c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.200575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0e38c-6aa0-4cf0-9832-134904e7066c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.205857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f835eb-d31c-433c-ac02-20cbf1dbc428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.206624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f835eb-d31c-433c-ac02-20cbf1dbc428 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.206897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f835eb-d31c-433c-ac02-20cbf1dbc428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.207162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f835eb-d31c-433c-ac02-20cbf1dbc428 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.207805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e53fb0b6-77bb-4c23-bb5b-e1c04d38710a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:59.208480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f835eb-d31c-433c-ac02-20cbf1dbc428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.209012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e53fb0b6-77bb-4c23-bb5b-e1c04d38710a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:59.209740 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f835eb-d31c-433c-ac02-20cbf1dbc428 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.217892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 773/1561] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:59.219186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40402040-0c5d-4d86-b1e6-e2bf229db321 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.219472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40402040-0c5d-4d86-b1e6-e2bf229db321 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.219843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40402040-0c5d-4d86-b1e6-e2bf229db321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.241530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-40402040-0c5d-4d86-b1e6-e2bf229db321 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:59.242776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-40402040-0c5d-4d86-b1e6-e2bf229db321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:59.251430 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 774/1562] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:59.253544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29d10f-2621-49d4-afc4-8d75101d7f30 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.253961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29d10f-2621-49d4-afc4-8d75101d7f30 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.254361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29d10f-2621-49d4-afc4-8d75101d7f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.274077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-aa29d10f-2621-49d4-afc4-8d75101d7f30 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:59.275335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-aa29d10f-2621-49d4-afc4-8d75101d7f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:59.283832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 775/1563] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:59.284654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29d10f-2621-49d4-afc4-8d75101d7f30 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.294964 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29d10f-2621-49d4-afc4-8d75101d7f30 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.299623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bf45e-5a83-4bfb-83bc-05f751d6e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.300274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bf45e-5a83-4bfb-83bc-05f751d6e17c admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.300558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bf45e-5a83-4bfb-83bc-05f751d6e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.300832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bf45e-5a83-4bfb-83bc-05f751d6e17c admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.301622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bf45e-5a83-4bfb-83bc-05f751d6e17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.303254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bf45e-5a83-4bfb-83bc-05f751d6e17c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.315292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 776/1564] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:30:59.316903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1f03c-b628-470c-b43e-40b067da24ef None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.317228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1f03c-b628-470c-b43e-40b067da24ef None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.317512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1f03c-b628-470c-b43e-40b067da24ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.332644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:59.338480 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-96c1f03c-b628-470c-b43e-40b067da24ef None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:59.339684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-96c1f03c-b628-470c-b43e-40b067da24ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:59.348150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 777/1565] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:59.349769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1f03c-b628-470c-b43e-40b067da24ef None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.360887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 789/1566] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:30:59.362210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9137b93-1c56-4633-a8ac-0d02b1d8ebe8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.362460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9137b93-1c56-4633-a8ac-0d02b1d8ebe8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.362729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9137b93-1c56-4633-a8ac-0d02b1d8ebe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.363704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1f03c-b628-470c-b43e-40b067da24ef None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.369479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6371f41-5459-4a8d-9dbf-68a68cad6ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.370633 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6371f41-5459-4a8d-9dbf-68a68cad6ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.371126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6371f41-5459-4a8d-9dbf-68a68cad6ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.372490 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6371f41-5459-4a8d-9dbf-68a68cad6ff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.373557 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6371f41-5459-4a8d-9dbf-68a68cad6ff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:30:59.374084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6371f41-5459-4a8d-9dbf-68a68cad6ff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.375324 dv-cinder-852009-5-smb devstack@keystone.service[81955]: WARNING py.warnings [None req-a6371f41-5459-4a8d-9dbf-68a68cad6ff4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:30:59.375324 dv-cinder-852009-5-smb devstack@keystone.service[81955]: warnings.warn(msg) Aug 29 20:30:59.375324 dv-cinder-852009-5-smb devstack@keystone.service[81955]: Aug 29 20:30:59.378786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6371f41-5459-4a8d-9dbf-68a68cad6ff4 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.383852 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b9137b93-1c56-4633-a8ac-0d02b1d8ebe8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:59.385074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b9137b93-1c56-4633-a8ac-0d02b1d8ebe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:59.396857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 778/1567] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:30:59.396857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b13c-b3c2-433a-aaf4-e2e5e155c699 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.396857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b13c-b3c2-433a-aaf4-e2e5e155c699 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.396857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b13c-b3c2-433a-aaf4-e2e5e155c699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.397361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 790/1568] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:59.397361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9137b93-1c56-4633-a8ac-0d02b1d8ebe8 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.406128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9137b93-1c56-4633-a8ac-0d02b1d8ebe8 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.411632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203300be-fb74-48f1-8231-25692f5e31d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.412298 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203300be-fb74-48f1-8231-25692f5e31d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.412576 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203300be-fb74-48f1-8231-25692f5e31d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.412841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203300be-fb74-48f1-8231-25692f5e31d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.413484 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203300be-fb74-48f1-8231-25692f5e31d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:30:59.413781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203300be-fb74-48f1-8231-25692f5e31d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.414889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-09b9b13c-b3c2-433a-aaf4-e2e5e155c699 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:59.415928 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203300be-fb74-48f1-8231-25692f5e31d3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.416093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-09b9b13c-b3c2-433a-aaf4-e2e5e155c699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:59.421613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:59.431179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 779/1569] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:59.431179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9b13c-b3c2-433a-aaf4-e2e5e155c699 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.436014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 791/1570] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:30:59.437188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203300be-fb74-48f1-8231-25692f5e31d3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.441586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9b13c-b3c2-433a-aaf4-e2e5e155c699 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.447819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203300be-fb74-48f1-8231-25692f5e31d3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.448255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81541bf-e76d-46e8-acdf-1c9c17377160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.448876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81541bf-e76d-46e8-acdf-1c9c17377160 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.449157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81541bf-e76d-46e8-acdf-1c9c17377160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.449484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81541bf-e76d-46e8-acdf-1c9c17377160 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.450146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81541bf-e76d-46e8-acdf-1c9c17377160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:30:59.450477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81541bf-e76d-46e8-acdf-1c9c17377160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.452128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81541bf-e76d-46e8-acdf-1c9c17377160 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.453652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1c3ff-b08b-4aba-b316-79e3316d214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.454350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1c3ff-b08b-4aba-b316-79e3316d214a admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.454632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1c3ff-b08b-4aba-b316-79e3316d214a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.454902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1c3ff-b08b-4aba-b316-79e3316d214a admin admin] PATH_INFO: `/v3/projects/861aa2a15d0840efb5e312142972472e/users/5963f388f4564ee6ab36c46bc99ac878/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.467008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 780/1571] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:30:59.469211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c85b3-e30e-4383-acd5-e63f7f1bfe5b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.469211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c85b3-e30e-4383-acd5-e63f7f1bfe5b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.469663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c85b3-e30e-4383-acd5-e63f7f1bfe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.475380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1c3ff-b08b-4aba-b316-79e3316d214a admin admin] RBAC: Authorizing `identity:create_grant(project_id=861aa2a15d0840efb5e312142972472e, user_id=5963f388f4564ee6ab36c46bc99ac878, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.476599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-09a1c3ff-b08b-4aba-b316-79e3316d214a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:30:59.476599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 20:30:59.476599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: Aug 29 20:30:59.478614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1c3ff-b08b-4aba-b316-79e3316d214a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.492411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-179c85b3-e30e-4383-acd5-e63f7f1bfe5b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:59.493756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-179c85b3-e30e-4383-acd5-e63f7f1bfe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:59.503826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 781/1572] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:59.516530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c85b3-e30e-4383-acd5-e63f7f1bfe5b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.516530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c85b3-e30e-4383-acd5-e63f7f1bfe5b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.520534 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294eaf-4fa6-47e4-a7c4-6b86e2e4b998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.521158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294eaf-4fa6-47e4-a7c4-6b86e2e4b998 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.521439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294eaf-4fa6-47e4-a7c4-6b86e2e4b998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.521710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294eaf-4fa6-47e4-a7c4-6b86e2e4b998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.522400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49294eaf-4fa6-47e4-a7c4-6b86e2e4b998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.524181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49294eaf-4fa6-47e4-a7c4-6b86e2e4b998 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.535939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 782/1573] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:30:59.536923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294eaf-4fa6-47e4-a7c4-6b86e2e4b998 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.547812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294eaf-4fa6-47e4-a7c4-6b86e2e4b998 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.552576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ba60-0b13-4ff8-b087-5e6569de4f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.553186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ba60-0b13-4ff8-b087-5e6569de4f0e admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.553465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ba60-0b13-4ff8-b087-5e6569de4f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.553740 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ba60-0b13-4ff8-b087-5e6569de4f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.554437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951ba60-0b13-4ff8-b087-5e6569de4f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.556358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951ba60-0b13-4ff8-b087-5e6569de4f0e admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.617668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 792/1574] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:30:59 2022] PUT /identity/v3/projects/861aa2a15d0840efb5e312142972472e/users/5963f388f4564ee6ab36c46bc99ac878/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:30:59.618507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1c3ff-b08b-4aba-b316-79e3316d214a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.690093 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1c3ff-b08b-4aba-b316-79e3316d214a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.694988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4092e8-e51f-47ff-b9b9-4fd62cb03572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.717950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4092e8-e51f-47ff-b9b9-4fd62cb03572 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.717950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4092e8-e51f-47ff-b9b9-4fd62cb03572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.717950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4092e8-e51f-47ff-b9b9-4fd62cb03572 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.717950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4092e8-e51f-47ff-b9b9-4fd62cb03572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:30:59.717950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4092e8-e51f-47ff-b9b9-4fd62cb03572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.717950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4092e8-e51f-47ff-b9b9-4fd62cb03572 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.721461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 793/1575] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:30:59.721461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4092e8-e51f-47ff-b9b9-4fd62cb03572 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.721645 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4092e8-e51f-47ff-b9b9-4fd62cb03572 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.726435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221caa1-8b75-47d9-afd9-24f0ba07792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.727037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221caa1-8b75-47d9-afd9-24f0ba07792a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.727323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221caa1-8b75-47d9-afd9-24f0ba07792a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.727595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221caa1-8b75-47d9-afd9-24f0ba07792a admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.728240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221caa1-8b75-47d9-afd9-24f0ba07792a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:30:59.728550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221caa1-8b75-47d9-afd9-24f0ba07792a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.731342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221caa1-8b75-47d9-afd9-24f0ba07792a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.744024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 794/1576] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:30:59.744931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221caa1-8b75-47d9-afd9-24f0ba07792a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.760624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221caa1-8b75-47d9-afd9-24f0ba07792a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.765494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3e8ac-e9f6-4121-9739-135887e0dfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.775404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3e8ac-e9f6-4121-9739-135887e0dfba admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.775404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3e8ac-e9f6-4121-9739-135887e0dfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.775404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3e8ac-e9f6-4121-9739-135887e0dfba admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.775404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3e8ac-e9f6-4121-9739-135887e0dfba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.775404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3e8ac-e9f6-4121-9739-135887e0dfba admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.806496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 783/1577] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/projects => generated 377 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:30:59.807466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ba60-0b13-4ff8-b087-5e6569de4f0e admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:59.870933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ba60-0b13-4ff8-b087-5e6569de4f0e admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:59.875797 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c9251-fc1e-4069-8e23-bcdd0daac20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:59.876464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c9251-fc1e-4069-8e23-bcdd0daac20e admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:59.876713 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c9251-fc1e-4069-8e23-bcdd0daac20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:59.876981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c9251-fc1e-4069-8e23-bcdd0daac20e admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:59.877623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c9251-fc1e-4069-8e23-bcdd0daac20e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:59.879576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c9251-fc1e-4069-8e23-bcdd0daac20e admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:59.962602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 795/1578] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:30:59.963660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3e8ac-e9f6-4121-9739-135887e0dfba admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:00.026634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3e8ac-e9f6-4121-9739-135887e0dfba admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:00.033114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f3b72-5299-4599-b4a4-41e6b4332bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:00.033860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f3b72-5299-4599-b4a4-41e6b4332bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.034153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f3b72-5299-4599-b4a4-41e6b4332bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.034492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f3b72-5299-4599-b4a4-41e6b4332bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.035192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f3b72-5299-4599-b4a4-41e6b4332bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:00.035500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f3b72-5299-4599-b4a4-41e6b4332bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:00.036840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 784/1579] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:30:59 2022] POST /identity/v3/projects => generated 393 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:00.037118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f3b72-5299-4599-b4a4-41e6b4332bcd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:00.037726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c9251-fc1e-4069-8e23-bcdd0daac20e admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:00.051352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 796/1580] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:00.058989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92670abc-7302-4374-a7a4-fedc13878b83 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.058989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92670abc-7302-4374-a7a4-fedc13878b83 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.058989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92670abc-7302-4374-a7a4-fedc13878b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.082048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-92670abc-7302-4374-a7a4-fedc13878b83 None None] MFA Rules not processed for user `5963f388f4564ee6ab36c46bc99ac878`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:00.083579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-92670abc-7302-4374-a7a4-fedc13878b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:00.096824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:00.103066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c9251-fc1e-4069-8e23-bcdd0daac20e admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:00.108425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01172c3-1c0c-4dbe-aba5-2cbc31589499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:00.111603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01172c3-1c0c-4dbe-aba5-2cbc31589499 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.111603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01172c3-1c0c-4dbe-aba5-2cbc31589499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.111603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01172c3-1c0c-4dbe-aba5-2cbc31589499 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.111603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01172c3-1c0c-4dbe-aba5-2cbc31589499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:00.111998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01172c3-1c0c-4dbe-aba5-2cbc31589499 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:00.122975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 785/1581] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:00.126946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01172c3-1c0c-4dbe-aba5-2cbc31589499 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:00.137688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01172c3-1c0c-4dbe-aba5-2cbc31589499 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:00.142319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753b002-8725-4c7c-b177-a7dfb2d2984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:00.142928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753b002-8725-4c7c-b177-a7dfb2d2984a admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.143241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753b002-8725-4c7c-b177-a7dfb2d2984a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.143626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753b002-8725-4c7c-b177-a7dfb2d2984a admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.144152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753b002-8725-4c7c-b177-a7dfb2d2984a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:00.146059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753b002-8725-4c7c-b177-a7dfb2d2984a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:00.152062 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:00.157378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 797/1582] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:00.157378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92670abc-7302-4374-a7a4-fedc13878b83 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:00.168956 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92670abc-7302-4374-a7a4-fedc13878b83 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:00.173518 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23de189-e7b2-41b6-b93b-fb711ec86b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:00.174121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23de189-e7b2-41b6-b93b-fb711ec86b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.174551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23de189-e7b2-41b6-b93b-fb711ec86b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.174752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23de189-e7b2-41b6-b93b-fb711ec86b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.175405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23de189-e7b2-41b6-b93b-fb711ec86b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:00.178257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23de189-e7b2-41b6-b93b-fb711ec86b9e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:00.290673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 798/1583] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:00 2022] POST /identity/v3/projects => generated 403 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:00.290673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23de189-e7b2-41b6-b93b-fb711ec86b9e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:00.290982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 786/1584] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:00 2022] POST /identity/v3/projects => generated 389 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:00.291410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753b002-8725-4c7c-b177-a7dfb2d2984a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:00.355640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23de189-e7b2-41b6-b93b-fb711ec86b9e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:00.361424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b6e65-64e5-475c-97d7-b898ca3b4f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:00.362037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b6e65-64e5-475c-97d7-b898ca3b4f8a admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.362344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b6e65-64e5-475c-97d7-b898ca3b4f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.362486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753b002-8725-4c7c-b177-a7dfb2d2984a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:00.362710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b6e65-64e5-475c-97d7-b898ca3b4f8a admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.363344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b6e65-64e5-475c-97d7-b898ca3b4f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:00.365269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b6e65-64e5-475c-97d7-b898ca3b4f8a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:00.367336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdad87-bd06-4c04-bf27-cbd98e5309d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:00.367997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdad87-bd06-4c04-bf27-cbd98e5309d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.368228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdad87-bd06-4c04-bf27-cbd98e5309d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.368501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdad87-bd06-4c04-bf27-cbd98e5309d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.369202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdad87-bd06-4c04-bf27-cbd98e5309d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:00.371213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdad87-bd06-4c04-bf27-cbd98e5309d1 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:00.497107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 799/1585] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:00 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:00.497953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b6e65-64e5-475c-97d7-b898ca3b4f8a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:00.508456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b6e65-64e5-475c-97d7-b898ca3b4f8a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:00.516594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 787/1586] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:00 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:00.516789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f2e68-2b00-4834-814f-7315d906a27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:00.516922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdad87-bd06-4c04-bf27-cbd98e5309d1 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:00.517028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f2e68-2b00-4834-814f-7315d906a27c admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.517028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f2e68-2b00-4834-814f-7315d906a27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.517028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f2e68-2b00-4834-814f-7315d906a27c admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.517028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f2e68-2b00-4834-814f-7315d906a27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:00.518150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f2e68-2b00-4834-814f-7315d906a27c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:00.525922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdad87-bd06-4c04-bf27-cbd98e5309d1 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:00.532762 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915e0fe-6a46-49a8-8453-f58bde3d2d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:00.533367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e0fe-6a46-49a8-8453-f58bde3d2d2d admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.533653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e0fe-6a46-49a8-8453-f58bde3d2d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.533928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e0fe-6a46-49a8-8453-f58bde3d2d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.534809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915e0fe-6a46-49a8-8453-f58bde3d2d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:00.536924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915e0fe-6a46-49a8-8453-f58bde3d2d2d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:00.600174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 800/1587] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:00 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:00.601293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f2e68-2b00-4834-814f-7315d906a27c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:00.613111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f2e68-2b00-4834-814f-7315d906a27c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:00.618652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc0be7-12fc-4852-bdce-1abb6f569bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:00.619396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc0be7-12fc-4852-bdce-1abb6f569bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.619671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc0be7-12fc-4852-bdce-1abb6f569bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.619967 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc0be7-12fc-4852-bdce-1abb6f569bd3 admin admin] PATH_INFO: `/v3/projects/deb257b004eb4c27bcdf78429213963a/users/69d76bbe1ee24f7fbe3764e4177fc534/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.640927 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc0be7-12fc-4852-bdce-1abb6f569bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb257b004eb4c27bcdf78429213963a, user_id=69d76bbe1ee24f7fbe3764e4177fc534, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:00.642722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 788/1588] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:00 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:00.643819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc0be7-12fc-4852-bdce-1abb6f569bd3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:00.648703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915e0fe-6a46-49a8-8453-f58bde3d2d2d admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:00.720277 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915e0fe-6a46-49a8-8453-f58bde3d2d2d admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:00.726816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d33ea0-2a0e-4d96-b448-b67587fa4c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:00.727909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d33ea0-2a0e-4d96-b448-b67587fa4c3c admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.728278 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d33ea0-2a0e-4d96-b448-b67587fa4c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.728689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d33ea0-2a0e-4d96-b448-b67587fa4c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.729958 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d33ea0-2a0e-4d96-b448-b67587fa4c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:00.733357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d33ea0-2a0e-4d96-b448-b67587fa4c3c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:00.742697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 801/1589] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:00 2022] PUT /identity/v3/projects/deb257b004eb4c27bcdf78429213963a/users/69d76bbe1ee24f7fbe3764e4177fc534/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:00.743713 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc0be7-12fc-4852-bdce-1abb6f569bd3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:00.797815 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:00.830168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc0be7-12fc-4852-bdce-1abb6f569bd3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:00.837339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c089b-655a-4dba-8fea-7606f247f1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:00.838408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c089b-655a-4dba-8fea-7606f247f1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.838747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c089b-655a-4dba-8fea-7606f247f1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.839081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c089b-655a-4dba-8fea-7606f247f1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.839946 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c089b-655a-4dba-8fea-7606f247f1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:00.842137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c089b-655a-4dba-8fea-7606f247f1f5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:00.860026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 789/1590] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:00 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:00.866940 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d33ea0-2a0e-4d96-b448-b67587fa4c3c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:00.915611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:00.952693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d33ea0-2a0e-4d96-b448-b67587fa4c3c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:00.959569 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8295c5-64ad-46b7-b48e-0ff4c0a4d3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:00.960161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8295c5-64ad-46b7-b48e-0ff4c0a4d3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:00.960732 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8295c5-64ad-46b7-b48e-0ff4c0a4d3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:00.961139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8295c5-64ad-46b7-b48e-0ff4c0a4d3b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:00.962360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8295c5-64ad-46b7-b48e-0ff4c0a4d3b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:00.966117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8295c5-64ad-46b7-b48e-0ff4c0a4d3b1 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:00.990454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 802/1591] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:00 2022] POST /identity/v3/users => generated 302 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:00.991583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c089b-655a-4dba-8fea-7606f247f1f5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.003266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c089b-655a-4dba-8fea-7606f247f1f5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.009237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f09b3-1c39-43ba-8ad5-bf0505939a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.009920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f09b3-1c39-43ba-8ad5-bf0505939a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.010521 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f09b3-1c39-43ba-8ad5-bf0505939a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.010803 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f09b3-1c39-43ba-8ad5-bf0505939a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.011558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f09b3-1c39-43ba-8ad5-bf0505939a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.013487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f09b3-1c39-43ba-8ad5-bf0505939a93 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.027877 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 803/1592] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.027877 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f09b3-1c39-43ba-8ad5-bf0505939a93 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.037057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f09b3-1c39-43ba-8ad5-bf0505939a93 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.041868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73a7ff-d895-4104-9b83-a99297cbed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.045987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73a7ff-d895-4104-9b83-a99297cbed46 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.045987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73a7ff-d895-4104-9b83-a99297cbed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.045987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73a7ff-d895-4104-9b83-a99297cbed46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.045987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73a7ff-d895-4104-9b83-a99297cbed46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.045987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73a7ff-d895-4104-9b83-a99297cbed46 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.057034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 804/1593] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.057798 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73a7ff-d895-4104-9b83-a99297cbed46 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.070613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73a7ff-d895-4104-9b83-a99297cbed46 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.075977 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3f08f-6be3-4fb7-b6f9-aefe1da249d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.076590 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3f08f-6be3-4fb7-b6f9-aefe1da249d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.080580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3f08f-6be3-4fb7-b6f9-aefe1da249d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.080580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3f08f-6be3-4fb7-b6f9-aefe1da249d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.080580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3f08f-6be3-4fb7-b6f9-aefe1da249d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.080580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3f08f-6be3-4fb7-b6f9-aefe1da249d1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.096386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 805/1594] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.096386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3f08f-6be3-4fb7-b6f9-aefe1da249d1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.103455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 790/1595] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:00 2022] POST /identity/v3/users => generated 295 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:01.104016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3f08f-6be3-4fb7-b6f9-aefe1da249d1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.106430 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e7325-d830-419e-a372-f906aa3edeef None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.107069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e7325-d830-419e-a372-f906aa3edeef None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.107446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e7325-d830-419e-a372-f906aa3edeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.109922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd58713-d39c-4e22-93af-d80ed362c527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.110562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd58713-d39c-4e22-93af-d80ed362c527 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.110836 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd58713-d39c-4e22-93af-d80ed362c527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.111104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd58713-d39c-4e22-93af-d80ed362c527 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.111782 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd58713-d39c-4e22-93af-d80ed362c527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.113701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd58713-d39c-4e22-93af-d80ed362c527 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.141701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ea1e7325-d830-419e-a372-f906aa3edeef None None] MFA Rules not processed for user `69d76bbe1ee24f7fbe3764e4177fc534`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:01.142967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ea1e7325-d830-419e-a372-f906aa3edeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:01.214320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 791/1596] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:01.215826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e7325-d830-419e-a372-f906aa3edeef None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.226651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e7325-d830-419e-a372-f906aa3edeef None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.232233 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a674a6-e088-4796-b9cf-255d61c898f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.232965 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a674a6-e088-4796-b9cf-255d61c898f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.233241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a674a6-e088-4796-b9cf-255d61c898f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.233507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a674a6-e088-4796-b9cf-255d61c898f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.234148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a674a6-e088-4796-b9cf-255d61c898f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.236190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a674a6-e088-4796-b9cf-255d61c898f6 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.254819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 806/1597] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:01 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:01.256135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd58713-d39c-4e22-93af-d80ed362c527 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.274488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd58713-d39c-4e22-93af-d80ed362c527 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.281440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdd09c-14b9-4f0b-beca-a99f17fd18f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.288548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdd09c-14b9-4f0b-beca-a99f17fd18f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.288548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdd09c-14b9-4f0b-beca-a99f17fd18f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.288548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdd09c-14b9-4f0b-beca-a99f17fd18f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.288548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdd09c-14b9-4f0b-beca-a99f17fd18f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.288548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdd09c-14b9-4f0b-beca-a99f17fd18f3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.301273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 807/1598] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.301273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdd09c-14b9-4f0b-beca-a99f17fd18f3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.310367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdd09c-14b9-4f0b-beca-a99f17fd18f3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.315427 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a92314-077b-403d-ad76-4e9618f23eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.319094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a92314-077b-403d-ad76-4e9618f23eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.319094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a92314-077b-403d-ad76-4e9618f23eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.319094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a92314-077b-403d-ad76-4e9618f23eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.319094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a92314-077b-403d-ad76-4e9618f23eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.319094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a92314-077b-403d-ad76-4e9618f23eeb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.337169 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 808/1599] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.338106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a92314-077b-403d-ad76-4e9618f23eeb admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.349376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a92314-077b-403d-ad76-4e9618f23eeb admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.349594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 792/1600] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:01 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:01.350699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a674a6-e088-4796-b9cf-255d61c898f6 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.355575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c67b3-d0c5-4759-8736-33e5b964e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.357710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c67b3-d0c5-4759-8736-33e5b964e9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.358121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c67b3-d0c5-4759-8736-33e5b964e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.359479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c67b3-d0c5-4759-8736-33e5b964e9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.360680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c67b3-d0c5-4759-8736-33e5b964e9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.363272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a674a6-e088-4796-b9cf-255d61c898f6 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.363963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c67b3-d0c5-4759-8736-33e5b964e9f2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.368421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711433a-12cc-42cb-8fbb-bb7688c960d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.369046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711433a-12cc-42cb-8fbb-bb7688c960d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.369330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711433a-12cc-42cb-8fbb-bb7688c960d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.369609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711433a-12cc-42cb-8fbb-bb7688c960d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.370296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711433a-12cc-42cb-8fbb-bb7688c960d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.372133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711433a-12cc-42cb-8fbb-bb7688c960d2 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.382243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 809/1601] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.383473 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c67b3-d0c5-4759-8736-33e5b964e9f2 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.383866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 793/1602] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.384731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711433a-12cc-42cb-8fbb-bb7688c960d2 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.398020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711433a-12cc-42cb-8fbb-bb7688c960d2 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.398321 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c67b3-d0c5-4759-8736-33e5b964e9f2 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.403625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42447bf9-6d4c-4601-a5a5-41995a598811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.404296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42447bf9-6d4c-4601-a5a5-41995a598811 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.404528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42447bf9-6d4c-4601-a5a5-41995a598811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.404802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42447bf9-6d4c-4601-a5a5-41995a598811 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.405303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055ac67-a538-4011-a15b-9e5080934096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.405441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42447bf9-6d4c-4601-a5a5-41995a598811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.405918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055ac67-a538-4011-a15b-9e5080934096 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.406188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055ac67-a538-4011-a15b-9e5080934096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.406568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055ac67-a538-4011-a15b-9e5080934096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.407127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055ac67-a538-4011-a15b-9e5080934096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.407404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42447bf9-6d4c-4601-a5a5-41995a598811 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.408692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055ac67-a538-4011-a15b-9e5080934096 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.425881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 810/1603] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.425881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055ac67-a538-4011-a15b-9e5080934096 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.434156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055ac67-a538-4011-a15b-9e5080934096 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.439018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec587ce2-1b7d-4d8f-b064-bfcfe762be19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.439627 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec587ce2-1b7d-4d8f-b064-bfcfe762be19 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.443279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec587ce2-1b7d-4d8f-b064-bfcfe762be19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.443279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec587ce2-1b7d-4d8f-b064-bfcfe762be19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.443279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec587ce2-1b7d-4d8f-b064-bfcfe762be19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.443279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec587ce2-1b7d-4d8f-b064-bfcfe762be19 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.453465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 811/1604] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.454372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec587ce2-1b7d-4d8f-b064-bfcfe762be19 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.464495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec587ce2-1b7d-4d8f-b064-bfcfe762be19 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.470066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41463a8d-0f2a-416c-aeac-1a78f7807fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.470663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41463a8d-0f2a-416c-aeac-1a78f7807fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.470942 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41463a8d-0f2a-416c-aeac-1a78f7807fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.471205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41463a8d-0f2a-416c-aeac-1a78f7807fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.471956 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41463a8d-0f2a-416c-aeac-1a78f7807fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.473545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41463a8d-0f2a-416c-aeac-1a78f7807fc8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.484242 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 812/1605] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.485063 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41463a8d-0f2a-416c-aeac-1a78f7807fc8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.496632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41463a8d-0f2a-416c-aeac-1a78f7807fc8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.502557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b18e5d-2106-4904-976e-36949166a8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.502557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b18e5d-2106-4904-976e-36949166a8f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.502557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b18e5d-2106-4904-976e-36949166a8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.502557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b18e5d-2106-4904-976e-36949166a8f2 admin admin] PATH_INFO: `/v3/projects/bdd239fcefef4a408d7ad333323ed4c9/users/63b7b33a0dd64d44ba980122f83eba4f/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.520444 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b18e5d-2106-4904-976e-36949166a8f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd239fcefef4a408d7ad333323ed4c9, user_id=63b7b33a0dd64d44ba980122f83eba4f, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.523570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b18e5d-2106-4904-976e-36949166a8f2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.534329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 794/1606] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:01 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:01.540799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42447bf9-6d4c-4601-a5a5-41995a598811 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.600639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42447bf9-6d4c-4601-a5a5-41995a598811 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.605363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704685f3-af3a-43e9-9c87-58c5de4055dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.606118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704685f3-af3a-43e9-9c87-58c5de4055dd admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.606423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704685f3-af3a-43e9-9c87-58c5de4055dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.606701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704685f3-af3a-43e9-9c87-58c5de4055dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.607348 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704685f3-af3a-43e9-9c87-58c5de4055dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.609009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704685f3-af3a-43e9-9c87-58c5de4055dd admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.611489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 813/1607] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:01 2022] PUT /identity/v3/projects/bdd239fcefef4a408d7ad333323ed4c9/users/63b7b33a0dd64d44ba980122f83eba4f/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:01.617673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b18e5d-2106-4904-976e-36949166a8f2 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.622916 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 795/1608] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.622916 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704685f3-af3a-43e9-9c87-58c5de4055dd admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.631929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:01.631929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704685f3-af3a-43e9-9c87-58c5de4055dd admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.669161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:01.683313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b18e5d-2106-4904-976e-36949166a8f2 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.688763 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be5511-7641-4372-8a7f-c939ce73d408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.689382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be5511-7641-4372-8a7f-c939ce73d408 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.689660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be5511-7641-4372-8a7f-c939ce73d408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.690118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be5511-7641-4372-8a7f-c939ce73d408 admin admin] PATH_INFO: `/v3/projects/5df4efab927a4696a73b88cde0fb0ff9/users/948542e68a5c499681d5faf8507cebe7/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.692744 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b168499-bf1c-419d-b7d0-5390cf2be202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.693479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b168499-bf1c-419d-b7d0-5390cf2be202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.694409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b168499-bf1c-419d-b7d0-5390cf2be202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.694694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b168499-bf1c-419d-b7d0-5390cf2be202 admin admin] PATH_INFO: `/v3/projects/0dda9e11de064a44b72c72eb82f977ee/users/19e03b55112b4defb53b1855692898f4/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.706242 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be5511-7641-4372-8a7f-c939ce73d408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df4efab927a4696a73b88cde0fb0ff9, user_id=948542e68a5c499681d5faf8507cebe7, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.708970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be5511-7641-4372-8a7f-c939ce73d408 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.710714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b168499-bf1c-419d-b7d0-5390cf2be202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dda9e11de064a44b72c72eb82f977ee, user_id=19e03b55112b4defb53b1855692898f4, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.713497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b168499-bf1c-419d-b7d0-5390cf2be202 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.804909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 814/1609] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:01 2022] PUT /identity/v3/projects/5df4efab927a4696a73b88cde0fb0ff9/users/948542e68a5c499681d5faf8507cebe7/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:01.805964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be5511-7641-4372-8a7f-c939ce73d408 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.828742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 796/1610] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:01 2022] PUT /identity/v3/projects/0dda9e11de064a44b72c72eb82f977ee/users/19e03b55112b4defb53b1855692898f4/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:01.829600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b168499-bf1c-419d-b7d0-5390cf2be202 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.879034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be5511-7641-4372-8a7f-c939ce73d408 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.905996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b168499-bf1c-419d-b7d0-5390cf2be202 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.911287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799647eb-90da-49c0-b61f-aa95cb03cbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.911907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799647eb-90da-49c0-b61f-aa95cb03cbed admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.912246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799647eb-90da-49c0-b61f-aa95cb03cbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.912519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799647eb-90da-49c0-b61f-aa95cb03cbed admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.913133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799647eb-90da-49c0-b61f-aa95cb03cbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.914818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799647eb-90da-49c0-b61f-aa95cb03cbed admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.925822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 797/1611] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.926707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799647eb-90da-49c0-b61f-aa95cb03cbed admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.937299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799647eb-90da-49c0-b61f-aa95cb03cbed admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.942663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f30035-259a-4f9e-9c4c-09133d2f010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.943449 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30035-259a-4f9e-9c4c-09133d2f010e admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.943734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30035-259a-4f9e-9c4c-09133d2f010e admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.944022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30035-259a-4f9e-9c4c-09133d2f010e admin admin] PATH_INFO: `/v3/projects/b6c8f97a9ecd49df9fa5bea0a02e1d37/users/636000b304484a329999b7f338e502a7/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.952007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f2ba2-6a81-4fb5-a484-81658ea5763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.952007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f2ba2-6a81-4fb5-a484-81658ea5763b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.952007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f2ba2-6a81-4fb5-a484-81658ea5763b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.952007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f2ba2-6a81-4fb5-a484-81658ea5763b admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.952530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f2ba2-6a81-4fb5-a484-81658ea5763b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.953564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f2ba2-6a81-4fb5-a484-81658ea5763b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.963281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f30035-259a-4f9e-9c4c-09133d2f010e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c8f97a9ecd49df9fa5bea0a02e1d37, user_id=636000b304484a329999b7f338e502a7, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.964217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 815/1612] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:01.965992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f2ba2-6a81-4fb5-a484-81658ea5763b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:01.967685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f30035-259a-4f9e-9c4c-09133d2f010e admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:01.976297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f2ba2-6a81-4fb5-a484-81658ea5763b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:01.982068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e136fe-bf64-49da-9778-df1a538bab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:01.982715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e136fe-bf64-49da-9778-df1a538bab53 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:01.987565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e136fe-bf64-49da-9778-df1a538bab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:01.987565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e136fe-bf64-49da-9778-df1a538bab53 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:01.987565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e136fe-bf64-49da-9778-df1a538bab53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:01.987565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e136fe-bf64-49da-9778-df1a538bab53 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:02.044977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 798/1613] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:01 2022] PUT /identity/v3/projects/b6c8f97a9ecd49df9fa5bea0a02e1d37/users/636000b304484a329999b7f338e502a7/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:02.046270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a051-739a-43cb-966e-8d2771edc6fa None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.046562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a051-739a-43cb-966e-8d2771edc6fa None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.046839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a051-739a-43cb-966e-8d2771edc6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.066604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-edc8a051-739a-43cb-966e-8d2771edc6fa None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:02.067817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-edc8a051-739a-43cb-966e-8d2771edc6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:02.076984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 816/1614] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:01 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:02.076984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e136fe-bf64-49da-9778-df1a538bab53 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:02.084166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e136fe-bf64-49da-9778-df1a538bab53 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:02.123009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:02.135030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 799/1615] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:02.137843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4255a48-ca43-4deb-95be-5bb2bc9d08a5 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.138367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4255a48-ca43-4deb-95be-5bb2bc9d08a5 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.138614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4255a48-ca43-4deb-95be-5bb2bc9d08a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.143165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:02.149127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d64e09-4854-47da-958c-5f6bb4c27791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:02.149791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d64e09-4854-47da-958c-5f6bb4c27791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.150070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d64e09-4854-47da-958c-5f6bb4c27791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.150454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d64e09-4854-47da-958c-5f6bb4c27791 admin admin] PATH_INFO: `/v3/projects/3048f683e5fc4cdd86e729925fdadddc/users/8ee6a738a4384502bef539b34862a8eb/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.159057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f4255a48-ca43-4deb-95be-5bb2bc9d08a5 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:02.160372 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f4255a48-ca43-4deb-95be-5bb2bc9d08a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:02.165922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d64e09-4854-47da-958c-5f6bb4c27791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3048f683e5fc4cdd86e729925fdadddc, user_id=8ee6a738a4384502bef539b34862a8eb, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:02.169239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d64e09-4854-47da-958c-5f6bb4c27791 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:02.172998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 800/1616] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:02.172998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf05c3-3b5c-4d71-a6a1-c46407752ec7 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.172998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf05c3-3b5c-4d71-a6a1-c46407752ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.172998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf05c3-3b5c-4d71-a6a1-c46407752ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.201254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-bcaf05c3-3b5c-4d71-a6a1-c46407752ec7 None None] MFA Rules not processed for user `19e03b55112b4defb53b1855692898f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:02.202491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bcaf05c3-3b5c-4d71-a6a1-c46407752ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:02.234299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 817/1617] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:02 2022] PUT /identity/v3/projects/3048f683e5fc4cdd86e729925fdadddc/users/8ee6a738a4384502bef539b34862a8eb/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:02.235122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d64e09-4854-47da-958c-5f6bb4c27791 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:02.272571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 801/1618] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:02.273490 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf05c3-3b5c-4d71-a6a1-c46407752ec7 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:02.290481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf05c3-3b5c-4d71-a6a1-c46407752ec7 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:02.309603 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d64e09-4854-47da-958c-5f6bb4c27791 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:02.318355 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180365d7-773c-42d8-9343-3e90d9010db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:02.319468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180365d7-773c-42d8-9343-3e90d9010db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.319917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180365d7-773c-42d8-9343-3e90d9010db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.320383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180365d7-773c-42d8-9343-3e90d9010db0 admin admin] PATH_INFO: `/v3/projects/7f1b20dafafa414da75171df59ec9611/users/81d4c0fb45114c7098382c3ee2d81b62/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.352224 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180365d7-773c-42d8-9343-3e90d9010db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1b20dafafa414da75171df59ec9611, user_id=81d4c0fb45114c7098382c3ee2d81b62, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:02.354937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180365d7-773c-42d8-9343-3e90d9010db0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:02.376662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7aba99-cc27-48cc-8365-40ce6c49c54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:02.377393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7aba99-cc27-48cc-8365-40ce6c49c54d admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.377674 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7aba99-cc27-48cc-8365-40ce6c49c54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.377946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7aba99-cc27-48cc-8365-40ce6c49c54d admin admin] PATH_INFO: `/v3/projects/26fa14650b694f409a61dccc8fb2f667/users/67a947140e4c4075acd70bbb57022baa/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.398205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7aba99-cc27-48cc-8365-40ce6c49c54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fa14650b694f409a61dccc8fb2f667, user_id=67a947140e4c4075acd70bbb57022baa, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:02.400877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7aba99-cc27-48cc-8365-40ce6c49c54d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:02.445333 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 818/1619] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:02 2022] PUT /identity/v3/projects/7f1b20dafafa414da75171df59ec9611/users/81d4c0fb45114c7098382c3ee2d81b62/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:02.446674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfa323-203d-4c7f-a03f-5666ab175f8e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.446935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfa323-203d-4c7f-a03f-5666ab175f8e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.447203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfa323-203d-4c7f-a03f-5666ab175f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.475903 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e7cfa323-203d-4c7f-a03f-5666ab175f8e None None] MFA Rules not processed for user `636000b304484a329999b7f338e502a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:02.480119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e7cfa323-203d-4c7f-a03f-5666ab175f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:02.490935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 802/1620] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:02 2022] PUT /identity/v3/projects/26fa14650b694f409a61dccc8fb2f667/users/67a947140e4c4075acd70bbb57022baa/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:02.491790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7aba99-cc27-48cc-8365-40ce6c49c54d admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:02.546794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 819/1621] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:02.548018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfa323-203d-4c7f-a03f-5666ab175f8e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:02.549448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e7cfa323-203d-4c7f-a03f-5666ab175f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:02.556569 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7aba99-cc27-48cc-8365-40ce6c49c54d admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:02.562115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680b43c-5be0-4701-970e-72a7c2287c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:02.562764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680b43c-5be0-4701-970e-72a7c2287c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.563048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680b43c-5be0-4701-970e-72a7c2287c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.563560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680b43c-5be0-4701-970e-72a7c2287c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.564384 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680b43c-5be0-4701-970e-72a7c2287c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:02.566136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680b43c-5be0-4701-970e-72a7c2287c46 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:02.578167 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 803/1622] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:02.579163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680b43c-5be0-4701-970e-72a7c2287c46 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:02.581226 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2680b43c-5be0-4701-970e-72a7c2287c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:02.586680 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:02.625381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfa323-203d-4c7f-a03f-5666ab175f8e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:02.630772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:02.647013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680b43c-5be0-4701-970e-72a7c2287c46 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:02.653453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1332576-7803-4457-8bee-53d0d46017c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:02.653453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1332576-7803-4457-8bee-53d0d46017c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.653453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1332576-7803-4457-8bee-53d0d46017c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.653453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1332576-7803-4457-8bee-53d0d46017c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.664373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1332576-7803-4457-8bee-53d0d46017c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:02.665880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1332576-7803-4457-8bee-53d0d46017c0 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:02.677553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 804/1623] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:02.678516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1332576-7803-4457-8bee-53d0d46017c0 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:02.687814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf068a0-1f02-433e-9704-24d03e0e75ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:02.688523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf068a0-1f02-433e-9704-24d03e0e75ae service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.688906 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf068a0-1f02-433e-9704-24d03e0e75ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.689249 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf068a0-1f02-433e-9704-24d03e0e75ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.689491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1332576-7803-4457-8bee-53d0d46017c0 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:02.696761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d666-9a7e-420a-b33c-f8413827ba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:02.703204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d666-9a7e-420a-b33c-f8413827ba23 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.703204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d666-9a7e-420a-b33c-f8413827ba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.703204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d666-9a7e-420a-b33c-f8413827ba23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.703204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6d666-9a7e-420a-b33c-f8413827ba23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:02.703204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6d666-9a7e-420a-b33c-f8413827ba23 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:02.705070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf068a0-1f02-433e-9704-24d03e0e75ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:02.706965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf068a0-1f02-433e-9704-24d03e0e75ae service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:02.712893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 805/1624] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:02.714411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6be374-80b4-4813-b4dd-b43eb9a41c5d None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.714873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6be374-80b4-4813-b4dd-b43eb9a41c5d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.715016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6be374-80b4-4813-b4dd-b43eb9a41c5d None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.716866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 806/1625] 10.222.0.81 () {54 vars in 962 bytes} [Mon Aug 29 20:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:02.717993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 820/1626] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:02.718121 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ebd38-8ce0-4996-b3a2-80d5fcc48252 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.718357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ebd38-8ce0-4996-b3a2-80d5fcc48252 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.718634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ebd38-8ce0-4996-b3a2-80d5fcc48252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.724272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f5b01-ab2a-4d00-bb5c-54d8fed11eca None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.724272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f5b01-ab2a-4d00-bb5c-54d8fed11eca None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.732058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f5b01-ab2a-4d00-bb5c-54d8fed11eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.740968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d44ebd38-8ce0-4996-b3a2-80d5fcc48252 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:02.742049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d44ebd38-8ce0-4996-b3a2-80d5fcc48252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:02.748820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-304f5b01-ab2a-4d00-bb5c-54d8fed11eca None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:02.751687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-304f5b01-ab2a-4d00-bb5c-54d8fed11eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:02.765087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 807/1627] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:02.765936 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ebd38-8ce0-4996-b3a2-80d5fcc48252 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:02.777080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 821/1628] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:02.777080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f5b01-ab2a-4d00-bb5c-54d8fed11eca None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:02.785375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ebd38-8ce0-4996-b3a2-80d5fcc48252 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:02.788688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f5b01-ab2a-4d00-bb5c-54d8fed11eca None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:02.790915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248799a-80ac-491d-a74b-7bb2d721d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:02.791587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248799a-80ac-491d-a74b-7bb2d721d606 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.791843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248799a-80ac-491d-a74b-7bb2d721d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.792118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248799a-80ac-491d-a74b-7bb2d721d606 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.792878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248799a-80ac-491d-a74b-7bb2d721d606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:02.794980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248799a-80ac-491d-a74b-7bb2d721d606 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:02.796964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5bf76-b6a0-48df-b00e-91284feb7d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:02.797652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5bf76-b6a0-48df-b00e-91284feb7d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.798019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5bf76-b6a0-48df-b00e-91284feb7d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.798383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5bf76-b6a0-48df-b00e-91284feb7d09 admin admin] PATH_INFO: `/v3/projects/5a2760bb75cd496abf16fe00a8073019/users/e99e68e351a14a3c96505dd4652d24c4/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.817977 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5bf76-b6a0-48df-b00e-91284feb7d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2760bb75cd496abf16fe00a8073019, user_id=e99e68e351a14a3c96505dd4652d24c4, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:02.820829 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5bf76-b6a0-48df-b00e-91284feb7d09 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:02.868303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 808/1629] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:02 2022] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:02.868303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248799a-80ac-491d-a74b-7bb2d721d606 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:02.893426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 822/1630] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:02 2022] PUT /identity/v3/projects/5a2760bb75cd496abf16fe00a8073019/users/e99e68e351a14a3c96505dd4652d24c4/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:02.897298 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23525837-c12d-4034-a949-3486447e5fb5 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.897766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23525837-c12d-4034-a949-3486447e5fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.898240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23525837-c12d-4034-a949-3486447e5fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.957861 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-23525837-c12d-4034-a949-3486447e5fb5 None None] MFA Rules not processed for user `30946d3b3f0f4a81b2ae5aa6e84f3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:02.958761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-23525837-c12d-4034-a949-3486447e5fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:02.962050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248799a-80ac-491d-a74b-7bb2d721d606 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:03.054142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f987d2d-014c-47f2-93ef-834e3a575cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:03.348697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f987d2d-014c-47f2-93ef-834e3a575cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:03.348697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f987d2d-014c-47f2-93ef-834e3a575cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:03.348697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f987d2d-014c-47f2-93ef-834e3a575cc6 admin admin] PATH_INFO: `/v3/projects/3048f683e5fc4cdd86e729925fdadddc/users/8ee6a738a4384502bef539b34862a8eb/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:03.348697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f987d2d-014c-47f2-93ef-834e3a575cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3048f683e5fc4cdd86e729925fdadddc, user_id=8ee6a738a4384502bef539b34862a8eb, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:03.348697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f987d2d-014c-47f2-93ef-834e3a575cc6 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:03.361923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 823/1631] 10.222.0.81 () {58 vars in 1059 bytes} [Mon Aug 29 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:03.361923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23525837-c12d-4034-a949-3486447e5fb5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:03.362724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 809/1632] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:02 2022] PUT /identity/v3/projects/3048f683e5fc4cdd86e729925fdadddc/users/8ee6a738a4384502bef539b34862a8eb/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:03.362724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f987d2d-014c-47f2-93ef-834e3a575cc6 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:03.362724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:03.363173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23525837-c12d-4034-a949-3486447e5fb5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:03.363173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:03.363298 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f987d2d-014c-47f2-93ef-834e3a575cc6 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:03.363298 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc04b-2d1d-43aa-a97e-ff9564131e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:03.363298 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc04b-2d1d-43aa-a97e-ff9564131e08 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:03.363298 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc04b-2d1d-43aa-a97e-ff9564131e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:03.363534 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc04b-2d1d-43aa-a97e-ff9564131e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:03.363602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe24c45-f867-4dd9-b3b6-050aa09e1bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:03.363602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe24c45-f867-4dd9-b3b6-050aa09e1bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:03.363602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe24c45-f867-4dd9-b3b6-050aa09e1bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:03.363602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe24c45-f867-4dd9-b3b6-050aa09e1bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:03.363891 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bc04b-2d1d-43aa-a97e-ff9564131e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:03.363891 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bc04b-2d1d-43aa-a97e-ff9564131e08 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:03.363891 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 810/1633] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:03.363891 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc04b-2d1d-43aa-a97e-ff9564131e08 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:03.363891 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc04b-2d1d-43aa-a97e-ff9564131e08 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:03.364363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd05c4-0184-4556-9666-ef6d6a7d8b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:03.364363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd05c4-0184-4556-9666-ef6d6a7d8b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:03.364363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd05c4-0184-4556-9666-ef6d6a7d8b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:03.364363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd05c4-0184-4556-9666-ef6d6a7d8b87 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:03.364606 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd05c4-0184-4556-9666-ef6d6a7d8b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:03.364606 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd05c4-0184-4556-9666-ef6d6a7d8b87 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:03.364724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe24c45-f867-4dd9-b3b6-050aa09e1bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:03.364724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe24c45-f867-4dd9-b3b6-050aa09e1bd5 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:03.364724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 824/1634] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:03.364724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe24c45-f867-4dd9-b3b6-050aa09e1bd5 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:03.364724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe24c45-f867-4dd9-b3b6-050aa09e1bd5 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:03.369948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877454e1-0ba3-4292-b759-b5336376f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:03.369948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877454e1-0ba3-4292-b759-b5336376f16a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:03.369948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877454e1-0ba3-4292-b759-b5336376f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:03.369948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877454e1-0ba3-4292-b759-b5336376f16a admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:03.370483 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877454e1-0ba3-4292-b759-b5336376f16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:03.372801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877454e1-0ba3-4292-b759-b5336376f16a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:03.386314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 825/1635] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:03.386314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877454e1-0ba3-4292-b759-b5336376f16a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:03.483721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877454e1-0ba3-4292-b759-b5336376f16a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:03.483721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d28d5-27ee-4e77-81f4-97bc7c94afb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:03.483721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d28d5-27ee-4e77-81f4-97bc7c94afb8 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:03.483721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d28d5-27ee-4e77-81f4-97bc7c94afb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:03.484050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d28d5-27ee-4e77-81f4-97bc7c94afb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:03.519226 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 811/1636] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:03 2022] POST /identity/v3/users => generated 308 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:03.521958 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76237c7b-9d56-4931-9203-d17a978ea3b0 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:03.524354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76237c7b-9d56-4931-9203-d17a978ea3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:03.524715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76237c7b-9d56-4931-9203-d17a978ea3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:03.563024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d28d5-27ee-4e77-81f4-97bc7c94afb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:03.564995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d28d5-27ee-4e77-81f4-97bc7c94afb8 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:03.578621 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 826/1637] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:03.579976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d28d5-27ee-4e77-81f4-97bc7c94afb8 service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:03.592600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d28d5-27ee-4e77-81f4-97bc7c94afb8 service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:03.598806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c13b3c-9c66-40b8-92c9-0bc7e361055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:03.599683 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c13b3c-9c66-40b8-92c9-0bc7e361055a admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:03.600068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c13b3c-9c66-40b8-92c9-0bc7e361055a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:03.600448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c13b3c-9c66-40b8-92c9-0bc7e361055a admin admin] PATH_INFO: `/v3/projects/5a2760bb75cd496abf16fe00a8073019/users/e99e68e351a14a3c96505dd4652d24c4/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:03.602601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c13b3c-9c66-40b8-92c9-0bc7e361055a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2760bb75cd496abf16fe00a8073019, user_id=e99e68e351a14a3c96505dd4652d24c4, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:03.606426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c13b3c-9c66-40b8-92c9-0bc7e361055a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:03.607326 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-76237c7b-9d56-4931-9203-d17a978ea3b0 None None] MFA Rules not processed for user `8ee6a738a4384502bef539b34862a8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:03.608685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-76237c7b-9d56-4931-9203-d17a978ea3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:03.633068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 827/1638] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:03 2022] PUT /identity/v3/projects/5a2760bb75cd496abf16fe00a8073019/users/e99e68e351a14a3c96505dd4652d24c4/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:03.638204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c13b3c-9c66-40b8-92c9-0bc7e361055a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:03.641506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:03.775704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c13b3c-9c66-40b8-92c9-0bc7e361055a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:03.783125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b319b5-1f6a-4f25-af90-00961e896169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:03.784366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b319b5-1f6a-4f25-af90-00961e896169 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:03.785295 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b319b5-1f6a-4f25-af90-00961e896169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:03.786468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b319b5-1f6a-4f25-af90-00961e896169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:03.787347 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b319b5-1f6a-4f25-af90-00961e896169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:03.789614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b319b5-1f6a-4f25-af90-00961e896169 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:03.807066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 812/1639] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:03.810307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 828/1640] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:03.811560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b319b5-1f6a-4f25-af90-00961e896169 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:03.823808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cc437-8d18-4862-893d-b0136a0ee019 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:03.824267 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cc437-8d18-4862-893d-b0136a0ee019 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:03.824704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cc437-8d18-4862-893d-b0136a0ee019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:03.825531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b319b5-1f6a-4f25-af90-00961e896169 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:03.834020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a693ac-f1a7-4681-af1f-846287c44819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:03.836946 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a693ac-f1a7-4681-af1f-846287c44819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:03.837726 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a693ac-f1a7-4681-af1f-846287c44819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:03.838909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a693ac-f1a7-4681-af1f-846287c44819 admin admin] PATH_INFO: `/v3/projects/1dffa8ddbe104ce7abbc927a749f4760/users/96179a8ee5104d33aabc53629ddc5b0e/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:03.876754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a693ac-f1a7-4681-af1f-846287c44819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dffa8ddbe104ce7abbc927a749f4760, user_id=96179a8ee5104d33aabc53629ddc5b0e, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:03.880063 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a693ac-f1a7-4681-af1f-846287c44819 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:03.886293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-348cc437-8d18-4862-893d-b0136a0ee019 None None] MFA Rules not processed for user `e99e68e351a14a3c96505dd4652d24c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:03.888395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-348cc437-8d18-4862-893d-b0136a0ee019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:03.901402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:03.967186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 813/1641] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:03.971641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cc437-8d18-4862-893d-b0136a0ee019 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:04.005868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 829/1642] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:03 2022] PUT /identity/v3/projects/1dffa8ddbe104ce7abbc927a749f4760/users/96179a8ee5104d33aabc53629ddc5b0e/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:04.012063 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d4623-4b61-42fe-8143-7a9ee3cfa231 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:04.012685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d4623-4b61-42fe-8143-7a9ee3cfa231 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:04.013309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d4623-4b61-42fe-8143-7a9ee3cfa231 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:04.017777 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 830/1643] 10.222.0.81 () {54 vars in 912 bytes} [Mon Aug 29 20:31:04 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:04.018916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d4623-4b61-42fe-8143-7a9ee3cfa231 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:04.066551 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cc437-8d18-4862-893d-b0136a0ee019 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:04.111811 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d4623-4b61-42fe-8143-7a9ee3cfa231 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:04.128053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac282de-ef21-4a63-b71f-870f61ede18e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:04.128640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac282de-ef21-4a63-b71f-870f61ede18e service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:04.129091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac282de-ef21-4a63-b71f-870f61ede18e service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:04.129243 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac282de-ef21-4a63-b71f-870f61ede18e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:04.131747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84483e5a-1dc5-4b2c-b034-e9faeb3ef2ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:04.133187 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84483e5a-1dc5-4b2c-b034-e9faeb3ef2ef service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:04.142481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84483e5a-1dc5-4b2c-b034-e9faeb3ef2ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:04.142481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84483e5a-1dc5-4b2c-b034-e9faeb3ef2ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:04.210834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84483e5a-1dc5-4b2c-b034-e9faeb3ef2ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:04.212400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84483e5a-1dc5-4b2c-b034-e9faeb3ef2ef service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:04.220406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:04.233846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 831/1644] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:04.233846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84483e5a-1dc5-4b2c-b034-e9faeb3ef2ef service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:04.247131 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac282de-ef21-4a63-b71f-870f61ede18e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:04.248721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac282de-ef21-4a63-b71f-870f61ede18e service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:04.262654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 814/1645] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:04.264086 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166efa8-9bde-448a-90f5-94267f0263c1 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:04.264771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166efa8-9bde-448a-90f5-94267f0263c1 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:04.264771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166efa8-9bde-448a-90f5-94267f0263c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:04.288710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6166efa8-9bde-448a-90f5-94267f0263c1 None None] MFA Rules not processed for user `30946d3b3f0f4a81b2ae5aa6e84f3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:04.290807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6166efa8-9bde-448a-90f5-94267f0263c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:04.368168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84483e5a-1dc5-4b2c-b034-e9faeb3ef2ef service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:04.384407 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb5c69-dfd9-4ad7-92b0-890eb76e5197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:04.385211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb5c69-dfd9-4ad7-92b0-890eb76e5197 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:04.386880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb5c69-dfd9-4ad7-92b0-890eb76e5197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:04.394477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb5c69-dfd9-4ad7-92b0-890eb76e5197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:04.394477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb5c69-dfd9-4ad7-92b0-890eb76e5197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:04.394974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb5c69-dfd9-4ad7-92b0-890eb76e5197 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:04.438566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 832/1646] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:04.456804 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:04.457286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb5c69-dfd9-4ad7-92b0-890eb76e5197 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:04.482791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb5c69-dfd9-4ad7-92b0-890eb76e5197 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:04.497212 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddac721-05f6-46f2-a850-7a013d845425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:04.498002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddac721-05f6-46f2-a850-7a013d845425 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:04.498397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddac721-05f6-46f2-a850-7a013d845425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:04.498741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddac721-05f6-46f2-a850-7a013d845425 admin admin] PATH_INFO: `/v3/projects/1dffa8ddbe104ce7abbc927a749f4760/users/96179a8ee5104d33aabc53629ddc5b0e/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:04.501034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddac721-05f6-46f2-a850-7a013d845425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dffa8ddbe104ce7abbc927a749f4760, user_id=96179a8ee5104d33aabc53629ddc5b0e, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:04.504155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddac721-05f6-46f2-a850-7a013d845425 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:04.509830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 815/1647] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:04.518796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 833/1648] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:04 2022] PUT /identity/v3/projects/1dffa8ddbe104ce7abbc927a749f4760/users/96179a8ee5104d33aabc53629ddc5b0e/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:04.530203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef901396-0217-479c-b57f-49ad9a084cb2 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:04.530793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef901396-0217-479c-b57f-49ad9a084cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:04.530793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef901396-0217-479c-b57f-49ad9a084cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:04.585392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddac721-05f6-46f2-a850-7a013d845425 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:04.586864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ef901396-0217-479c-b57f-49ad9a084cb2 None None] MFA Rules not processed for user `96179a8ee5104d33aabc53629ddc5b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:04.588126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ef901396-0217-479c-b57f-49ad9a084cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:04.695418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 816/1649] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:04.740438 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddac721-05f6-46f2-a850-7a013d845425 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:04.756970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07280d37-11c9-414f-b25f-a3c2119e84fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:04.757250 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07280d37-11c9-414f-b25f-a3c2119e84fd service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:04.757561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07280d37-11c9-414f-b25f-a3c2119e84fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:04.757934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07280d37-11c9-414f-b25f-a3c2119e84fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:04.793739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef901396-0217-479c-b57f-49ad9a084cb2 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:04.807747 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef901396-0217-479c-b57f-49ad9a084cb2 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:04.813832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c239097-baec-4fc2-8224-545869a2600c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:04.818101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c239097-baec-4fc2-8224-545869a2600c service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:04.818101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c239097-baec-4fc2-8224-545869a2600c service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:04.818101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c239097-baec-4fc2-8224-545869a2600c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:04.894367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07280d37-11c9-414f-b25f-a3c2119e84fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:04.896003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07280d37-11c9-414f-b25f-a3c2119e84fd service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:04.920944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 834/1650] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:04.947587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c239097-baec-4fc2-8224-545869a2600c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:04.950133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c239097-baec-4fc2-8224-545869a2600c service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:04.967529 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 817/1651] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:31:06.206921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07280d37-11c9-414f-b25f-a3c2119e84fd service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:06.223794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07280d37-11c9-414f-b25f-a3c2119e84fd service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:06.229223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32de56-9da4-42dc-aaed-7c1f2f8759cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:06.230026 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32de56-9da4-42dc-aaed-7c1f2f8759cf service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:06.230588 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32de56-9da4-42dc-aaed-7c1f2f8759cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:06.231065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32de56-9da4-42dc-aaed-7c1f2f8759cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:06.244526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32de56-9da4-42dc-aaed-7c1f2f8759cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:06.246289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32de56-9da4-42dc-aaed-7c1f2f8759cf service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:06.258859 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 835/1652] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:06 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:31:06.793982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c239097-baec-4fc2-8224-545869a2600c service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:06.939971 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:07.030211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c239097-baec-4fc2-8224-545869a2600c service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:07.042855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e446c5-4e52-4ce2-82c4-cd969356ccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:07.043283 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e446c5-4e52-4ce2-82c4-cd969356ccf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.043581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e446c5-4e52-4ce2-82c4-cd969356ccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.043967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e446c5-4e52-4ce2-82c4-cd969356ccf7 admin admin] PATH_INFO: `/v3/users/636000b304484a329999b7f338e502a7` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.045174 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e446c5-4e52-4ce2-82c4-cd969356ccf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=636000b304484a329999b7f338e502a7)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:07.047146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e446c5-4e52-4ce2-82c4-cd969356ccf7 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:07.291348 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-50e446c5-4e52-4ce2-82c4-cd969356ccf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636000b304484a329999b7f338e502a7'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:07.311670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-50e446c5-4e52-4ce2-82c4-cd969356ccf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636000b304484a329999b7f338e502a7'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:07.313371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-50e446c5-4e52-4ce2-82c4-cd969356ccf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636000b304484a329999b7f338e502a7'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:07.380050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d03185-615c-4e5d-a454-a7af0e21ef75 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.380662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d03185-615c-4e5d-a454-a7af0e21ef75 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.381186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d03185-615c-4e5d-a454-a7af0e21ef75 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.383722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 836/1653] 10.222.0.81 () {54 vars in 962 bytes} [Mon Aug 29 20:31:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:31:07.411580 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-50e446c5-4e52-4ce2-82c4-cd969356ccf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636000b304484a329999b7f338e502a7'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:07.420217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2406c7-3cc7-43e4-8ebf-f15e79233a05 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.420791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2406c7-3cc7-43e4-8ebf-f15e79233a05 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.421251 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2406c7-3cc7-43e4-8ebf-f15e79233a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.452878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-50e446c5-4e52-4ce2-82c4-cd969356ccf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636000b304484a329999b7f338e502a7'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:07.466867 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5b2406c7-3cc7-43e4-8ebf-f15e79233a05 None None] MFA Rules not processed for user `30946d3b3f0f4a81b2ae5aa6e84f3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:07.468780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 818/1654] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:06 2022] DELETE /identity/v3/users/636000b304484a329999b7f338e502a7 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:07.470459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5b2406c7-3cc7-43e4-8ebf-f15e79233a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.473090 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cef93-a0da-4bcf-a34e-ffeeb82a38e4 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.473803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cef93-a0da-4bcf-a34e-ffeeb82a38e4 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.474299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cef93-a0da-4bcf-a34e-ffeeb82a38e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.485956 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:07.628816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a84cef93-a0da-4bcf-a34e-ffeeb82a38e4 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:07.628816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a84cef93-a0da-4bcf-a34e-ffeeb82a38e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.630392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 837/1655] 10.222.0.81 () {58 vars in 1059 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:07.630554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 819/1656] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:07.630626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1408449-d3cb-410f-a46b-ecb4578f0bda None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.630626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1408449-d3cb-410f-a46b-ecb4578f0bda None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.630626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1408449-d3cb-410f-a46b-ecb4578f0bda None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.630626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 838/1657] 10.222.0.81 () {54 vars in 912 bytes} [Mon Aug 29 20:31:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:07.630861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb76a-129e-4996-b44e-e88ad219d0a2 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.630861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb76a-129e-4996-b44e-e88ad219d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.630861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb76a-129e-4996-b44e-e88ad219d0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.634740 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1408449-d3cb-410f-a46b-ecb4578f0bda None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:07.636755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f1408449-d3cb-410f-a46b-ecb4578f0bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.654118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-9fcbb76a-129e-4996-b44e-e88ad219d0a2 None None] MFA Rules not processed for user `30946d3b3f0f4a81b2ae5aa6e84f3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:07.655736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9fcbb76a-129e-4996-b44e-e88ad219d0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.680938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 820/1658] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:07.696435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb76a-129e-4996-b44e-e88ad219d0a2 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:07.707714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9fcbb76a-129e-4996-b44e-e88ad219d0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.877659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1408449-d3cb-410f-a46b-ecb4578f0bda None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:07.880004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:07.883156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8363e-449d-4dae-b198-4fd3bdff0b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:07.884060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8363e-449d-4dae-b198-4fd3bdff0b5f service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.884343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8363e-449d-4dae-b198-4fd3bdff0b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.886528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8363e-449d-4dae-b198-4fd3bdff0b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.916024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8363e-449d-4dae-b198-4fd3bdff0b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:07.918712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8363e-449d-4dae-b198-4fd3bdff0b5f service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:07.922966 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb76a-129e-4996-b44e-e88ad219d0a2 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:07.930603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a28e0d-2728-4779-ac3b-c5212d3433cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:07.932808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a28e0d-2728-4779-ac3b-c5212d3433cf service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.935117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a28e0d-2728-4779-ac3b-c5212d3433cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.936721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a28e0d-2728-4779-ac3b-c5212d3433cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.953525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 839/1659] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:31:07.953525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8363e-449d-4dae-b198-4fd3bdff0b5f service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:07.955110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4ce8363e-449d-4dae-b198-4fd3bdff0b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.974416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a28e0d-2728-4779-ac3b-c5212d3433cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:07.975978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a28e0d-2728-4779-ac3b-c5212d3433cf service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:07.995078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8363e-449d-4dae-b198-4fd3bdff0b5f service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.015025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 821/1660] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:08.022422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.027688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.029949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.030835 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] PATH_INFO: `/v3/users/69d76bbe1ee24f7fbe3764e4177fc534` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.036739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d76bbe1ee24f7fbe3764e4177fc534)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.040218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:31:08.040218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 20:31:08.040218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: Aug 29 20:31:08.048032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.364798 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d76bbe1ee24f7fbe3764e4177fc534'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:08.398028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d76bbe1ee24f7fbe3764e4177fc534'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:08.399657 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d76bbe1ee24f7fbe3764e4177fc534'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:08.403364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d76bbe1ee24f7fbe3764e4177fc534'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:08.416450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d76bbe1ee24f7fbe3764e4177fc534'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:08.567315 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 840/1661] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:07 2022] DELETE /identity/v3/users/69d76bbe1ee24f7fbe3764e4177fc534 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:08.572454 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3855d4b-ef02-4459-94ad-655126c838fd None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.572856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3855d4b-ef02-4459-94ad-655126c838fd None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.574004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3855d4b-ef02-4459-94ad-655126c838fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.635024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d3855d4b-ef02-4459-94ad-655126c838fd None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:08.638586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d3855d4b-ef02-4459-94ad-655126c838fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:08.785160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 822/1662] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:09.080723 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.083505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:09.265093 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:09.400078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25347322-f643-4980-b1a1-acc90778a5b1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.424230 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44e856-eb44-43f8-9e79-448ae6568018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.425297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44e856-eb44-43f8-9e79-448ae6568018 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.425785 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44e856-eb44-43f8-9e79-448ae6568018 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.426535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44e856-eb44-43f8-9e79-448ae6568018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.477341 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44e856-eb44-43f8-9e79-448ae6568018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.483183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44e856-eb44-43f8-9e79-448ae6568018 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.528676 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 841/1663] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:09.688487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3855d4b-ef02-4459-94ad-655126c838fd None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.690074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d3855d4b-ef02-4459-94ad-655126c838fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:09.719519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3855d4b-ef02-4459-94ad-655126c838fd None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.737604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.738449 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.738740 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.739020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] PATH_INFO: `/v3/projects/b6c8f97a9ecd49df9fa5bea0a02e1d37` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.740937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c8f97a9ecd49df9fa5bea0a02e1d37)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.746499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: WARNING py.warnings [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:31:09.746499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: warnings.warn(msg) Aug 29 20:31:09.746499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: Aug 29 20:31:09.752030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.966434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c8f97a9ecd49df9fa5bea0a02e1d37', 'request_id': 'req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:10.008780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c8f97a9ecd49df9fa5bea0a02e1d37', 'request_id': 'req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:10.045506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c8f97a9ecd49df9fa5bea0a02e1d37', 'request_id': 'req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:10.130694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] The token cache is being invalidate because project b6c8f97a9ecd49df9fa5bea0a02e1d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:10.131598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:10.134074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:10.138613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 823/1664] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:09 2022] DELETE /identity/v3/projects/b6c8f97a9ecd49df9fa5bea0a02e1d37 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:10.143045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44e856-eb44-43f8-9e79-448ae6568018 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:10.167921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44e856-eb44-43f8-9e79-448ae6568018 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:10.375485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:10.376833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.377335 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.378586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] PATH_INFO: `/v3/users/96179a8ee5104d33aabc53629ddc5b0e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.380237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] RBAC: Authorizing `identity:delete_user(user_id=96179a8ee5104d33aabc53629ddc5b0e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:10.385188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:10.701076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96179a8ee5104d33aabc53629ddc5b0e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:10.770608 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96179a8ee5104d33aabc53629ddc5b0e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:10.772648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96179a8ee5104d33aabc53629ddc5b0e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:10.775454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96179a8ee5104d33aabc53629ddc5b0e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:10.798929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96179a8ee5104d33aabc53629ddc5b0e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:10.932602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 842/1665] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:10 2022] DELETE /identity/v3/users/96179a8ee5104d33aabc53629ddc5b0e => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:12.374869 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.377040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:12.403443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3553fc-5d1a-4f0c-95ab-c91b1d733334 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.590111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.591036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.591545 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.591826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] PATH_INFO: `/v3/projects/deb257b004eb4c27bcdf78429213963a` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.594649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb257b004eb4c27bcdf78429213963a)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.597346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:12.635913 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:12.791043 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb257b004eb4c27bcdf78429213963a', 'request_id': 'req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:12.807232 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb257b004eb4c27bcdf78429213963a', 'request_id': 'req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:12.828022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb257b004eb4c27bcdf78429213963a', 'request_id': 'req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:12.961238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.963256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:13.003366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] The token cache is being invalidate because project deb257b004eb4c27bcdf78429213963a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:13.003778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.003939 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239671-0c66-4a6e-a32d-c874a5f3249f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:13.005575 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.008220 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 824/1666] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:12 2022] DELETE /identity/v3/projects/deb257b004eb4c27bcdf78429213963a => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:13.018192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:13.020835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:13.092042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:13.124529 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ea78c-5e42-469b-9041-032733d84aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:13.125593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ea78c-5e42-469b-9041-032733d84aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:13.126109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ea78c-5e42-469b-9041-032733d84aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:13.126712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ea78c-5e42-469b-9041-032733d84aa3 admin admin] PATH_INFO: `/v3/projects/1dffa8ddbe104ce7abbc927a749f4760` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:13.128283 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ea78c-5e42-469b-9041-032733d84aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dffa8ddbe104ce7abbc927a749f4760)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:13.130700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ea78c-5e42-469b-9041-032733d84aa3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:13.179771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0a686-f613-4ef1-ba1c-d1d7c66f92a4 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:13.186916 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723bd51-b0fb-4b0e-a6ae-b7598efd8405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:13.188585 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723bd51-b0fb-4b0e-a6ae-b7598efd8405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:13.189120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723bd51-b0fb-4b0e-a6ae-b7598efd8405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:13.189612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723bd51-b0fb-4b0e-a6ae-b7598efd8405 admin admin] PATH_INFO: `/v3/users/e99e68e351a14a3c96505dd4652d24c4` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:13.191640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723bd51-b0fb-4b0e-a6ae-b7598efd8405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99e68e351a14a3c96505dd4652d24c4)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:13.195367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723bd51-b0fb-4b0e-a6ae-b7598efd8405 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:13.298749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f7ea78c-5e42-469b-9041-032733d84aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dffa8ddbe104ce7abbc927a749f4760', 'request_id': 'req-7f7ea78c-5e42-469b-9041-032733d84aa3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.313335 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f7ea78c-5e42-469b-9041-032733d84aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dffa8ddbe104ce7abbc927a749f4760', 'request_id': 'req-7f7ea78c-5e42-469b-9041-032733d84aa3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.387749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f7ea78c-5e42-469b-9041-032733d84aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dffa8ddbe104ce7abbc927a749f4760', 'request_id': 'req-7f7ea78c-5e42-469b-9041-032733d84aa3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.417067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4723bd51-b0fb-4b0e-a6ae-b7598efd8405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99e68e351a14a3c96505dd4652d24c4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.433671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f7ea78c-5e42-469b-9041-032733d84aa3 admin admin] The token cache is being invalidate because project 1dffa8ddbe104ce7abbc927a749f4760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:13.433979 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f7ea78c-5e42-469b-9041-032733d84aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.438787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f7ea78c-5e42-469b-9041-032733d84aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.447319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4723bd51-b0fb-4b0e-a6ae-b7598efd8405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99e68e351a14a3c96505dd4652d24c4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.447902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 843/1667] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:12 2022] DELETE /identity/v3/projects/1dffa8ddbe104ce7abbc927a749f4760 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:13.449723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4723bd51-b0fb-4b0e-a6ae-b7598efd8405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99e68e351a14a3c96505dd4652d24c4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.463443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa3330-82b1-4cf9-a8c8-c87267dac2a2 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:13.463970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa3330-82b1-4cf9-a8c8-c87267dac2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:13.464479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa3330-82b1-4cf9-a8c8-c87267dac2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:13.516348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-21fa3330-82b1-4cf9-a8c8-c87267dac2a2 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:13.518720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-21fa3330-82b1-4cf9-a8c8-c87267dac2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:13.550385 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4723bd51-b0fb-4b0e-a6ae-b7598efd8405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99e68e351a14a3c96505dd4652d24c4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.591909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4723bd51-b0fb-4b0e-a6ae-b7598efd8405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99e68e351a14a3c96505dd4652d24c4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.612091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 825/1668] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:13 2022] DELETE /identity/v3/users/e99e68e351a14a3c96505dd4652d24c4 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:13.688638 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad9b32-c6e5-4759-a524-7bdcf3c08654 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:13.689362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad9b32-c6e5-4759-a524-7bdcf3c08654 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:13.689842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad9b32-c6e5-4759-a524-7bdcf3c08654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:13.692963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 844/1669] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:13.733002 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a8ad9b32-c6e5-4759-a524-7bdcf3c08654 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:13.735118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a8ad9b32-c6e5-4759-a524-7bdcf3c08654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:13.884356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 826/1670] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:13.888602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa3330-82b1-4cf9-a8c8-c87267dac2a2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:13.908466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa3330-82b1-4cf9-a8c8-c87267dac2a2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:13.925242 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ca820-e1d3-410c-bf5c-b046f7901147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:13.925883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ca820-e1d3-410c-bf5c-b046f7901147 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:13.926165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ca820-e1d3-410c-bf5c-b046f7901147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:13.927098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ca820-e1d3-410c-bf5c-b046f7901147 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:13.927216 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ca820-e1d3-410c-bf5c-b046f7901147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:13.927423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ca820-e1d3-410c-bf5c-b046f7901147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:13.929137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ca820-e1d3-410c-bf5c-b046f7901147 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:13.959788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad9b32-c6e5-4759-a524-7bdcf3c08654 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:13.964684 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 845/1671] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:13.974586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad9b32-c6e5-4759-a524-7bdcf3c08654 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:13.991880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da15987-a0c5-4fa0-bbf3-a74afa0b89f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:13.991880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da15987-a0c5-4fa0-bbf3-a74afa0b89f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:13.991880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da15987-a0c5-4fa0-bbf3-a74afa0b89f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:13.993230 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da15987-a0c5-4fa0-bbf3-a74afa0b89f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:13.993230 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da15987-a0c5-4fa0-bbf3-a74afa0b89f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:13.995220 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da15987-a0c5-4fa0-bbf3-a74afa0b89f5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:14.175637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ca820-e1d3-410c-bf5c-b046f7901147 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:14.176697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 827/1672] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:13 2022] POST /identity/v3/projects => generated 363 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:14.192153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ca820-e1d3-410c-bf5c-b046f7901147 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:14.327085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7636f-a53b-4316-92d1-a098514d8e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:14.328161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7636f-a53b-4316-92d1-a098514d8e13 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:14.329693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7636f-a53b-4316-92d1-a098514d8e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:14.330021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7636f-a53b-4316-92d1-a098514d8e13 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:14.330718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7636f-a53b-4316-92d1-a098514d8e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:14.332966 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7636f-a53b-4316-92d1-a098514d8e13 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:14.473961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 846/1673] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:14 2022] POST /identity/v3/users => generated 282 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:31:14.476702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da15987-a0c5-4fa0-bbf3-a74afa0b89f5 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:14.491636 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da15987-a0c5-4fa0-bbf3-a74afa0b89f5 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:14.511445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327efe57-b0ad-455e-a3fe-26cb9db2dac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:14.512762 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327efe57-b0ad-455e-a3fe-26cb9db2dac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:14.513201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327efe57-b0ad-455e-a3fe-26cb9db2dac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:14.513624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327efe57-b0ad-455e-a3fe-26cb9db2dac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:14.514479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327efe57-b0ad-455e-a3fe-26cb9db2dac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:14.516269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327efe57-b0ad-455e-a3fe-26cb9db2dac5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:14.545552 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7636f-a53b-4316-92d1-a098514d8e13 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:14.555935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 828/1674] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:14.559205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7636f-a53b-4316-92d1-a098514d8e13 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:14.577103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03623d6c-6b58-4257-b700-8ab588f3db78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:14.577103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03623d6c-6b58-4257-b700-8ab588f3db78 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:14.577103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03623d6c-6b58-4257-b700-8ab588f3db78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:14.577103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03623d6c-6b58-4257-b700-8ab588f3db78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:14.577461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03623d6c-6b58-4257-b700-8ab588f3db78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:14.578639 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03623d6c-6b58-4257-b700-8ab588f3db78 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:14.605955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 847/1675] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:31:14.611902 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327efe57-b0ad-455e-a3fe-26cb9db2dac5 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:14.641659 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327efe57-b0ad-455e-a3fe-26cb9db2dac5 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:14.648832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52920c6-7813-40db-a361-3581bcfe46f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:14.649565 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52920c6-7813-40db-a361-3581bcfe46f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:14.649954 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52920c6-7813-40db-a361-3581bcfe46f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:14.650507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52920c6-7813-40db-a361-3581bcfe46f3 admin admin] PATH_INFO: `/v3/projects/1a9c34dd18764d8ca1b131c549fd5e7c/users/618e8f73d95c487fb1b570d59950f697/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:14.695618 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52920c6-7813-40db-a361-3581bcfe46f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9c34dd18764d8ca1b131c549fd5e7c, user_id=618e8f73d95c487fb1b570d59950f697, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:14.699126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52920c6-7813-40db-a361-3581bcfe46f3 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:14.827449 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 829/1676] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:14 2022] PUT /identity/v3/projects/1a9c34dd18764d8ca1b131c549fd5e7c/users/618e8f73d95c487fb1b570d59950f697/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:14.846763 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e60cb-b29e-4388-9031-6e4eee1af030 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:14.847263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e60cb-b29e-4388-9031-6e4eee1af030 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:14.847597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e60cb-b29e-4388-9031-6e4eee1af030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:14.912827 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e40e60cb-b29e-4388-9031-6e4eee1af030 None None] MFA Rules not processed for user `618e8f73d95c487fb1b570d59950f697`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:14.915725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e40e60cb-b29e-4388-9031-6e4eee1af030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:15.056071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:15.169151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 848/1677] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:15.191124 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52920c6-7813-40db-a361-3581bcfe46f3 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:15.422320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52920c6-7813-40db-a361-3581bcfe46f3 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:15.436610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e6987-02c3-471b-8ced-bcec92ae04e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:15.437457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e6987-02c3-471b-8ced-bcec92ae04e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:15.437878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e6987-02c3-471b-8ced-bcec92ae04e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:15.438337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e6987-02c3-471b-8ced-bcec92ae04e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:15.439629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e6987-02c3-471b-8ced-bcec92ae04e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:15.444771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e6987-02c3-471b-8ced-bcec92ae04e2 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:15.633798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 830/1678] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:15 2022] POST /identity/v3/projects => generated 365 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:15.638156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e60cb-b29e-4388-9031-6e4eee1af030 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:15.677485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e60cb-b29e-4388-9031-6e4eee1af030 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:15.716636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:15.845492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f2ae2-8217-438a-8d7a-62c076a7733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:15.846866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f2ae2-8217-438a-8d7a-62c076a7733f admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:15.846866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f2ae2-8217-438a-8d7a-62c076a7733f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:15.847092 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f2ae2-8217-438a-8d7a-62c076a7733f admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:15.850087 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f2ae2-8217-438a-8d7a-62c076a7733f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:15.855689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f2ae2-8217-438a-8d7a-62c076a7733f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:15.930782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e6987-02c3-471b-8ced-bcec92ae04e2 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:15.933852 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5c9e6987-02c3-471b-8ced-bcec92ae04e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:15.966423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e6987-02c3-471b-8ced-bcec92ae04e2 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:15.983263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa7868-f3ca-41df-a5bd-0f6c167ece5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:15.984867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa7868-f3ca-41df-a5bd-0f6c167ece5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:15.985419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa7868-f3ca-41df-a5bd-0f6c167ece5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:15.985876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa7868-f3ca-41df-a5bd-0f6c167ece5a admin admin] PATH_INFO: `/v3/users/19e03b55112b4defb53b1855692898f4` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:15.987395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa7868-f3ca-41df-a5bd-0f6c167ece5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e03b55112b4defb53b1855692898f4)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:15.993361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa7868-f3ca-41df-a5bd-0f6c167ece5a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:15.998555 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 849/1679] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:15 2022] POST /identity/v3/users => generated 289 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:16.006534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f2ae2-8217-438a-8d7a-62c076a7733f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:16.030575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f2ae2-8217-438a-8d7a-62c076a7733f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:16.040255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe2c6e-d29b-466e-8382-6da3f79b9df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:16.040895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe2c6e-d29b-466e-8382-6da3f79b9df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:16.041176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe2c6e-d29b-466e-8382-6da3f79b9df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:16.041833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe2c6e-d29b-466e-8382-6da3f79b9df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:16.042347 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe2c6e-d29b-466e-8382-6da3f79b9df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:16.047531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe2c6e-d29b-466e-8382-6da3f79b9df8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:16.065063 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 850/1680] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:16.069759 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe2c6e-d29b-466e-8382-6da3f79b9df8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:16.096451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe2c6e-d29b-466e-8382-6da3f79b9df8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:16.125708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e88a0-eab0-4956-bf81-77b787ec0789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:16.126431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e88a0-eab0-4956-bf81-77b787ec0789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:16.126746 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e88a0-eab0-4956-bf81-77b787ec0789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:16.127037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e88a0-eab0-4956-bf81-77b787ec0789 admin admin] PATH_INFO: `/v3/projects/f1b97afe6ce8457ebd6abdd915e51aa4/users/cb3c13c8bd58438dabd38d223743b49a/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:16.170181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e88a0-eab0-4956-bf81-77b787ec0789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b97afe6ce8457ebd6abdd915e51aa4, user_id=cb3c13c8bd58438dabd38d223743b49a, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:16.190345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e88a0-eab0-4956-bf81-77b787ec0789 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:16.274391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 851/1681] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:16 2022] PUT /identity/v3/projects/f1b97afe6ce8457ebd6abdd915e51aa4/users/cb3c13c8bd58438dabd38d223743b49a/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:16.281267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e88a0-eab0-4956-bf81-77b787ec0789 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:16.292988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-92fa7868-f3ca-41df-a5bd-0f6c167ece5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e03b55112b4defb53b1855692898f4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:16.323134 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-92fa7868-f3ca-41df-a5bd-0f6c167ece5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e03b55112b4defb53b1855692898f4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:16.329635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-92fa7868-f3ca-41df-a5bd-0f6c167ece5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e03b55112b4defb53b1855692898f4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:16.439409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-92fa7868-f3ca-41df-a5bd-0f6c167ece5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e03b55112b4defb53b1855692898f4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:16.476364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-92fa7868-f3ca-41df-a5bd-0f6c167ece5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e03b55112b4defb53b1855692898f4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:16.494557 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 831/1682] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:15 2022] DELETE /identity/v3/users/19e03b55112b4defb53b1855692898f4 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:16.495431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e88a0-eab0-4956-bf81-77b787ec0789 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:16.500628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ddfc0-3ee7-4622-a92c-c659f61e405c None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:16.501062 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ddfc0-3ee7-4622-a92c-c659f61e405c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:16.501436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ddfc0-3ee7-4622-a92c-c659f61e405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:16.571322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-858ddfc0-3ee7-4622-a92c-c659f61e405c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:16.583320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-858ddfc0-3ee7-4622-a92c-c659f61e405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:16.699728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd05f62-9bc7-484e-8b33-b3917699ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:16.700505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd05f62-9bc7-484e-8b33-b3917699ba2b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:16.700791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd05f62-9bc7-484e-8b33-b3917699ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:16.702808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd05f62-9bc7-484e-8b33-b3917699ba2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:16.705619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd05f62-9bc7-484e-8b33-b3917699ba2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:16.708015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd05f62-9bc7-484e-8b33-b3917699ba2b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:16.747290 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 852/1683] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:16.748451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd05f62-9bc7-484e-8b33-b3917699ba2b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:16.749825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 832/1684] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:16.751828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ddfc0-3ee7-4622-a92c-c659f61e405c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:16.755276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2fd05f62-9bc7-484e-8b33-b3917699ba2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:16.757541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-858ddfc0-3ee7-4622-a92c-c659f61e405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:16.790498 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd05f62-9bc7-484e-8b33-b3917699ba2b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:16.795402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ddfc0-3ee7-4622-a92c-c659f61e405c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:16.828478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:16.830331 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:16.830612 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:16.831061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] PATH_INFO: `/v3/projects/5a2760bb75cd496abf16fe00a8073019` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:16.832370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01ece8-65a9-4ae0-8fab-69a883ed4a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:16.833046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01ece8-65a9-4ae0-8fab-69a883ed4a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:16.833327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01ece8-65a9-4ae0-8fab-69a883ed4a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:16.833602 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01ece8-65a9-4ae0-8fab-69a883ed4a5f admin admin] PATH_INFO: `/v3/projects/f1b97afe6ce8457ebd6abdd915e51aa4/users/cb3c13c8bd58438dabd38d223743b49a/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:16.835290 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a2760bb75cd496abf16fe00a8073019)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:16.840132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:16.842816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01ece8-65a9-4ae0-8fab-69a883ed4a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b97afe6ce8457ebd6abdd915e51aa4, user_id=cb3c13c8bd58438dabd38d223743b49a, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:16.846617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01ece8-65a9-4ae0-8fab-69a883ed4a5f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:16.897736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 833/1685] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:16 2022] PUT /identity/v3/projects/f1b97afe6ce8457ebd6abdd915e51aa4/users/cb3c13c8bd58438dabd38d223743b49a/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:16.899052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01ece8-65a9-4ae0-8fab-69a883ed4a5f admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:16.914706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3e01ece8-65a9-4ae0-8fab-69a883ed4a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:17.076065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01ece8-65a9-4ae0-8fab-69a883ed4a5f admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:17.080604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21eb6ac-b1cd-4bda-b9de-fee9e6019cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:17.081398 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21eb6ac-b1cd-4bda-b9de-fee9e6019cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:17.081827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21eb6ac-b1cd-4bda-b9de-fee9e6019cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:17.082298 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21eb6ac-b1cd-4bda-b9de-fee9e6019cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:17.116470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2760bb75cd496abf16fe00a8073019', 'request_id': 'req-c47efe33-1587-4a00-845b-045e606bc607'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.130030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2760bb75cd496abf16fe00a8073019', 'request_id': 'req-c47efe33-1587-4a00-845b-045e606bc607'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.220671 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21eb6ac-b1cd-4bda-b9de-fee9e6019cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:17.223278 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21eb6ac-b1cd-4bda-b9de-fee9e6019cd8 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:17.232778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2760bb75cd496abf16fe00a8073019', 'request_id': 'req-c47efe33-1587-4a00-845b-045e606bc607'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.238041 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 834/1686] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:17.240189 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db59523-aa88-46a7-b1c0-f2a5c0375ca9 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:17.240689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db59523-aa88-46a7-b1c0-f2a5c0375ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:17.241140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db59523-aa88-46a7-b1c0-f2a5c0375ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:17.253948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] The token cache is being invalidate because project 5a2760bb75cd496abf16fe00a8073019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:17.254406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.256541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.262595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 853/1687] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:16 2022] DELETE /identity/v3/projects/5a2760bb75cd496abf16fe00a8073019 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:17.270011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:17.274883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:17.323123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-7db59523-aa88-46a7-b1c0-f2a5c0375ca9 None None] MFA Rules not processed for user `cb3c13c8bd58438dabd38d223743b49a`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:17.329149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7db59523-aa88-46a7-b1c0-f2a5c0375ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:17.372093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:17.441865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47efe33-1587-4a00-845b-045e606bc607 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:17.454364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a5301-83dc-4e8e-934f-5a241f51d0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:17.455017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5301-83dc-4e8e-934f-5a241f51d0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:17.455288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5301-83dc-4e8e-934f-5a241f51d0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:17.455572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5301-83dc-4e8e-934f-5a241f51d0ae admin admin] PATH_INFO: `/v3/users/5963f388f4564ee6ab36c46bc99ac878` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:17.459392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a5301-83dc-4e8e-934f-5a241f51d0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5963f388f4564ee6ab36c46bc99ac878)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:17.461777 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a5301-83dc-4e8e-934f-5a241f51d0ae admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:17.515147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 835/1688] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:17.521908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cf72b-f6da-44cd-8cdf-88fbbfdac999 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:17.521908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cf72b-f6da-44cd-8cdf-88fbbfdac999 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:17.521908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cf72b-f6da-44cd-8cdf-88fbbfdac999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:17.602748 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-320cf72b-f6da-44cd-8cdf-88fbbfdac999 None None] MFA Rules not processed for user `81d4c0fb45114c7098382c3ee2d81b62`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:17.608305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-320cf72b-f6da-44cd-8cdf-88fbbfdac999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:17.724594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 836/1689] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:17.725955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5b5a7-ab15-4b92-b448-2811c387fa7c None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:17.726873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5b5a7-ab15-4b92-b448-2811c387fa7c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:17.727698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5b5a7-ab15-4b92-b448-2811c387fa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:17.742820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:17.748485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3f4a5301-83dc-4e8e-934f-5a241f51d0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5963f388f4564ee6ab36c46bc99ac878'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.755946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-77f5b5a7-ab15-4b92-b448-2811c387fa7c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:17.759834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-77f5b5a7-ab15-4b92-b448-2811c387fa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:17.774670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 837/1690] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:17.777390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5b5a7-ab15-4b92-b448-2811c387fa7c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:17.782837 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-77f5b5a7-ab15-4b92-b448-2811c387fa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:17.790393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3f4a5301-83dc-4e8e-934f-5a241f51d0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5963f388f4564ee6ab36c46bc99ac878'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.796104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3f4a5301-83dc-4e8e-934f-5a241f51d0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5963f388f4564ee6ab36c46bc99ac878'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.798898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3f4a5301-83dc-4e8e-934f-5a241f51d0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5963f388f4564ee6ab36c46bc99ac878'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.862822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3f4a5301-83dc-4e8e-934f-5a241f51d0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5963f388f4564ee6ab36c46bc99ac878'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.973949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5b5a7-ab15-4b92-b448-2811c387fa7c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:17.993165 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe40d80-e353-4ff6-a683-6ea6d96a550e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:17.994274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe40d80-e353-4ff6-a683-6ea6d96a550e service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:17.994710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe40d80-e353-4ff6-a683-6ea6d96a550e service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:17.995157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe40d80-e353-4ff6-a683-6ea6d96a550e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:18.005533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6fe40d80-e353-4ff6-a683-6ea6d96a550e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:18.025257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 854/1691] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:17 2022] DELETE /identity/v3/users/5963f388f4564ee6ab36c46bc99ac878 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:18.030692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134cb4a-54d9-4e6b-87fe-6117030ef1eb None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:18.030990 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134cb4a-54d9-4e6b-87fe-6117030ef1eb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:18.031242 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134cb4a-54d9-4e6b-87fe-6117030ef1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:18.041047 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe40d80-e353-4ff6-a683-6ea6d96a550e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:18.058426 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe40d80-e353-4ff6-a683-6ea6d96a550e service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:18.097447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7134cb4a-54d9-4e6b-87fe-6117030ef1eb None None] MFA Rules not processed for user `81d4c0fb45114c7098382c3ee2d81b62`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:18.102584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 838/1692] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:18.103126 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7134cb4a-54d9-4e6b-87fe-6117030ef1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:18.107722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f316ee-fcc7-4db1-ae04-9a0ad83d88b8 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:18.109958 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f316ee-fcc7-4db1-ae04-9a0ad83d88b8 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:18.110536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f316ee-fcc7-4db1-ae04-9a0ad83d88b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:18.226985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-b9f316ee-fcc7-4db1-ae04-9a0ad83d88b8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:18.234386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b9f316ee-fcc7-4db1-ae04-9a0ad83d88b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:18.237977 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 855/1693] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:18.240275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dcfd7-0a84-4ef4-a8c1-94934c350b64 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:18.240752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dcfd7-0a84-4ef4-a8c1-94934c350b64 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:18.241781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dcfd7-0a84-4ef4-a8c1-94934c350b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:18.300643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e32dcfd7-0a84-4ef4-a8c1-94934c350b64 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:18.303098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e32dcfd7-0a84-4ef4-a8c1-94934c350b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:18.455784 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 839/1694] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:18.459690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f316ee-fcc7-4db1-ae04-9a0ad83d88b8 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:18.469887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:18.472367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b9f316ee-fcc7-4db1-ae04-9a0ad83d88b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:18.520277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 856/1695] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:18.521401 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dcfd7-0a84-4ef4-a8c1-94934c350b64 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:18.545157 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dcfd7-0a84-4ef4-a8c1-94934c350b64 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:18.560171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d0577-ec1b-4cd7-b2f8-5541506b0985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:18.560898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d0577-ec1b-4cd7-b2f8-5541506b0985 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:18.561247 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d0577-ec1b-4cd7-b2f8-5541506b0985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:18.561610 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d0577-ec1b-4cd7-b2f8-5541506b0985 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:18.563456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d0577-ec1b-4cd7-b2f8-5541506b0985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:18.574642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d0577-ec1b-4cd7-b2f8-5541506b0985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:18.574642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d0577-ec1b-4cd7-b2f8-5541506b0985 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:18.609010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 857/1696] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:18.609010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d0577-ec1b-4cd7-b2f8-5541506b0985 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:18.624662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-de9d0577-ec1b-4cd7-b2f8-5541506b0985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:18.718559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f316ee-fcc7-4db1-ae04-9a0ad83d88b8 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:18.740767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31691c6d-15e6-40b2-89be-7fde9b995474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:18.741408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31691c6d-15e6-40b2-89be-7fde9b995474 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:18.741690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31691c6d-15e6-40b2-89be-7fde9b995474 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:18.741959 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31691c6d-15e6-40b2-89be-7fde9b995474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:18.744049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-31691c6d-15e6-40b2-89be-7fde9b995474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:18.768368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31691c6d-15e6-40b2-89be-7fde9b995474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:18.773735 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31691c6d-15e6-40b2-89be-7fde9b995474 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:18.798834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:18.806169 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d0577-ec1b-4cd7-b2f8-5541506b0985 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:18.814537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 840/1697] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:18.815422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96fa6f-9fbd-4322-82ba-3a8121a7ea18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:18.816585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96fa6f-9fbd-4322-82ba-3a8121a7ea18 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:18.817180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31691c6d-15e6-40b2-89be-7fde9b995474 service nova] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:18.817309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96fa6f-9fbd-4322-82ba-3a8121a7ea18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:18.818002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96fa6f-9fbd-4322-82ba-3a8121a7ea18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:18.856524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31691c6d-15e6-40b2-89be-7fde9b995474 service nova] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:18.858288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96fa6f-9fbd-4322-82ba-3a8121a7ea18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:18.863851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96fa6f-9fbd-4322-82ba-3a8121a7ea18 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:18.870906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41698299-7471-4a1b-9595-2b55ad2ed114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:18.872013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41698299-7471-4a1b-9595-2b55ad2ed114 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:18.872606 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41698299-7471-4a1b-9595-2b55ad2ed114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:18.873271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41698299-7471-4a1b-9595-2b55ad2ed114 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:18.874398 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41698299-7471-4a1b-9595-2b55ad2ed114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:18.886587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41698299-7471-4a1b-9595-2b55ad2ed114 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:18.909925 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 858/1698] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:19.134717 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 841/1699] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:18 2022] POST /identity/v3/projects => generated 367 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:19.135634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96fa6f-9fbd-4322-82ba-3a8121a7ea18 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:19.157463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96fa6f-9fbd-4322-82ba-3a8121a7ea18 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:19.308999 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e984099-22a3-4e92-945b-eae8559831b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:19.312787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e984099-22a3-4e92-945b-eae8559831b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:19.317097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e984099-22a3-4e92-945b-eae8559831b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:19.317389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e984099-22a3-4e92-945b-eae8559831b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:19.320491 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e984099-22a3-4e92-945b-eae8559831b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:19.324582 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e984099-22a3-4e92-945b-eae8559831b9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:19.513551 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41698299-7471-4a1b-9595-2b55ad2ed114 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:19.525018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 859/1700] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:19 2022] POST /identity/v3/users => generated 284 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:31:19.528562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41698299-7471-4a1b-9595-2b55ad2ed114 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:19.543806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc934a4-6951-4dcc-95d1-480970b89f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:19.546125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc934a4-6951-4dcc-95d1-480970b89f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:19.548754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc934a4-6951-4dcc-95d1-480970b89f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:19.549446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc934a4-6951-4dcc-95d1-480970b89f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:19.551853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc934a4-6951-4dcc-95d1-480970b89f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:19.555832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc934a4-6951-4dcc-95d1-480970b89f81 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:19.586892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 842/1701] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:19.588243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e984099-22a3-4e92-945b-eae8559831b9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:19.604947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e984099-22a3-4e92-945b-eae8559831b9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:19.618436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf82b7c-2201-43d7-9a2a-ea44ce58c7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:19.619478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf82b7c-2201-43d7-9a2a-ea44ce58c7eb admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:19.619821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf82b7c-2201-43d7-9a2a-ea44ce58c7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:19.622016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf82b7c-2201-43d7-9a2a-ea44ce58c7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:19.622803 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf82b7c-2201-43d7-9a2a-ea44ce58c7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:19.625118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf82b7c-2201-43d7-9a2a-ea44ce58c7eb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:19.646166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 860/1702] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:19.652028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc934a4-6951-4dcc-95d1-480970b89f81 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:19.677451 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc934a4-6951-4dcc-95d1-480970b89f81 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:19.711002 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75561-85ee-483b-a874-d79b3a8d9877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:19.712403 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75561-85ee-483b-a874-d79b3a8d9877 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:19.715764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75561-85ee-483b-a874-d79b3a8d9877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:19.716915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75561-85ee-483b-a874-d79b3a8d9877 admin admin] PATH_INFO: `/v3/projects/a0759e109ea8424099ef0051ae51df0c/users/c17c6ef06b694caaab905f36975e8bdd/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:19.749700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a75561-85ee-483b-a874-d79b3a8d9877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0759e109ea8424099ef0051ae51df0c, user_id=c17c6ef06b694caaab905f36975e8bdd, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:19.754001 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a75561-85ee-483b-a874-d79b3a8d9877 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:19.886692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 843/1703] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:19 2022] PUT /identity/v3/projects/a0759e109ea8424099ef0051ae51df0c/users/c17c6ef06b694caaab905f36975e8bdd/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:19.897455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ff56a-c7a5-4bab-a2ba-3c902714f960 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:19.898016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ff56a-c7a5-4bab-a2ba-3c902714f960 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:19.898465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ff56a-c7a5-4bab-a2ba-3c902714f960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:19.912814 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75561-85ee-483b-a874-d79b3a8d9877 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:19.916244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-89a75561-85ee-483b-a874-d79b3a8d9877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:19.920266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:20.003526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-931ff56a-c7a5-4bab-a2ba-3c902714f960 None None] MFA Rules not processed for user `c17c6ef06b694caaab905f36975e8bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:20.005805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-931ff56a-c7a5-4bab-a2ba-3c902714f960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:20.091473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:20.144370 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 861/1704] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:20.146596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ff56a-c7a5-4bab-a2ba-3c902714f960 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:20.248510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75561-85ee-483b-a874-d79b3a8d9877 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:20.270505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:20.275185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:20.277392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:20.277691 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] PATH_INFO: `/v3/users/618e8f73d95c487fb1b570d59950f697` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:20.280630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=618e8f73d95c487fb1b570d59950f697)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:20.287049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:20.393638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ff56a-c7a5-4bab-a2ba-3c902714f960 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:20.402314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ad6e5-9e7b-4576-a242-c705586b4ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:20.403117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ad6e5-9e7b-4576-a242-c705586b4ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:20.404174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ad6e5-9e7b-4576-a242-c705586b4ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:20.404531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ad6e5-9e7b-4576-a242-c705586b4ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:20.405250 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ad6e5-9e7b-4576-a242-c705586b4ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:20.409973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ad6e5-9e7b-4576-a242-c705586b4ea9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:20.425370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:20.587117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 862/1705] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:20 2022] POST /identity/v3/projects => generated 367 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:20.591934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ad6e5-9e7b-4576-a242-c705586b4ea9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:20.617558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '618e8f73d95c487fb1b570d59950f697'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.638249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '618e8f73d95c487fb1b570d59950f697'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.644880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '618e8f73d95c487fb1b570d59950f697'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.707961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '618e8f73d95c487fb1b570d59950f697'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.730151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '618e8f73d95c487fb1b570d59950f697'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.748090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:20.764221 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 844/1706] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:19 2022] DELETE /identity/v3/users/618e8f73d95c487fb1b570d59950f697 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:20.764221 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:20.768204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:20.814695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ad6e5-9e7b-4576-a242-c705586b4ea9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:20.924907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d29c7-21d8-4b5f-8805-24966abf07bf admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:20.931375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:20.933182 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:20.934364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:20.938571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] PATH_INFO: `/v3/projects/0dda9e11de064a44b72c72eb82f977ee` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:20.940384 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dda9e11de064a44b72c72eb82f977ee)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:20.943826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:20.946049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc8845-dae3-4429-b78e-9ee95ea27a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:20.947030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc8845-dae3-4429-b78e-9ee95ea27a26 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:20.947501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc8845-dae3-4429-b78e-9ee95ea27a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:20.947983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc8845-dae3-4429-b78e-9ee95ea27a26 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:20.949818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc8845-dae3-4429-b78e-9ee95ea27a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:20.952407 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc8845-dae3-4429-b78e-9ee95ea27a26 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:21.073499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 863/1707] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:20 2022] POST /identity/v3/users => generated 290 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:21.074707 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec416206-8093-4a2d-9197-710ea55eacf1 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.076443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec416206-8093-4a2d-9197-710ea55eacf1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.076443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec416206-8093-4a2d-9197-710ea55eacf1 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.077356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 864/1708] 10.222.0.81 () {54 vars in 912 bytes} [Mon Aug 29 20:31:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:21.080190 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b43cfa-59b4-49d6-8bf5-e6ce419d7683 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.080729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b43cfa-59b4-49d6-8bf5-e6ce419d7683 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.081151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b43cfa-59b4-49d6-8bf5-e6ce419d7683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.112572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dda9e11de064a44b72c72eb82f977ee', 'request_id': 'req-53b1330c-5de8-4107-89c9-44e929ab29f1'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.118931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-22b43cfa-59b4-49d6-8bf5-e6ce419d7683 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:21.122522 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dda9e11de064a44b72c72eb82f977ee', 'request_id': 'req-53b1330c-5de8-4107-89c9-44e929ab29f1'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.123803 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-22b43cfa-59b4-49d6-8bf5-e6ce419d7683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:21.135046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:21.139395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dda9e11de064a44b72c72eb82f977ee', 'request_id': 'req-53b1330c-5de8-4107-89c9-44e929ab29f1'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.216914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] The token cache is being invalidate because project 0dda9e11de064a44b72c72eb82f977ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:21.217300 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.218042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.220884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 845/1709] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:20 2022] DELETE /identity/v3/projects/0dda9e11de064a44b72c72eb82f977ee => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:21.227014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:21.231309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:21.260976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 865/1710] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:21.263911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b43cfa-59b4-49d6-8bf5-e6ce419d7683 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:21.282767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1330c-5de8-4107-89c9-44e929ab29f1 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:21.291091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-22b43cfa-59b4-49d6-8bf5-e6ce419d7683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:21.296214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:21.298597 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.299215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.299640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] PATH_INFO: `/v3/projects/861aa2a15d0840efb5e312142972472e` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.302829 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] RBAC: Authorizing `identity:delete_project(project_id=861aa2a15d0840efb5e312142972472e)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:21.305029 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:21.323759 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b43cfa-59b4-49d6-8bf5-e6ce419d7683 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:21.336313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e19f0-6081-4e3a-85ee-3e901a470b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:21.340477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:21.350558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e19f0-6081-4e3a-85ee-3e901a470b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.350558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e19f0-6081-4e3a-85ee-3e901a470b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.350558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e19f0-6081-4e3a-85ee-3e901a470b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.350558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e19f0-6081-4e3a-85ee-3e901a470b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:21.350558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e19f0-6081-4e3a-85ee-3e901a470b42 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:21.384388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 866/1711] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:21.390479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e7740-d799-426f-9662-af8938275376 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.391822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e7740-d799-426f-9662-af8938275376 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.392178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e7740-d799-426f-9662-af8938275376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.442161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-647e7740-d799-426f-9662-af8938275376 None None] MFA Rules not processed for user `241e34a86aba4c3a92ed9d469e6a205e`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:21.443574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-647e7740-d799-426f-9662-af8938275376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:21.519379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861aa2a15d0840efb5e312142972472e', 'request_id': 'req-9664191b-992c-442c-8444-9f8c94de673c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.542895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861aa2a15d0840efb5e312142972472e', 'request_id': 'req-9664191b-992c-442c-8444-9f8c94de673c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.544718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 867/1712] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:31:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:21.546946 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dc7e3-9061-42d0-bf76-5561de6b0497 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.547288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dc7e3-9061-42d0-bf76-5561de6b0497 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.547635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dc7e3-9061-42d0-bf76-5561de6b0497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.576380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861aa2a15d0840efb5e312142972472e', 'request_id': 'req-9664191b-992c-442c-8444-9f8c94de673c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.586072 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-502dc7e3-9061-42d0-bf76-5561de6b0497 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:21.589691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-502dc7e3-9061-42d0-bf76-5561de6b0497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:21.690794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] The token cache is being invalidate because project 861aa2a15d0840efb5e312142972472e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:21.693845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.698367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.705254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 846/1713] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:21 2022] DELETE /identity/v3/projects/861aa2a15d0840efb5e312142972472e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:21.705254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:21.711029 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:21.729271 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 868/1714] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:21.730810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dc7e3-9061-42d0-bf76-5561de6b0497 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:21.735027 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-502dc7e3-9061-42d0-bf76-5561de6b0497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:21.767090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dc7e3-9061-42d0-bf76-5561de6b0497 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:21.786507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6b9c9-a6c4-4055-a740-ddddaeb8d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:21.787299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6b9c9-a6c4-4055-a740-ddddaeb8d0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.787765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6b9c9-a6c4-4055-a740-ddddaeb8d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.791244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6b9c9-a6c4-4055-a740-ddddaeb8d0f0 admin admin] PATH_INFO: `/v3/projects/590eb8f85e084ae28a9863a0788626b1/users/688ea3a8a8f24ef1bbb47801ea5a1051/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.824060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6b9c9-a6c4-4055-a740-ddddaeb8d0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=590eb8f85e084ae28a9863a0788626b1, user_id=688ea3a8a8f24ef1bbb47801ea5a1051, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:21.827248 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6b9c9-a6c4-4055-a740-ddddaeb8d0f0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:21.931235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 869/1715] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:21 2022] PUT /identity/v3/projects/590eb8f85e084ae28a9863a0788626b1/users/688ea3a8a8f24ef1bbb47801ea5a1051/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:21.936297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6b9c9-a6c4-4055-a740-ddddaeb8d0f0 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:21.940954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-07c6b9c9-a6c4-4055-a740-ddddaeb8d0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:22.019875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664191b-992c-442c-8444-9f8c94de673c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:22.062689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:22.117777 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6b9c9-a6c4-4055-a740-ddddaeb8d0f0 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:22.131305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccda52-6446-4c74-a0d6-2573fd0431f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:22.132717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccda52-6446-4c74-a0d6-2573fd0431f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:22.132895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccda52-6446-4c74-a0d6-2573fd0431f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:22.133659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccda52-6446-4c74-a0d6-2573fd0431f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:22.137991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a3ccda52-6446-4c74-a0d6-2573fd0431f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:22.164138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccda52-6446-4c74-a0d6-2573fd0431f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:22.165660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccda52-6446-4c74-a0d6-2573fd0431f5 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:22.177496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e393e3e-5821-47a3-9a79-df09a97f4248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:22.179549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e393e3e-5821-47a3-9a79-df09a97f4248 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:22.179989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e393e3e-5821-47a3-9a79-df09a97f4248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:22.180344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e393e3e-5821-47a3-9a79-df09a97f4248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:22.186142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5e393e3e-5821-47a3-9a79-df09a97f4248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:22.190837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 870/1716] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:22.191734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccda52-6446-4c74-a0d6-2573fd0431f5 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:22.205222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a3ccda52-6446-4c74-a0d6-2573fd0431f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:22.327262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:22.369996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccda52-6446-4c74-a0d6-2573fd0431f5 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:22.390211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:22.392567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:22.392855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:22.393131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] PATH_INFO: `/v3/users/8ee6a738a4384502bef539b34862a8eb` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:22.396009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee6a738a4384502bef539b34862a8eb)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:22.399845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:22.401869 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e393e3e-5821-47a3-9a79-df09a97f4248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:22.411291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e393e3e-5821-47a3-9a79-df09a97f4248 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:22.436566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 847/1717] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:22.440883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfefc1-2f41-4ca4-ab34-f80dffacea67 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:22.441162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfefc1-2f41-4ca4-ab34-f80dffacea67 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:22.442751 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfefc1-2f41-4ca4-ab34-f80dffacea67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:22.488194 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f3cfefc1-2f41-4ca4-ab34-f80dffacea67 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:22.489681 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f3cfefc1-2f41-4ca4-ab34-f80dffacea67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:22.498724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 848/1718] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:22.499715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfefc1-2f41-4ca4-ab34-f80dffacea67 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:22.511428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfefc1-2f41-4ca4-ab34-f80dffacea67 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:22.517361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bc58b-9d6c-4d7d-ac2b-a4b637953de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:22.518783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bc58b-9d6c-4d7d-ac2b-a4b637953de5 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:22.518783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bc58b-9d6c-4d7d-ac2b-a4b637953de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:22.519020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bc58b-9d6c-4d7d-ac2b-a4b637953de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:22.519815 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bc58b-9d6c-4d7d-ac2b-a4b637953de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:22.522156 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bc58b-9d6c-4d7d-ac2b-a4b637953de5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:22.539945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 849/1719] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:22.541863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce30a5-7c91-4d42-8a44-2367c093e800 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:22.542372 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce30a5-7c91-4d42-8a44-2367c093e800 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:22.542802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce30a5-7c91-4d42-8a44-2367c093e800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:22.612018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f6ce30a5-7c91-4d42-8a44-2367c093e800 None None] MFA Rules not processed for user `948542e68a5c499681d5faf8507cebe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:22.613470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f6ce30a5-7c91-4d42-8a44-2367c093e800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:22.727302 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee6a738a4384502bef539b34862a8eb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.763925 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee6a738a4384502bef539b34862a8eb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.770253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee6a738a4384502bef539b34862a8eb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.771771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee6a738a4384502bef539b34862a8eb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.789097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee6a738a4384502bef539b34862a8eb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.821794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 850/1720] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:22.823503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce30a5-7c91-4d42-8a44-2367c093e800 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:22.827914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f6ce30a5-7c91-4d42-8a44-2367c093e800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:22.868553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce30a5-7c91-4d42-8a44-2367c093e800 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:22.885189 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb27b89-6209-4121-a898-3ec1bea49872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:22.890086 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb27b89-6209-4121-a898-3ec1bea49872 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:22.890448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb27b89-6209-4121-a898-3ec1bea49872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:22.890725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb27b89-6209-4121-a898-3ec1bea49872 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:22.891282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 871/1721] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:22 2022] DELETE /identity/v3/users/8ee6a738a4384502bef539b34862a8eb => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:22.891455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb27b89-6209-4121-a898-3ec1bea49872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:22.892088 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:22.895399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb27b89-6209-4121-a898-3ec1bea49872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:22.898271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb27b89-6209-4121-a898-3ec1bea49872 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:22.901596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:22.940483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 851/1722] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:22.940483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7525f-5fbb-47e7-90d2-68cac157903d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:22.941142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7525f-5fbb-47e7-90d2-68cac157903d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:22.942088 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7525f-5fbb-47e7-90d2-68cac157903d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:22.992177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-51f7525f-5fbb-47e7-90d2-68cac157903d None None] MFA Rules not processed for user `948542e68a5c499681d5faf8507cebe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:22.998438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-51f7525f-5fbb-47e7-90d2-68cac157903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:23.080875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:23.116107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96750a0-8182-4405-acca-d091e4edb816 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:23.123775 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eea47-efd7-4f0a-8bf7-1ce3b88e6ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:23.124560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eea47-efd7-4f0a-8bf7-1ce3b88e6ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:23.124838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eea47-efd7-4f0a-8bf7-1ce3b88e6ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:23.125105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eea47-efd7-4f0a-8bf7-1ce3b88e6ddd admin admin] PATH_INFO: `/v3/projects/590eb8f85e084ae28a9863a0788626b1/users/688ea3a8a8f24ef1bbb47801ea5a1051/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:23.131911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696eea47-efd7-4f0a-8bf7-1ce3b88e6ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=590eb8f85e084ae28a9863a0788626b1, user_id=688ea3a8a8f24ef1bbb47801ea5a1051, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:23.137293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696eea47-efd7-4f0a-8bf7-1ce3b88e6ddd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:23.161108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 872/1723] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:22 2022] PUT /identity/v3/projects/590eb8f85e084ae28a9863a0788626b1/users/688ea3a8a8f24ef1bbb47801ea5a1051/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:23.161108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eea47-efd7-4f0a-8bf7-1ce3b88e6ddd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:23.218955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 852/1724] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:23.220349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a937ac-f2e2-434c-904c-8e83cfd8613c None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:23.220665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a937ac-f2e2-434c-904c-8e83cfd8613c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:23.220980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a937ac-f2e2-434c-904c-8e83cfd8613c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:23.290878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-c9a937ac-f2e2-434c-904c-8e83cfd8613c None None] MFA Rules not processed for user `688ea3a8a8f24ef1bbb47801ea5a1051`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:23.292447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c9a937ac-f2e2-434c-904c-8e83cfd8613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:23.314395 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eea47-efd7-4f0a-8bf7-1ce3b88e6ddd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:23.328154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1a634-01b9-499a-9080-35c7e68c42a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:23.329767 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1a634-01b9-499a-9080-35c7e68c42a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:23.330286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1a634-01b9-499a-9080-35c7e68c42a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:23.330805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1a634-01b9-499a-9080-35c7e68c42a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:23.332886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1a634-01b9-499a-9080-35c7e68c42a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:23.335570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1a634-01b9-499a-9080-35c7e68c42a7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:23.476065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 853/1725] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:23.477006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a937ac-f2e2-434c-904c-8e83cfd8613c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:23.479748 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c9a937ac-f2e2-434c-904c-8e83cfd8613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:23.564017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 873/1726] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:23 2022] POST /identity/v3/projects => generated 405 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:23.575334 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1a634-01b9-499a-9080-35c7e68c42a7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:23.575334 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bcc1a634-01b9-499a-9080-35c7e68c42a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:23.649903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a937ac-f2e2-434c-904c-8e83cfd8613c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:23.691543 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:23.737433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1a634-01b9-499a-9080-35c7e68c42a7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:23.744261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cb993-051d-433b-8478-1d06b9d086fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:23.746695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cb993-051d-433b-8478-1d06b9d086fb service placement] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:23.747056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cb993-051d-433b-8478-1d06b9d086fb service placement] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:23.747536 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cb993-051d-433b-8478-1d06b9d086fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:23.749648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d95cb993-051d-433b-8478-1d06b9d086fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:23.767696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cb993-051d-433b-8478-1d06b9d086fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:23.769018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cb993-051d-433b-8478-1d06b9d086fb service placement] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:23.786904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1754c-4955-4245-9951-f7b48310a8f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:23.788130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1754c-4955-4245-9951-f7b48310a8f7 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:23.788558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1754c-4955-4245-9951-f7b48310a8f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:23.789151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1754c-4955-4245-9951-f7b48310a8f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:23.812020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 874/1727] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:23.814437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cb993-051d-433b-8478-1d06b9d086fb service placement] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:23.820036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d95cb993-051d-433b-8478-1d06b9d086fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:23.930133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1754c-4955-4245-9951-f7b48310a8f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:23.931854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1754c-4955-4245-9951-f7b48310a8f7 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:23.960149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 854/1728] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:23.961346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1754c-4955-4245-9951-f7b48310a8f7 service nova] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:23.967501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c4e1754c-4955-4245-9951-f7b48310a8f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:24.117753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cb993-051d-433b-8478-1d06b9d086fb service placement] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:24.131352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee0774-f5de-44c6-b7d5-87879d1ce1f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:24.132292 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee0774-f5de-44c6-b7d5-87879d1ce1f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:24.132716 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee0774-f5de-44c6-b7d5-87879d1ce1f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:24.133353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee0774-f5de-44c6-b7d5-87879d1ce1f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:24.157267 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1754c-4955-4245-9951-f7b48310a8f7 service nova] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:24.173752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9ce5b-e721-41cc-b49e-d4b2979261bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:24.174705 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ce5b-e721-41cc-b49e-d4b2979261bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:24.174705 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ce5b-e721-41cc-b49e-d4b2979261bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:24.175025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ce5b-e721-41cc-b49e-d4b2979261bc admin admin] PATH_INFO: `/v3/projects/1a9c34dd18764d8ca1b131c549fd5e7c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:24.178951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9ce5b-e721-41cc-b49e-d4b2979261bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9c34dd18764d8ca1b131c549fd5e7c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:24.184017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9ce5b-e721-41cc-b49e-d4b2979261bc admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:24.299396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:24.435717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee0774-f5de-44c6-b7d5-87879d1ce1f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:24.437802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee0774-f5de-44c6-b7d5-87879d1ce1f9 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:24.465225 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 875/1729] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:24.467367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee0774-f5de-44c6-b7d5-87879d1ce1f9 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:24.468338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2af9ce5b-e721-41cc-b49e-d4b2979261bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9c34dd18764d8ca1b131c549fd5e7c', 'request_id': 'req-2af9ce5b-e721-41cc-b49e-d4b2979261bc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:24.497442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2af9ce5b-e721-41cc-b49e-d4b2979261bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9c34dd18764d8ca1b131c549fd5e7c', 'request_id': 'req-2af9ce5b-e721-41cc-b49e-d4b2979261bc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:24.497614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee0774-f5de-44c6-b7d5-87879d1ce1f9 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:24.523972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2af9ce5b-e721-41cc-b49e-d4b2979261bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9c34dd18764d8ca1b131c549fd5e7c', 'request_id': 'req-2af9ce5b-e721-41cc-b49e-d4b2979261bc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:24.639400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b514b3a-8411-4841-b990-5a4fb441faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:24.640326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b514b3a-8411-4841-b990-5a4fb441faff admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:24.641691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b514b3a-8411-4841-b990-5a4fb441faff admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:24.643440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b514b3a-8411-4841-b990-5a4fb441faff admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:24.645909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b514b3a-8411-4841-b990-5a4fb441faff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:24.660223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b514b3a-8411-4841-b990-5a4fb441faff admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:24.666399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2af9ce5b-e721-41cc-b49e-d4b2979261bc admin admin] The token cache is being invalidate because project 1a9c34dd18764d8ca1b131c549fd5e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:24.668433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2af9ce5b-e721-41cc-b49e-d4b2979261bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:24.675048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2af9ce5b-e721-41cc-b49e-d4b2979261bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:24.690112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 855/1730] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:23 2022] DELETE /identity/v3/projects/1a9c34dd18764d8ca1b131c549fd5e7c => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:24.714359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f720c-051b-49a8-b8bf-aa190835b10d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:24.730594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f720c-051b-49a8-b8bf-aa190835b10d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:24.731953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f720c-051b-49a8-b8bf-aa190835b10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:24.819713 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 876/1731] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:24 2022] POST /identity/v3/users => generated 303 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:24.820715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b514b3a-8411-4841-b990-5a4fb441faff admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:24.831678 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5b514b3a-8411-4841-b990-5a4fb441faff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:24.851810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-774f720c-051b-49a8-b8bf-aa190835b10d None None] MFA Rules not processed for user `63b7b33a0dd64d44ba980122f83eba4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:24.853212 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-774f720c-051b-49a8-b8bf-aa190835b10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:24.867314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:25.051399 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b514b3a-8411-4841-b990-5a4fb441faff admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:25.077593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8c979-6031-4644-8ce1-1f815529b0a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:25.078890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8c979-6031-4644-8ce1-1f815529b0a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.079520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8c979-6031-4644-8ce1-1f815529b0a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.080249 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8c979-6031-4644-8ce1-1f815529b0a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.093229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d9f8c979-6031-4644-8ce1-1f815529b0a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:25.125459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 856/1732] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:25.127031 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f720c-051b-49a8-b8bf-aa190835b10d None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:25.135954 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-774f720c-051b-49a8-b8bf-aa190835b10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:25.188365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f720c-051b-49a8-b8bf-aa190835b10d None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:25.210576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:25.211610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.212073 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.212531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] PATH_INFO: `/v3/users/cb3c13c8bd58438dabd38d223743b49a` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.222321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3c13c8bd58438dabd38d223743b49a)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:25.225881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:25.264961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:25.310521 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8c979-6031-4644-8ce1-1f815529b0a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:25.314069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8c979-6031-4644-8ce1-1f815529b0a0 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:25.328096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:25.356958 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 877/1733] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:25.360779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8c979-6031-4644-8ce1-1f815529b0a0 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:25.371858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d9f8c979-6031-4644-8ce1-1f815529b0a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:25.452322 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8c979-6031-4644-8ce1-1f815529b0a0 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:25.470694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b7c9a-0333-4b40-b0e5-469748b7c659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:25.471345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b7c9a-0333-4b40-b0e5-469748b7c659 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.471633 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b7c9a-0333-4b40-b0e5-469748b7c659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.471909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b7c9a-0333-4b40-b0e5-469748b7c659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.480645 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b7c9a-0333-4b40-b0e5-469748b7c659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:25.487343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b7c9a-0333-4b40-b0e5-469748b7c659 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:25.522663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3c13c8bd58438dabd38d223743b49a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:25.523526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 878/1734] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:25.527849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971f99a-e6ea-4894-9f44-4cb91c36ca89 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.533112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971f99a-e6ea-4894-9f44-4cb91c36ca89 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.533112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971f99a-e6ea-4894-9f44-4cb91c36ca89 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.533112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 879/1735] 10.222.0.81 () {54 vars in 912 bytes} [Mon Aug 29 20:31:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:25.537339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3c13c8bd58438dabd38d223743b49a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:25.538501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3c13c8bd58438dabd38d223743b49a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:25.545116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971f99a-e6ea-4894-9f44-4cb91c36ca89 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:25.548568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e971f99a-e6ea-4894-9f44-4cb91c36ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:25.616762 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3c13c8bd58438dabd38d223743b49a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:25.645667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3c13c8bd58438dabd38d223743b49a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:25.660774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 857/1736] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:25 2022] DELETE /identity/v3/users/cb3c13c8bd58438dabd38d223743b49a => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:25.664207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:25.667684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:25.757563 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971f99a-e6ea-4894-9f44-4cb91c36ca89 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:25.836594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99175c3-7b93-49e9-878a-0f780ea2562a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:25.855048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4fce5-aa21-4641-bfe4-caf45d0fbee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:25.856407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4fce5-aa21-4641-bfe4-caf45d0fbee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.859079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4fce5-aa21-4641-bfe4-caf45d0fbee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.859616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4fce5-aa21-4641-bfe4-caf45d0fbee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.860500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4fce5-aa21-4641-bfe4-caf45d0fbee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:25.862423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4fce5-aa21-4641-bfe4-caf45d0fbee9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:25.899818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 858/1737] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:25.899818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885aaf3-dfae-400d-943f-427c1802611f None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.899818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885aaf3-dfae-400d-943f-427c1802611f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.899818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885aaf3-dfae-400d-943f-427c1802611f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.945379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-b885aaf3-dfae-400d-943f-427c1802611f None None] MFA Rules not processed for user `241e34a86aba4c3a92ed9d469e6a205e`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:25.946891 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b885aaf3-dfae-400d-943f-427c1802611f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:25.955221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6e677-56d6-4460-a94f-3cf8ad1e4697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:25.955862 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6e677-56d6-4460-a94f-3cf8ad1e4697 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.956144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6e677-56d6-4460-a94f-3cf8ad1e4697 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.956499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6e677-56d6-4460-a94f-3cf8ad1e4697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.967029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b8b6e677-56d6-4460-a94f-3cf8ad1e4697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.109516 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6e677-56d6-4460-a94f-3cf8ad1e4697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:26.113655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6e677-56d6-4460-a94f-3cf8ad1e4697 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:26.139863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 859/1738] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:31:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:26.140774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885aaf3-dfae-400d-943f-427c1802611f None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:26.142254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b885aaf3-dfae-400d-943f-427c1802611f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.172671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 880/1739] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:26.174614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf72ab-0605-4a3b-b0b0-68724d5c0df2 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.174907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf72ab-0605-4a3b-b0b0-68724d5c0df2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.175189 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf72ab-0605-4a3b-b0b0-68724d5c0df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.192856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885aaf3-dfae-400d-943f-427c1802611f None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:26.212363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:26.213728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.217843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.218621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] PATH_INFO: `/v3/projects/3048f683e5fc4cdd86e729925fdadddc` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.221925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3048f683e5fc4cdd86e729925fdadddc)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:26.228165 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:26.295269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4daf72ab-0605-4a3b-b0b0-68724d5c0df2 None None] MFA Rules not processed for user `67a947140e4c4075acd70bbb57022baa`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:26.301224 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4daf72ab-0605-4a3b-b0b0-68724d5c0df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.385482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:26.536845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 881/1740] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:26.537865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf72ab-0605-4a3b-b0b0-68724d5c0df2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:26.568077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf72ab-0605-4a3b-b0b0-68724d5c0df2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:26.599490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ed662-c0d0-4410-a97c-11d662e23cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:26.600118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ed662-c0d0-4410-a97c-11d662e23cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.600386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ed662-c0d0-4410-a97c-11d662e23cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.600659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ed662-c0d0-4410-a97c-11d662e23cfd admin admin] PATH_INFO: `/v3/projects/ab531119751c4a40be30136ab7d63836/users/916c6069352e4fe9b3a4ad6a29a2d58d/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.601855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:26.643829 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3048f683e5fc4cdd86e729925fdadddc', 'request_id': 'req-860d9a46-204f-48bf-9114-a35d5c31db94'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:26.652078 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3048f683e5fc4cdd86e729925fdadddc', 'request_id': 'req-860d9a46-204f-48bf-9114-a35d5c31db94'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:26.661956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3048f683e5fc4cdd86e729925fdadddc', 'request_id': 'req-860d9a46-204f-48bf-9114-a35d5c31db94'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:26.684957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ed662-c0d0-4410-a97c-11d662e23cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab531119751c4a40be30136ab7d63836, user_id=916c6069352e4fe9b3a4ad6a29a2d58d, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:26.695162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ed662-c0d0-4410-a97c-11d662e23cfd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:26.781256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] The token cache is being invalidate because project 3048f683e5fc4cdd86e729925fdadddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:26.782441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:26.783191 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:26.787234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 860/1741] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:26 2022] DELETE /identity/v3/projects/3048f683e5fc4cdd86e729925fdadddc => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:26.788128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:26.791067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.866832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d9a46-204f-48bf-9114-a35d5c31db94 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:26.873006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca53396-a065-42cb-b8de-be4e9abf2486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:26.873914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca53396-a065-42cb-b8de-be4e9abf2486 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.874356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca53396-a065-42cb-b8de-be4e9abf2486 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.874759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca53396-a065-42cb-b8de-be4e9abf2486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.878468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-dca53396-a065-42cb-b8de-be4e9abf2486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.897039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 882/1742] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:26 2022] PUT /identity/v3/projects/ab531119751c4a40be30136ab7d63836/users/916c6069352e4fe9b3a4ad6a29a2d58d/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:26.897619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ed662-c0d0-4410-a97c-11d662e23cfd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:26.900601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca53396-a065-42cb-b8de-be4e9abf2486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:26.903183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca53396-a065-42cb-b8de-be4e9abf2486 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:26.910608 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f68ed662-c0d0-4410-a97c-11d662e23cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.925888 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 861/1743] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:26.927059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca53396-a065-42cb-b8de-be4e9abf2486 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:26.928750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-dca53396-a065-42cb-b8de-be4e9abf2486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:27.101409 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ed662-c0d0-4410-a97c-11d662e23cfd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:27.119033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2006c42-35f5-4c50-9737-8140573213ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:27.119869 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2006c42-35f5-4c50-9737-8140573213ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:27.120333 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2006c42-35f5-4c50-9737-8140573213ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:27.120615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2006c42-35f5-4c50-9737-8140573213ee admin admin] PATH_INFO: `/v3/projects/f1b97afe6ce8457ebd6abdd915e51aa4` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:27.122119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2006c42-35f5-4c50-9737-8140573213ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b97afe6ce8457ebd6abdd915e51aa4)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:27.124810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2006c42-35f5-4c50-9737-8140573213ee admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:27.131409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca53396-a065-42cb-b8de-be4e9abf2486 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:27.288456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2a460-9c6e-4f99-a8d1-a066da63e2b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:27.289106 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a460-9c6e-4f99-a8d1-a066da63e2b8 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:27.289391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a460-9c6e-4f99-a8d1-a066da63e2b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:27.289667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a460-9c6e-4f99-a8d1-a066da63e2b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:27.294896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-03f2a460-9c6e-4f99-a8d1-a066da63e2b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:27.344602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2006c42-35f5-4c50-9737-8140573213ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b97afe6ce8457ebd6abdd915e51aa4', 'request_id': 'req-c2006c42-35f5-4c50-9737-8140573213ee'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:27.378932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2006c42-35f5-4c50-9737-8140573213ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b97afe6ce8457ebd6abdd915e51aa4', 'request_id': 'req-c2006c42-35f5-4c50-9737-8140573213ee'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:27.535798 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2006c42-35f5-4c50-9737-8140573213ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b97afe6ce8457ebd6abdd915e51aa4', 'request_id': 'req-c2006c42-35f5-4c50-9737-8140573213ee'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:27.556872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2006c42-35f5-4c50-9737-8140573213ee admin admin] The token cache is being invalidate because project f1b97afe6ce8457ebd6abdd915e51aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:27.558501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2006c42-35f5-4c50-9737-8140573213ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:27.561824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2006c42-35f5-4c50-9737-8140573213ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:27.564193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 883/1744] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:26 2022] DELETE /identity/v3/projects/f1b97afe6ce8457ebd6abdd915e51aa4 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:27.572474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcf819-47e5-4c4c-b3bd-9a1359b58a3b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:27.574150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcf819-47e5-4c4c-b3bd-9a1359b58a3b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:27.574741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcf819-47e5-4c4c-b3bd-9a1359b58a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:27.592178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2a460-9c6e-4f99-a8d1-a066da63e2b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:27.594025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2a460-9c6e-4f99-a8d1-a066da63e2b8 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:27.626434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 862/1745] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:27.628552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81960f2-15b0-4dd7-9880-f8b0ace7a88b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:27.628845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81960f2-15b0-4dd7-9880-f8b0ace7a88b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:27.629153 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81960f2-15b0-4dd7-9880-f8b0ace7a88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:27.641383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-91bcf819-47e5-4c4c-b3bd-9a1359b58a3b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:27.654407 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-91bcf819-47e5-4c4c-b3bd-9a1359b58a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:27.736856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a81960f2-15b0-4dd7-9880-f8b0ace7a88b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:27.737839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:27.739749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a81960f2-15b0-4dd7-9880-f8b0ace7a88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:27.906298 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 884/1746] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:27.906298 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5cbd2-d1f9-40a8-9444-c58cf0ade0e4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:27.906298 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5cbd2-d1f9-40a8-9444-c58cf0ade0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:27.906298 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5cbd2-d1f9-40a8-9444-c58cf0ade0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:27.975227 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 863/1747] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:27.981676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1b804-95da-487f-b021-20c159b0f646 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:27.982042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1b804-95da-487f-b021-20c159b0f646 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:27.994128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1b804-95da-487f-b021-20c159b0f646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.002175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-10a5cbd2-d1f9-40a8-9444-c58cf0ade0e4 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:28.003896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-10a5cbd2-d1f9-40a8-9444-c58cf0ade0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:28.109020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 885/1748] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:28.111300 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5cbd2-d1f9-40a8-9444-c58cf0ade0e4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:28.117637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-10a5cbd2-d1f9-40a8-9444-c58cf0ade0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:28.128283 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-38a1b804-95da-487f-b021-20c159b0f646 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:28.129845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-38a1b804-95da-487f-b021-20c159b0f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:28.142878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 864/1749] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:28.144246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8071d5-d127-4865-ae3b-3952591b6a14 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.144540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8071d5-d127-4865-ae3b-3952591b6a14 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.145019 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8071d5-d127-4865-ae3b-3952591b6a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.170806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ff8071d5-d127-4865-ae3b-3952591b6a14 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:28.172241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ff8071d5-d127-4865-ae3b-3952591b6a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:28.223504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 865/1750] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:28.224496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8071d5-d127-4865-ae3b-3952591b6a14 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:28.264383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5cbd2-d1f9-40a8-9444-c58cf0ade0e4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:28.282549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056df4b-07bc-448d-8abe-961cedbb117e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:28.285166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8071d5-d127-4865-ae3b-3952591b6a14 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:28.294932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056df4b-07bc-448d-8abe-961cedbb117e service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.295289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056df4b-07bc-448d-8abe-961cedbb117e service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.300035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056df4b-07bc-448d-8abe-961cedbb117e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.313044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da59e5-1039-4544-b04e-73a31c502555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:28.316673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da59e5-1039-4544-b04e-73a31c502555 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.318016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da59e5-1039-4544-b04e-73a31c502555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.318332 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da59e5-1039-4544-b04e-73a31c502555 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.319052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da59e5-1039-4544-b04e-73a31c502555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:28.319365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da59e5-1039-4544-b04e-73a31c502555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:28.333898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da59e5-1039-4544-b04e-73a31c502555 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:28.367881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056df4b-07bc-448d-8abe-961cedbb117e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:28.383692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056df4b-07bc-448d-8abe-961cedbb117e service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:28.409447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 866/1751] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:28.416939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e68fa2-7c58-4d15-99a3-156b15a8fe28 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.419455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e68fa2-7c58-4d15-99a3-156b15a8fe28 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.419835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e68fa2-7c58-4d15-99a3-156b15a8fe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.489688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 886/1752] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:28.500382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056df4b-07bc-448d-8abe-961cedbb117e service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:28.521071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-54e68fa2-7c58-4d15-99a3-156b15a8fe28 None None] MFA Rules not processed for user `948542e68a5c499681d5faf8507cebe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:28.527349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-54e68fa2-7c58-4d15-99a3-156b15a8fe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:28.535826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056df4b-07bc-448d-8abe-961cedbb117e service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:28.549211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67a988-bd1f-412b-8306-db410c27d5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:28.549843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67a988-bd1f-412b-8306-db410c27d5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.550118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67a988-bd1f-412b-8306-db410c27d5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.550422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67a988-bd1f-412b-8306-db410c27d5e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.554455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67a988-bd1f-412b-8306-db410c27d5e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:28.555617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67a988-bd1f-412b-8306-db410c27d5e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:28.557947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67a988-bd1f-412b-8306-db410c27d5e1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:28.597083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 887/1753] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:28.597083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67a988-bd1f-412b-8306-db410c27d5e1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:28.611816 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67a988-bd1f-412b-8306-db410c27d5e1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:28.618588 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634102b7-7043-414d-a3cf-46a79318507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:28.619570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634102b7-7043-414d-a3cf-46a79318507d admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.620031 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634102b7-7043-414d-a3cf-46a79318507d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.620499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634102b7-7043-414d-a3cf-46a79318507d admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.621189 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634102b7-7043-414d-a3cf-46a79318507d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:28.623311 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634102b7-7043-414d-a3cf-46a79318507d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:28.678049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:28.757405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 888/1754] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:28 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:28.759414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634102b7-7043-414d-a3cf-46a79318507d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:28.832850 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 867/1755] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:28.834177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e68fa2-7c58-4d15-99a3-156b15a8fe28 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:28.886346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e68fa2-7c58-4d15-99a3-156b15a8fe28 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:28.917075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634102b7-7043-414d-a3cf-46a79318507d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:28.924789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac81572-726d-483f-8e47-11ac243fdd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:28.925705 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac81572-726d-483f-8e47-11ac243fdd0e admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.925996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac81572-726d-483f-8e47-11ac243fdd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.926387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac81572-726d-483f-8e47-11ac243fdd0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.927929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac81572-726d-483f-8e47-11ac243fdd0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:28.931738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac81572-726d-483f-8e47-11ac243fdd0e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.052444 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22ccab-144e-4e66-ab2d-dd5c77ce5c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:29.053241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22ccab-144e-4e66-ab2d-dd5c77ce5c55 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.053667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22ccab-144e-4e66-ab2d-dd5c77ce5c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.054014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22ccab-144e-4e66-ab2d-dd5c77ce5c55 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.054919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22ccab-144e-4e66-ab2d-dd5c77ce5c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:29.063865 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22ccab-144e-4e66-ab2d-dd5c77ce5c55 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.085399 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 889/1756] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:28 2022] POST /identity/v3/projects => generated 363 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:29.090157 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac81572-726d-483f-8e47-11ac243fdd0e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:29.164427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 868/1757] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:28 2022] POST /identity/v3/users => generated 294 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:29.169287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22ccab-144e-4e66-ab2d-dd5c77ce5c55 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:29.226095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22ccab-144e-4e66-ab2d-dd5c77ce5c55 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:29.309353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac81572-726d-483f-8e47-11ac243fdd0e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:29.324744 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e803c-5275-4392-bfd8-08da1536c142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:29.325934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e803c-5275-4392-bfd8-08da1536c142 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.326528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e803c-5275-4392-bfd8-08da1536c142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.327240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e803c-5275-4392-bfd8-08da1536c142 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.329884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e803c-5275-4392-bfd8-08da1536c142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:29.335616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e803c-5275-4392-bfd8-08da1536c142 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.395742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e582e89-7db3-4100-82f8-19c4e5d52968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:29.398477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582e89-7db3-4100-82f8-19c4e5d52968 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.398818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582e89-7db3-4100-82f8-19c4e5d52968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.399096 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582e89-7db3-4100-82f8-19c4e5d52968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.401539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e582e89-7db3-4100-82f8-19c4e5d52968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:29.431170 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e582e89-7db3-4100-82f8-19c4e5d52968 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.473116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 869/1758] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:29.480994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e582e89-7db3-4100-82f8-19c4e5d52968 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:29.507714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e582e89-7db3-4100-82f8-19c4e5d52968 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:29.528257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 890/1759] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:29 2022] POST /identity/v3/users => generated 282 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:31:29.532843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e803c-5275-4392-bfd8-08da1536c142 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:29.548811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fed3f4-b93a-45cd-84ea-aefc4101c962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:29.556590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fed3f4-b93a-45cd-84ea-aefc4101c962 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.559358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fed3f4-b93a-45cd-84ea-aefc4101c962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.560899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fed3f4-b93a-45cd-84ea-aefc4101c962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.563132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fed3f4-b93a-45cd-84ea-aefc4101c962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:29.570639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fed3f4-b93a-45cd-84ea-aefc4101c962 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.573232 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e803c-5275-4392-bfd8-08da1536c142 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:29.594915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24841a-ad5a-4bda-bf26-6dd588d03130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:29.595566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24841a-ad5a-4bda-bf26-6dd588d03130 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.595849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24841a-ad5a-4bda-bf26-6dd588d03130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.596147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24841a-ad5a-4bda-bf26-6dd588d03130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.596762 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24841a-ad5a-4bda-bf26-6dd588d03130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:29.598402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24841a-ad5a-4bda-bf26-6dd588d03130 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.617470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 870/1760] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:29.624554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fed3f4-b93a-45cd-84ea-aefc4101c962 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:29.653252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fed3f4-b93a-45cd-84ea-aefc4101c962 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:29.657624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 891/1761] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:29.660144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24841a-ad5a-4bda-bf26-6dd588d03130 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:29.665081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d855c1-3172-4349-9818-b5750a2d117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:29.669438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d855c1-3172-4349-9818-b5750a2d117b admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.669856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d855c1-3172-4349-9818-b5750a2d117b admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.670754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d855c1-3172-4349-9818-b5750a2d117b admin admin] PATH_INFO: `/v3/projects/de65a6ffca1d424881e8281482f6a936/users/c2a38c4081e34b569d39ac5958fa4e7f/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.687237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24841a-ad5a-4bda-bf26-6dd588d03130 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:29.700517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19260c64-deab-4d98-8553-bb41d789c068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:29.702651 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19260c64-deab-4d98-8553-bb41d789c068 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.702946 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19260c64-deab-4d98-8553-bb41d789c068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.704638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19260c64-deab-4d98-8553-bb41d789c068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.705354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19260c64-deab-4d98-8553-bb41d789c068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:29.710945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d855c1-3172-4349-9818-b5750a2d117b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de65a6ffca1d424881e8281482f6a936, user_id=c2a38c4081e34b569d39ac5958fa4e7f, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:29.711494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19260c64-deab-4d98-8553-bb41d789c068 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.719304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d855c1-3172-4349-9818-b5750a2d117b admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.741348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 892/1762] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:29.743987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19260c64-deab-4d98-8553-bb41d789c068 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:29.769118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19260c64-deab-4d98-8553-bb41d789c068 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:29.779108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4f20-9442-4037-851d-24a77e9c57b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:29.783061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4f20-9442-4037-851d-24a77e9c57b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.783061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4f20-9442-4037-851d-24a77e9c57b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.783061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4f20-9442-4037-851d-24a77e9c57b7 admin admin] PATH_INFO: `/v3/projects/0dedcd1a31f74c2abba52aeb124e738b/users/3fd8e01d97e547bc95be35a034730e21/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.809981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b4f20-9442-4037-851d-24a77e9c57b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dedcd1a31f74c2abba52aeb124e738b, user_id=3fd8e01d97e547bc95be35a034730e21, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:29.813391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b4f20-9442-4037-851d-24a77e9c57b7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.906081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 871/1763] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:29 2022] PUT /identity/v3/projects/de65a6ffca1d424881e8281482f6a936/users/c2a38c4081e34b569d39ac5958fa4e7f/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:29.917866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a77134-ffac-4583-afc8-c242bec23340 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.918147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a77134-ffac-4583-afc8-c242bec23340 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.918922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a77134-ffac-4583-afc8-c242bec23340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.927489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 893/1764] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:29 2022] PUT /identity/v3/projects/0dedcd1a31f74c2abba52aeb124e738b/users/3fd8e01d97e547bc95be35a034730e21/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:29.941902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb72a1-82ad-433c-a59d-569426ffb21b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.942190 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb72a1-82ad-433c-a59d-569426ffb21b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.942487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb72a1-82ad-433c-a59d-569426ffb21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.978599 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f9a77134-ffac-4583-afc8-c242bec23340 None None] MFA Rules not processed for user `c2a38c4081e34b569d39ac5958fa4e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:29.980819 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f9a77134-ffac-4583-afc8-c242bec23340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:30.014093 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b2cb72a1-82ad-433c-a59d-569426ffb21b None None] MFA Rules not processed for user `3fd8e01d97e547bc95be35a034730e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:30.015628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b2cb72a1-82ad-433c-a59d-569426ffb21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:30.030131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:30.146060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 872/1765] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:30.150392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a77134-ffac-4583-afc8-c242bec23340 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:30.250168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 894/1766] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:30.267436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb72a1-82ad-433c-a59d-569426ffb21b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:30.343811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a77134-ffac-4583-afc8-c242bec23340 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:30.373974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f231a9-e3e7-49e2-8537-a74cb3044015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:30.374650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f231a9-e3e7-49e2-8537-a74cb3044015 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:30.374934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f231a9-e3e7-49e2-8537-a74cb3044015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:30.383882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f231a9-e3e7-49e2-8537-a74cb3044015 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:30.383882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f231a9-e3e7-49e2-8537-a74cb3044015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:30.383882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f231a9-e3e7-49e2-8537-a74cb3044015 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:30.527071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb72a1-82ad-433c-a59d-569426ffb21b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:30.533376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf0c72-a653-4df2-aa04-a5daaa426ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:30.534150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0c72-a653-4df2-aa04-a5daaa426ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:30.534632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0c72-a653-4df2-aa04-a5daaa426ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:30.535009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0c72-a653-4df2-aa04-a5daaa426ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:30.535752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf0c72-a653-4df2-aa04-a5daaa426ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:30.538052 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf0c72-a653-4df2-aa04-a5daaa426ce3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:30.559390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 873/1767] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:30 2022] POST /identity/v3/projects => generated 387 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:31:30.563782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f231a9-e3e7-49e2-8537-a74cb3044015 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:30.708691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 895/1768] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:30 2022] POST /identity/v3/projects => generated 365 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:30.710261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0aa1-67d8-49fe-89fc-89f3ac48029c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:30.711020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0aa1-67d8-49fe-89fc-89f3ac48029c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:30.711130 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0aa1-67d8-49fe-89fc-89f3ac48029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:30.720565 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f231a9-e3e7-49e2-8537-a74cb3044015 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:30.912319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-29ab0aa1-67d8-49fe-89fc-89f3ac48029c None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:30.914175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-29ab0aa1-67d8-49fe-89fc-89f3ac48029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:30.914504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7f5d4-ad9f-4725-8ebf-ff9fe40b1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:30.915386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7f5d4-ad9f-4725-8ebf-ff9fe40b1198 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:30.916547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7f5d4-ad9f-4725-8ebf-ff9fe40b1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:30.917102 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7f5d4-ad9f-4725-8ebf-ff9fe40b1198 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:30.923057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7f5d4-ad9f-4725-8ebf-ff9fe40b1198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:30.939796 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7f5d4-ad9f-4725-8ebf-ff9fe40b1198 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:31.087345 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 874/1769] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:30 2022] POST /identity/v3/users => generated 300 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:31.088247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7f5d4-ad9f-4725-8ebf-ff9fe40b1198 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:31.124604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 896/1770] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:31:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:31.129474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0aa1-67d8-49fe-89fc-89f3ac48029c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:31.143783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7f5d4-ad9f-4725-8ebf-ff9fe40b1198 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:31.178836 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b761-653a-4b05-a2d5-0092ca0264ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:31.179302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b761-653a-4b05-a2d5-0092ca0264ed admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.179719 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b761-653a-4b05-a2d5-0092ca0264ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.180114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b761-653a-4b05-a2d5-0092ca0264ed admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:31.181088 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41b761-653a-4b05-a2d5-0092ca0264ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:31.183879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0aa1-67d8-49fe-89fc-89f3ac48029c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:31.191290 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41b761-653a-4b05-a2d5-0092ca0264ed admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:31.232843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73abb8-1052-4f28-a8ad-2ad988d745f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:31.233523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73abb8-1052-4f28-a8ad-2ad988d745f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.233810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73abb8-1052-4f28-a8ad-2ad988d745f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.234136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73abb8-1052-4f28-a8ad-2ad988d745f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:31.234949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73abb8-1052-4f28-a8ad-2ad988d745f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:31.236721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73abb8-1052-4f28-a8ad-2ad988d745f5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:31.281202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 897/1771] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:31.286727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73abb8-1052-4f28-a8ad-2ad988d745f5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:31.323223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73abb8-1052-4f28-a8ad-2ad988d745f5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:31.339531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63756746-034e-4dd0-a382-eaa0c0c3452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:31.351314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63756746-034e-4dd0-a382-eaa0c0c3452b admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.351314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63756746-034e-4dd0-a382-eaa0c0c3452b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.351314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63756746-034e-4dd0-a382-eaa0c0c3452b admin admin] PATH_INFO: `/v3/projects/f4d36f215f4148f2ae15813909066e6c/users/008b7ef7ef4147daa98b298d094bf564/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:31.374963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 875/1772] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:31 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:31.379562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b761-653a-4b05-a2d5-0092ca0264ed admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:31.384213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63756746-034e-4dd0-a382-eaa0c0c3452b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d36f215f4148f2ae15813909066e6c, user_id=008b7ef7ef4147daa98b298d094bf564, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:31.388160 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63756746-034e-4dd0-a382-eaa0c0c3452b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:31.431128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b761-653a-4b05-a2d5-0092ca0264ed admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:31.463651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a26c3-0809-4c1d-b6ed-edf56f0899f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:31.464590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a26c3-0809-4c1d-b6ed-edf56f0899f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.464996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a26c3-0809-4c1d-b6ed-edf56f0899f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.466067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a26c3-0809-4c1d-b6ed-edf56f0899f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:31.466919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a26c3-0809-4c1d-b6ed-edf56f0899f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:31.468787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a26c3-0809-4c1d-b6ed-edf56f0899f3 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:31.515028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 876/1773] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:31.524150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 898/1774] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:31 2022] PUT /identity/v3/projects/f4d36f215f4148f2ae15813909066e6c/users/008b7ef7ef4147daa98b298d094bf564/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:31.524779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63756746-034e-4dd0-a382-eaa0c0c3452b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:31.524915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a26c3-0809-4c1d-b6ed-edf56f0899f3 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:31.558633 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a26c3-0809-4c1d-b6ed-edf56f0899f3 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:31.581937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:31.748896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa34cd-3f2a-4b7f-af53-2e1fecd094a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:31.749680 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa34cd-3f2a-4b7f-af53-2e1fecd094a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.750386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa34cd-3f2a-4b7f-af53-2e1fecd094a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.751113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa34cd-3f2a-4b7f-af53-2e1fecd094a8 admin admin] PATH_INFO: `/v3/projects/e01f34f4c50646f7b7c278fabd07be2f/users/31c8990a79c44a82b4ea1122a8e356fb/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:31.792383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63756746-034e-4dd0-a382-eaa0c0c3452b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:31.794421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa34cd-3f2a-4b7f-af53-2e1fecd094a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01f34f4c50646f7b7c278fabd07be2f, user_id=31c8990a79c44a82b4ea1122a8e356fb, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:31.800327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa34cd-3f2a-4b7f-af53-2e1fecd094a8 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:31.806071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b63556-e8f8-4c40-b9f2-9e1cb607b26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:31.808014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63556-e8f8-4c40-b9f2-9e1cb607b26e admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.808324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63556-e8f8-4c40-b9f2-9e1cb607b26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.808875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63556-e8f8-4c40-b9f2-9e1cb607b26e admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:31.810185 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b63556-e8f8-4c40-b9f2-9e1cb607b26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:31.813425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b63556-e8f8-4c40-b9f2-9e1cb607b26e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:31.858588 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 899/1775] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:31.860585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b63556-e8f8-4c40-b9f2-9e1cb607b26e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:31.880892 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-69b63556-e8f8-4c40-b9f2-9e1cb607b26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:31.903088 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 877/1776] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:31 2022] PUT /identity/v3/projects/e01f34f4c50646f7b7c278fabd07be2f/users/31c8990a79c44a82b4ea1122a8e356fb/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:31.904214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa34cd-3f2a-4b7f-af53-2e1fecd094a8 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:32.007454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:32.130754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b63556-e8f8-4c40-b9f2-9e1cb607b26e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:32.131709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa34cd-3f2a-4b7f-af53-2e1fecd094a8 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:32.156600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efe3f7-e4d4-4a08-8e75-482d1b9bdc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:32.158613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efe3f7-e4d4-4a08-8e75-482d1b9bdc59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:32.160313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efe3f7-e4d4-4a08-8e75-482d1b9bdc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:32.162181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efe3f7-e4d4-4a08-8e75-482d1b9bdc59 admin admin] PATH_INFO: `/v3/projects/f4d36f215f4148f2ae15813909066e6c/users/008b7ef7ef4147daa98b298d094bf564/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:32.170018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efe3f7-e4d4-4a08-8e75-482d1b9bdc59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d36f215f4148f2ae15813909066e6c, user_id=008b7ef7ef4147daa98b298d094bf564, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:32.177843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efe3f7-e4d4-4a08-8e75-482d1b9bdc59 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:32.209981 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 878/1777] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:31 2022] PUT /identity/v3/projects/f4d36f215f4148f2ae15813909066e6c/users/008b7ef7ef4147daa98b298d094bf564/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:32.211274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efe3f7-e4d4-4a08-8e75-482d1b9bdc59 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:32.324237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2289e5d-b36d-4347-a75b-87867a2f3b77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:32.342365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2289e5d-b36d-4347-a75b-87867a2f3b77 service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:32.344382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2289e5d-b36d-4347-a75b-87867a2f3b77 service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:32.348047 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2289e5d-b36d-4347-a75b-87867a2f3b77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:32.440612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:32.446141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efe3f7-e4d4-4a08-8e75-482d1b9bdc59 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:32.458943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d49e67-96c1-4ef7-bb1f-44d263eb7c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:32.459596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d49e67-96c1-4ef7-bb1f-44d263eb7c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:32.459884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d49e67-96c1-4ef7-bb1f-44d263eb7c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:32.461038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d49e67-96c1-4ef7-bb1f-44d263eb7c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:32.461038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d49e67-96c1-4ef7-bb1f-44d263eb7c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:32.468510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d49e67-96c1-4ef7-bb1f-44d263eb7c4d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:32.514742 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2289e5d-b36d-4347-a75b-87867a2f3b77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:32.517500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2289e5d-b36d-4347-a75b-87867a2f3b77 service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:32.518896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 879/1778] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:32.524086 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308fad7-f86d-4261-b0d3-9171b9665787 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:32.524470 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308fad7-f86d-4261-b0d3-9171b9665787 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:32.527144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308fad7-f86d-4261-b0d3-9171b9665787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:32.534490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 900/1779] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:31:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:31:32.539415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2289e5d-b36d-4347-a75b-87867a2f3b77 service swift] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:32.562381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2289e5d-b36d-4347-a75b-87867a2f3b77 service swift] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:32.570296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f74f44-a127-4e6c-bc9b-e25051e75ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:32.571449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f74f44-a127-4e6c-bc9b-e25051e75ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:32.572330 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f74f44-a127-4e6c-bc9b-e25051e75ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:32.572866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f74f44-a127-4e6c-bc9b-e25051e75ff9 admin admin] PATH_INFO: `/v3/projects/e01f34f4c50646f7b7c278fabd07be2f/users/31c8990a79c44a82b4ea1122a8e356fb/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:32.575993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f74f44-a127-4e6c-bc9b-e25051e75ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01f34f4c50646f7b7c278fabd07be2f, user_id=31c8990a79c44a82b4ea1122a8e356fb, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:32.581379 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f74f44-a127-4e6c-bc9b-e25051e75ff9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:32.624391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6308fad7-f86d-4261-b0d3-9171b9665787 None None] MFA Rules not processed for user `008b7ef7ef4147daa98b298d094bf564`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:32.634890 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6308fad7-f86d-4261-b0d3-9171b9665787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:32.660047 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 901/1780] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:32 2022] PUT /identity/v3/projects/e01f34f4c50646f7b7c278fabd07be2f/users/31c8990a79c44a82b4ea1122a8e356fb/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:32.672646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5088b5-1448-49d4-80df-5984b48c7a35 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:32.673194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5088b5-1448-49d4-80df-5984b48c7a35 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:32.674918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5088b5-1448-49d4-80df-5984b48c7a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:32.862924 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-cf5088b5-1448-49d4-80df-5984b48c7a35 None None] MFA Rules not processed for user `31c8990a79c44a82b4ea1122a8e356fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:32.868192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cf5088b5-1448-49d4-80df-5984b48c7a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:33.118967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 880/1781] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 596 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:33.118967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308fad7-f86d-4261-b0d3-9171b9665787 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:33.154757 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6308fad7-f86d-4261-b0d3-9171b9665787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:33.202653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 902/1782] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 531 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:33.209808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5088b5-1448-49d4-80df-5984b48c7a35 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:33.422393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cf5088b5-1448-49d4-80df-5984b48c7a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:33.422393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5088b5-1448-49d4-80df-5984b48c7a35 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:33.422393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccce6a-922c-4f17-be3e-de21e69c8e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:33.424238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccce6a-922c-4f17-be3e-de21e69c8e41 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:33.424238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccce6a-922c-4f17-be3e-de21e69c8e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:33.424238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccce6a-922c-4f17-be3e-de21e69c8e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:33.428837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccce6a-922c-4f17-be3e-de21e69c8e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:33.430752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccce6a-922c-4f17-be3e-de21e69c8e41 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:33.450144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 903/1783] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:33.484431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccce6a-922c-4f17-be3e-de21e69c8e41 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:33.484431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8dccce6a-922c-4f17-be3e-de21e69c8e41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:33.485004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308fad7-f86d-4261-b0d3-9171b9665787 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:33.485004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:33.485004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:33.485004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:33.485463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] PATH_INFO: `/v3/users/c17c6ef06b694caaab905f36975e8bdd` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:33.485463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17c6ef06b694caaab905f36975e8bdd)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:33.485463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:33.521456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccce6a-922c-4f17-be3e-de21e69c8e41 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:33.533986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d5a1-11d3-4c76-a11b-e77c3b35dc74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:33.534841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d5a1-11d3-4c76-a11b-e77c3b35dc74 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:33.535188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d5a1-11d3-4c76-a11b-e77c3b35dc74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:33.535529 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d5a1-11d3-4c76-a11b-e77c3b35dc74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:33.551439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d5a1-11d3-4c76-a11b-e77c3b35dc74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:33.553199 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d5a1-11d3-4c76-a11b-e77c3b35dc74 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:33.574425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 904/1784] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:33.913988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a7e06-8ff2-458a-93e5-f84761bd9d00 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:33.915247 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a7e06-8ff2-458a-93e5-f84761bd9d00 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:33.915528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a7e06-8ff2-458a-93e5-f84761bd9d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:34.018166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-155a7e06-8ff2-458a-93e5-f84761bd9d00 None None] MFA Rules not processed for user `916c6069352e4fe9b3a4ad6a29a2d58d`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:34.019753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-155a7e06-8ff2-458a-93e5-f84761bd9d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:34.054161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17c6ef06b694caaab905f36975e8bdd'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:34.076274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17c6ef06b694caaab905f36975e8bdd'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:34.078081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17c6ef06b694caaab905f36975e8bdd'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:34.127345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:34.204707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17c6ef06b694caaab905f36975e8bdd'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:34.265484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17c6ef06b694caaab905f36975e8bdd'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:34.276142 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 905/1785] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 20:31:34.286250 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a413fb-533f-42a3-9a8d-92f2374fd662 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:34.287280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a413fb-533f-42a3-9a8d-92f2374fd662 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:34.289786 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a413fb-533f-42a3-9a8d-92f2374fd662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:34.293157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 881/1786] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:33 2022] DELETE /identity/v3/users/c17c6ef06b694caaab905f36975e8bdd => generated 0 bytes in 1177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:34.297789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:34.305801 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:34.341196 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-24a413fb-533f-42a3-9a8d-92f2374fd662 None None] MFA Rules not processed for user `63b7b33a0dd64d44ba980122f83eba4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:34.342854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-24a413fb-533f-42a3-9a8d-92f2374fd662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:34.469247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:34.514611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ceab89-01e2-41a3-b42e-229c02e0cc63 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:34.535144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 906/1787] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:34.537123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5c2ee-0334-45ee-bb6b-9cad33b5c3cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:34.537412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5c2ee-0334-45ee-bb6b-9cad33b5c3cc service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:34.538000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5c2ee-0334-45ee-bb6b-9cad33b5c3cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:34.539672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eeb74-69a9-47a7-929e-7ef8873d7684 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:34.540166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eeb74-69a9-47a7-929e-7ef8873d7684 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:34.540297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5c2ee-0334-45ee-bb6b-9cad33b5c3cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:34.540708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eeb74-69a9-47a7-929e-7ef8873d7684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:34.548263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3bb5c2ee-0334-45ee-bb6b-9cad33b5c3cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:34.585654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a20eeb74-69a9-47a7-929e-7ef8873d7684 None None] MFA Rules not processed for user `241e34a86aba4c3a92ed9d469e6a205e`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:34.587477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a20eeb74-69a9-47a7-929e-7ef8873d7684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:34.712419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5c2ee-0334-45ee-bb6b-9cad33b5c3cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:34.714530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5c2ee-0334-45ee-bb6b-9cad33b5c3cc service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:34.735469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 907/1788] 10.222.0.117 () {58 vars in 1016 bytes} [Mon Aug 29 20:31:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:34.737598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eeb74-69a9-47a7-929e-7ef8873d7684 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:34.751207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a20eeb74-69a9-47a7-929e-7ef8873d7684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:34.751361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 882/1789] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:34.751361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51820542-2c99-467e-87ba-72ed0cd6ff2c None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:34.751361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51820542-2c99-467e-87ba-72ed0cd6ff2c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:34.751992 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51820542-2c99-467e-87ba-72ed0cd6ff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:34.787862 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-51820542-2c99-467e-87ba-72ed0cd6ff2c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:34.789195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-51820542-2c99-467e-87ba-72ed0cd6ff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:34.922742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 883/1790] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:34.923892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51820542-2c99-467e-87ba-72ed0cd6ff2c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:34.927048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-51820542-2c99-467e-87ba-72ed0cd6ff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:34.943900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51820542-2c99-467e-87ba-72ed0cd6ff2c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:34.950093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b392d-8718-4b7e-9637-c9302ffc9633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:34.951111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b392d-8718-4b7e-9637-c9302ffc9633 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:34.953329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b392d-8718-4b7e-9637-c9302ffc9633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:34.953885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b392d-8718-4b7e-9637-c9302ffc9633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:34.955935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eeb74-69a9-47a7-929e-7ef8873d7684 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:34.968572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b392d-8718-4b7e-9637-c9302ffc9633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:34.968572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b392d-8718-4b7e-9637-c9302ffc9633 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:34.980129 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b95600-16cb-40e1-a67f-fb873d600fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:34.980882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b95600-16cb-40e1-a67f-fb873d600fff admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:34.981167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b95600-16cb-40e1-a67f-fb873d600fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:34.982055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b95600-16cb-40e1-a67f-fb873d600fff admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:34.982806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b95600-16cb-40e1-a67f-fb873d600fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:34.984777 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b95600-16cb-40e1-a67f-fb873d600fff admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:34.991895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 884/1791] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:34.993448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b392d-8718-4b7e-9637-c9302ffc9633 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:35.015177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b392d-8718-4b7e-9637-c9302ffc9633 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:35.026942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baedea-dc03-4d75-98fd-934dc50e3189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:35.028838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baedea-dc03-4d75-98fd-934dc50e3189 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:35.029309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baedea-dc03-4d75-98fd-934dc50e3189 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:35.030600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baedea-dc03-4d75-98fd-934dc50e3189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:35.065188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baedea-dc03-4d75-98fd-934dc50e3189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:35.071969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baedea-dc03-4d75-98fd-934dc50e3189 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:35.111875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 885/1792] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:35.457935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 908/1793] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:34 2022] POST /identity/v3/projects => generated 403 bytes in 718 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:35.459332 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baedea-dc03-4d75-98fd-934dc50e3189 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:35.475466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baedea-dc03-4d75-98fd-934dc50e3189 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:35.667662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:35.804804 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3c2e5-53f3-4e67-85e1-77b7839db7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:35.829354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3c2e5-53f3-4e67-85e1-77b7839db7de admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:35.829785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3c2e5-53f3-4e67-85e1-77b7839db7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:35.830069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3c2e5-53f3-4e67-85e1-77b7839db7de admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:35.832654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3c2e5-53f3-4e67-85e1-77b7839db7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:35.839722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3c2e5-53f3-4e67-85e1-77b7839db7de admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:36.231053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b95600-16cb-40e1-a67f-fb873d600fff admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:36.231552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 886/1794] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:35 2022] POST /identity/v3/users => generated 308 bytes in 769 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:31:36.251921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:36.262320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b95600-16cb-40e1-a67f-fb873d600fff admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:36.280816 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a3f28-916b-4f07-93f2-d92c3dd64e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:36.288485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a3f28-916b-4f07-93f2-d92c3dd64e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:36.292051 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a3f28-916b-4f07-93f2-d92c3dd64e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:36.292548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a3f28-916b-4f07-93f2-d92c3dd64e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:36.296319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a3f28-916b-4f07-93f2-d92c3dd64e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:36.300265 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a3f28-916b-4f07-93f2-d92c3dd64e58 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:36.349542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3c2e5-53f3-4e67-85e1-77b7839db7de admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:36.357969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 909/1795] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:31:36.368399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3c2e5-53f3-4e67-85e1-77b7839db7de admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:36.394203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a08143-9e5a-4efc-ac4c-abf26702767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:36.395066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08143-9e5a-4efc-ac4c-abf26702767c admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:36.395411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08143-9e5a-4efc-ac4c-abf26702767c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:36.395750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08143-9e5a-4efc-ac4c-abf26702767c admin admin] PATH_INFO: `/v3/projects/f3573c715ceb4d78bb03790268ac028e/users/370e856631fc4b0bb80b019dd35ca799/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:36.430009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a08143-9e5a-4efc-ac4c-abf26702767c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3573c715ceb4d78bb03790268ac028e, user_id=370e856631fc4b0bb80b019dd35ca799, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:36.433917 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a08143-9e5a-4efc-ac4c-abf26702767c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:36.661859 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a3f28-916b-4f07-93f2-d92c3dd64e58 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:36.662421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 887/1796] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:36 2022] PUT /identity/v3/projects/f3573c715ceb4d78bb03790268ac028e/users/370e856631fc4b0bb80b019dd35ca799/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:36.680515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a3f28-916b-4f07-93f2-d92c3dd64e58 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:36.728165 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a08143-9e5a-4efc-ac4c-abf26702767c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:36.730296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c7a08143-9e5a-4efc-ac4c-abf26702767c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:36.942711 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a08143-9e5a-4efc-ac4c-abf26702767c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:36.958078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11bbcd-c249-4e27-8b2c-78189dccf44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:36.959338 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11bbcd-c249-4e27-8b2c-78189dccf44a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:36.959781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11bbcd-c249-4e27-8b2c-78189dccf44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:36.960872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11bbcd-c249-4e27-8b2c-78189dccf44a admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:36.961987 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:36.963726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:36.963939 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11bbcd-c249-4e27-8b2c-78189dccf44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:36.964804 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:36.965609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] PATH_INFO: `/v3/users/c2a38c4081e34b569d39ac5958fa4e7f` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:36.972834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a38c4081e34b569d39ac5958fa4e7f)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:36.976937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:36.988758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11bbcd-c249-4e27-8b2c-78189dccf44a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:37.063399 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 910/1797] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:37.067786 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11bbcd-c249-4e27-8b2c-78189dccf44a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:37.118585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11bbcd-c249-4e27-8b2c-78189dccf44a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:37.140529 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f21c8-1dfa-4401-aed6-dcde992b0863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:37.141915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f21c8-1dfa-4401-aed6-dcde992b0863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:37.144053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f21c8-1dfa-4401-aed6-dcde992b0863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:37.144670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f21c8-1dfa-4401-aed6-dcde992b0863 admin admin] PATH_INFO: `/v3/projects/f3573c715ceb4d78bb03790268ac028e/users/370e856631fc4b0bb80b019dd35ca799/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:37.149316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f21c8-1dfa-4401-aed6-dcde992b0863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3573c715ceb4d78bb03790268ac028e, user_id=370e856631fc4b0bb80b019dd35ca799, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:37.156183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f21c8-1dfa-4401-aed6-dcde992b0863 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:37.207848 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 911/1798] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:37 2022] PUT /identity/v3/projects/f3573c715ceb4d78bb03790268ac028e/users/370e856631fc4b0bb80b019dd35ca799/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:37.209583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:37.388975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a38c4081e34b569d39ac5958fa4e7f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:37.402253 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a38c4081e34b569d39ac5958fa4e7f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:37.402809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a38c4081e34b569d39ac5958fa4e7f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:37.527272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a38c4081e34b569d39ac5958fa4e7f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:37.551637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a38c4081e34b569d39ac5958fa4e7f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:37.571570 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 888/1799] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:36 2022] DELETE /identity/v3/users/c2a38c4081e34b569d39ac5958fa4e7f => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:31:37.577256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b730c-6863-44dd-8037-e21a428d48b5 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:37.577821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b730c-6863-44dd-8037-e21a428d48b5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:37.578071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b730c-6863-44dd-8037-e21a428d48b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:37.601355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:37.626442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ec1b730c-6863-44dd-8037-e21a428d48b5 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:37.628587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ec1b730c-6863-44dd-8037-e21a428d48b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:37.759245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:37.915306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 912/1800] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:37.951116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:37.952685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:38.009151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c313b4-7d41-494e-b4c5-ac343ac03212 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:38.009151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c313b4-7d41-494e-b4c5-ac343ac03212 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:38.009151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c313b4-7d41-494e-b4c5-ac343ac03212 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:38.009948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 913/1801] 10.222.0.81 () {54 vars in 921 bytes} [Mon Aug 29 20:31:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:38.023558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c313b4-7d41-494e-b4c5-ac343ac03212 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:38.025792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-56c313b4-7d41-494e-b4c5-ac343ac03212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:38.096652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c313b4-7d41-494e-b4c5-ac343ac03212 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:38.111600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:38.112913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:38.113250 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:38.116224 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] PATH_INFO: `/v3/projects/a0759e109ea8424099ef0051ae51df0c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:38.118122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0759e109ea8424099ef0051ae51df0c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:38.133701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:38.220503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a622e-2dd5-42ab-8a48-d4ac70caa4a5 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:38.229261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032eb02-1369-4c39-8051-b0b29530835f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:38.230506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032eb02-1369-4c39-8051-b0b29530835f service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:38.231218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032eb02-1369-4c39-8051-b0b29530835f service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:38.231972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032eb02-1369-4c39-8051-b0b29530835f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:38.252551 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032eb02-1369-4c39-8051-b0b29530835f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:38.255724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032eb02-1369-4c39-8051-b0b29530835f service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:38.292679 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 889/1802] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:38.299954 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46df255-bfdf-44a4-bf18-0cfe6d63f509 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:38.300741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46df255-bfdf-44a4-bf18-0cfe6d63f509 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:38.301311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46df255-bfdf-44a4-bf18-0cfe6d63f509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:38.365623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d46df255-bfdf-44a4-bf18-0cfe6d63f509 None None] MFA Rules not processed for user `30946d3b3f0f4a81b2ae5aa6e84f3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:38.370419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d46df255-bfdf-44a4-bf18-0cfe6d63f509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:38.377748 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0759e109ea8424099ef0051ae51df0c', 'request_id': 'req-807c38d7-94db-4cf7-9b4a-dac202318de0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:38.388630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0759e109ea8424099ef0051ae51df0c', 'request_id': 'req-807c38d7-94db-4cf7-9b4a-dac202318de0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:38.455081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0759e109ea8424099ef0051ae51df0c', 'request_id': 'req-807c38d7-94db-4cf7-9b4a-dac202318de0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:38.484851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] The token cache is being invalidate because project a0759e109ea8424099ef0051ae51df0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:38.485291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:38.498794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:38.500516 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 914/1803] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:38 2022] DELETE /identity/v3/projects/a0759e109ea8424099ef0051ae51df0c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:38.504825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:38.518021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:38.616929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 890/1804] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Aug 29 20:31:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:38.769321 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c38d7-94db-4cf7-9b4a-dac202318de0 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:38.791591 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:38.793802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:38.794477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:38.795513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] PATH_INFO: `/v3/users/688ea3a8a8f24ef1bbb47801ea5a1051` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:38.801878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=688ea3a8a8f24ef1bbb47801ea5a1051)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:38.805156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:39.164267 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46df255-bfdf-44a4-bf18-0cfe6d63f509 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:39.167304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d46df255-bfdf-44a4-bf18-0cfe6d63f509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:39.185415 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46df255-bfdf-44a4-bf18-0cfe6d63f509 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:39.194742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d32b2-2dc0-45ca-b8de-3da4e80f1776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:39.195884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d32b2-2dc0-45ca-b8de-3da4e80f1776 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:39.196503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d32b2-2dc0-45ca-b8de-3da4e80f1776 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:39.197280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d32b2-2dc0-45ca-b8de-3da4e80f1776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:39.211792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d32b2-2dc0-45ca-b8de-3da4e80f1776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:39.214704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d32b2-2dc0-45ca-b8de-3da4e80f1776 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:39.233424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 891/1805] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:39.892845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688ea3a8a8f24ef1bbb47801ea5a1051'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.940974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688ea3a8a8f24ef1bbb47801ea5a1051'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.944152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688ea3a8a8f24ef1bbb47801ea5a1051'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.947753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688ea3a8a8f24ef1bbb47801ea5a1051'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.966449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688ea3a8a8f24ef1bbb47801ea5a1051'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:40.105367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 915/1806] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:38 2022] DELETE /identity/v3/users/688ea3a8a8f24ef1bbb47801ea5a1051 => generated 0 bytes in 1601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:40.120337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3f95-0643-43d9-9963-2ab8a206fb53 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:40.121204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3f95-0643-43d9-9963-2ab8a206fb53 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:40.121765 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3f95-0643-43d9-9963-2ab8a206fb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:40.207975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-85bf3f95-0643-43d9-9963-2ab8a206fb53 None None] MFA Rules not processed for user `67a947140e4c4075acd70bbb57022baa`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:40.209551 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-85bf3f95-0643-43d9-9963-2ab8a206fb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:40.370286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:40.540183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 892/1807] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:40.872521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:42.461358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:42.469104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:42.506149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3f95-0643-43d9-9963-2ab8a206fb53 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:42.511953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-85bf3f95-0643-43d9-9963-2ab8a206fb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:42.623767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:42.687899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db90e4e-0f7f-4bf5-aed0-f8df49214755 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:42.692433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:42.693301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:42.703378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:42.703775 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] PATH_INFO: `/v3/users/3fd8e01d97e547bc95be35a034730e21` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:42.706741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd8e01d97e547bc95be35a034730e21)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:42.709122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:42.771241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3f95-0643-43d9-9963-2ab8a206fb53 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:42.778297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:42.779979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:42.780423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:42.781167 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a admin admin] PATH_INFO: `/v3/projects/de65a6ffca1d424881e8281482f6a936` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:42.782690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de65a6ffca1d424881e8281482f6a936)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:42.788889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:43.049011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd8e01d97e547bc95be35a034730e21'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.051929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de65a6ffca1d424881e8281482f6a936', 'request_id': 'req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.087085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd8e01d97e547bc95be35a034730e21'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.089223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd8e01d97e547bc95be35a034730e21'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.090389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd8e01d97e547bc95be35a034730e21'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.094418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de65a6ffca1d424881e8281482f6a936', 'request_id': 'req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.109000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd8e01d97e547bc95be35a034730e21'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.141957 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de65a6ffca1d424881e8281482f6a936', 'request_id': 'req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.198994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 916/1808] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:42 2022] DELETE /identity/v3/users/3fd8e01d97e547bc95be35a034730e21 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:43.203074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:43.215984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:43.307131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4177a2b-b28a-48fa-b03f-3d279c19b941 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:43.313754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58670f55-101e-4e87-9da6-b080db78b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:43.314661 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58670f55-101e-4e87-9da6-b080db78b07b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:43.330148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58670f55-101e-4e87-9da6-b080db78b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:43.331350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58670f55-101e-4e87-9da6-b080db78b07b admin admin] PATH_INFO: `/v3/projects/590eb8f85e084ae28a9863a0788626b1` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:43.333439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58670f55-101e-4e87-9da6-b080db78b07b admin admin] RBAC: Authorizing `identity:delete_project(project_id=590eb8f85e084ae28a9863a0788626b1)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:43.339371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58670f55-101e-4e87-9da6-b080db78b07b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:43.349174 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a admin admin] The token cache is being invalidate because project de65a6ffca1d424881e8281482f6a936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:43.349480 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.350730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-44bed92f-4a3e-458a-adbf-5d83a62b8b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.383059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 893/1809] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:42 2022] DELETE /identity/v3/projects/de65a6ffca1d424881e8281482f6a936 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:43.386859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac0b8e-dcf7-4489-9bf2-e241d92a527e None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:43.391934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac0b8e-dcf7-4489-9bf2-e241d92a527e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:43.392380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac0b8e-dcf7-4489-9bf2-e241d92a527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:43.538038 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-58670f55-101e-4e87-9da6-b080db78b07b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590eb8f85e084ae28a9863a0788626b1', 'request_id': 'req-58670f55-101e-4e87-9da6-b080db78b07b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.568921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-58670f55-101e-4e87-9da6-b080db78b07b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590eb8f85e084ae28a9863a0788626b1', 'request_id': 'req-58670f55-101e-4e87-9da6-b080db78b07b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.669352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-c8ac0b8e-dcf7-4489-9bf2-e241d92a527e None None] MFA Rules not processed for user `370e856631fc4b0bb80b019dd35ca799`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:43.675139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-58670f55-101e-4e87-9da6-b080db78b07b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590eb8f85e084ae28a9863a0788626b1', 'request_id': 'req-58670f55-101e-4e87-9da6-b080db78b07b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.675256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c8ac0b8e-dcf7-4489-9bf2-e241d92a527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:43.725910 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-58670f55-101e-4e87-9da6-b080db78b07b admin admin] The token cache is being invalidate because project 590eb8f85e084ae28a9863a0788626b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:43.729957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-58670f55-101e-4e87-9da6-b080db78b07b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.738781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-58670f55-101e-4e87-9da6-b080db78b07b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.750036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 917/1810] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:43 2022] DELETE /identity/v3/projects/590eb8f85e084ae28a9863a0788626b1 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:43.754235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93ec81-6f08-48ed-b9d3-ae52689bd86c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:43.760665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93ec81-6f08-48ed-b9d3-ae52689bd86c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:43.760665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93ec81-6f08-48ed-b9d3-ae52689bd86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:43.892554 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-bd93ec81-6f08-48ed-b9d3-ae52689bd86c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:43.894548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bd93ec81-6f08-48ed-b9d3-ae52689bd86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:43.906577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 894/1811] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:43 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:43.907830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac0b8e-dcf7-4489-9bf2-e241d92a527e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:43.911629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c8ac0b8e-dcf7-4489-9bf2-e241d92a527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:44.053676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac0b8e-dcf7-4489-9bf2-e241d92a527e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:44.060704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e94b7-d8a9-4a5f-a77d-c2727c637cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:44.061830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e94b7-d8a9-4a5f-a77d-c2727c637cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:44.062573 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e94b7-d8a9-4a5f-a77d-c2727c637cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:44.063234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e94b7-d8a9-4a5f-a77d-c2727c637cff admin admin] PATH_INFO: `/v3/users/008b7ef7ef4147daa98b298d094bf564` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:44.065128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e94b7-d8a9-4a5f-a77d-c2727c637cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=008b7ef7ef4147daa98b298d094bf564)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:44.067787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e94b7-d8a9-4a5f-a77d-c2727c637cff admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:44.124702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 918/1812] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:44.126531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67861f-f363-4ed8-8472-bc86007356ec None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:44.127034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67861f-f363-4ed8-8472-bc86007356ec None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:44.127496 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67861f-f363-4ed8-8472-bc86007356ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:44.153892 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2e67861f-f363-4ed8-8472-bc86007356ec None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:44.155392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2e67861f-f363-4ed8-8472-bc86007356ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:44.177367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 919/1813] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:44.179362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe1f4d-71eb-4e0b-a6cc-1b62e4acbfaf None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:44.179724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe1f4d-71eb-4e0b-a6cc-1b62e4acbfaf None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:44.180089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe1f4d-71eb-4e0b-a6cc-1b62e4acbfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:44.209700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4dbe1f4d-71eb-4e0b-a6cc-1b62e4acbfaf None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:44.211128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4dbe1f4d-71eb-4e0b-a6cc-1b62e4acbfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:44.249095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 920/1814] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:44.250765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe1f4d-71eb-4e0b-a6cc-1b62e4acbfaf None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:44.262800 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe1f4d-71eb-4e0b-a6cc-1b62e4acbfaf None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:44.269808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55c25b-a58a-48fe-b0ab-2d250c26ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:44.270626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55c25b-a58a-48fe-b0ab-2d250c26ac71 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:44.270963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55c25b-a58a-48fe-b0ab-2d250c26ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:44.272337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55c25b-a58a-48fe-b0ab-2d250c26ac71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:44.272337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55c25b-a58a-48fe-b0ab-2d250c26ac71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:44.272739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55c25b-a58a-48fe-b0ab-2d250c26ac71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:44.275173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55c25b-a58a-48fe-b0ab-2d250c26ac71 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:44.296778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 921/1815] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:44.296778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55c25b-a58a-48fe-b0ab-2d250c26ac71 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:44.296778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1e55c25b-a58a-48fe-b0ab-2d250c26ac71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:44.334252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bb0e94b7-d8a9-4a5f-a77d-c2727c637cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008b7ef7ef4147daa98b298d094bf564'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:44.370937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:44.371911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bb0e94b7-d8a9-4a5f-a77d-c2727c637cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008b7ef7ef4147daa98b298d094bf564'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:44.372798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bb0e94b7-d8a9-4a5f-a77d-c2727c637cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008b7ef7ef4147daa98b298d094bf564'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:44.410407 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55c25b-a58a-48fe-b0ab-2d250c26ac71 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:44.418387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e9c0c-956d-479f-abba-b2d0f7a3f8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:44.418986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e9c0c-956d-479f-abba-b2d0f7a3f8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:44.419267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e9c0c-956d-479f-abba-b2d0f7a3f8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:44.419619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e9c0c-956d-479f-abba-b2d0f7a3f8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:44.422659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9c0e9c0c-956d-479f-abba-b2d0f7a3f8e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:44.441740 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e9c0c-956d-479f-abba-b2d0f7a3f8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:44.444184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e9c0c-956d-479f-abba-b2d0f7a3f8e9 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:44.449422 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bb0e94b7-d8a9-4a5f-a77d-c2727c637cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008b7ef7ef4147daa98b298d094bf564'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:44.467405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 922/1816] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:44.469054 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e9c0c-956d-479f-abba-b2d0f7a3f8e9 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:44.472433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9c0e9c0c-956d-479f-abba-b2d0f7a3f8e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:44.480079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bb0e94b7-d8a9-4a5f-a77d-c2727c637cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008b7ef7ef4147daa98b298d094bf564'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:44.519173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 895/1817] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:43 2022] DELETE /identity/v3/users/008b7ef7ef4147daa98b298d094bf564 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:44.519610 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e9c0c-956d-479f-abba-b2d0f7a3f8e9 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:44.573458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4a6ad-2ea7-4948-a220-deadc0798053 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:44.574088 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4a6ad-2ea7-4948-a220-deadc0798053 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:44.574088 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4a6ad-2ea7-4948-a220-deadc0798053 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:44.575592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 896/1818] 10.222.0.81 () {54 vars in 921 bytes} [Mon Aug 29 20:31:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:31:44.614636 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57509f9-2cb9-4948-ac91-052e07b1839e None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:44.614989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57509f9-2cb9-4948-ac91-052e07b1839e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:44.615266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57509f9-2cb9-4948-ac91-052e07b1839e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:44.645778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b60ea5-3a5a-47f6-a1e3-bc333259cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:44.646596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b60ea5-3a5a-47f6-a1e3-bc333259cf2b admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:44.646750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b60ea5-3a5a-47f6-a1e3-bc333259cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:44.646990 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b60ea5-3a5a-47f6-a1e3-bc333259cf2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:44.666847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b60ea5-3a5a-47f6-a1e3-bc333259cf2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:44.668866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b60ea5-3a5a-47f6-a1e3-bc333259cf2b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:44.690323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f57509f9-2cb9-4948-ac91-052e07b1839e None None] MFA Rules not processed for user `30946d3b3f0f4a81b2ae5aa6e84f3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:44.697235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f57509f9-2cb9-4948-ac91-052e07b1839e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:44.856433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 923/1819] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:44 2022] POST /identity/v3/projects => generated 387 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:44.862441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b60ea5-3a5a-47f6-a1e3-bc333259cf2b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:44.922502 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 897/1820] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Aug 29 20:31:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:44.970923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57509f9-2cb9-4948-ac91-052e07b1839e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:44.973420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f57509f9-2cb9-4948-ac91-052e07b1839e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:45.028696 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57509f9-2cb9-4948-ac91-052e07b1839e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:45.073290 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b60ea5-3a5a-47f6-a1e3-bc333259cf2b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:45.097585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a73d1-36c7-41ac-ad8e-29d08c57dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:45.098274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a73d1-36c7-41ac-ad8e-29d08c57dccd admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:45.098570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a73d1-36c7-41ac-ad8e-29d08c57dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:45.098876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a73d1-36c7-41ac-ad8e-29d08c57dccd admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:45.099762 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a73d1-36c7-41ac-ad8e-29d08c57dccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:45.101775 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a73d1-36c7-41ac-ad8e-29d08c57dccd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:45.256675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 924/1821] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:44 2022] POST /identity/v3/users => generated 294 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:45.262081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a73d1-36c7-41ac-ad8e-29d08c57dccd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:45.281147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acee90-bc43-4956-8d4d-1038a001c941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:45.282636 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acee90-bc43-4956-8d4d-1038a001c941 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:45.283200 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acee90-bc43-4956-8d4d-1038a001c941 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:45.283643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acee90-bc43-4956-8d4d-1038a001c941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:45.284101 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a73d1-36c7-41ac-ad8e-29d08c57dccd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:45.295493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acee90-bc43-4956-8d4d-1038a001c941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:45.297804 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acee90-bc43-4956-8d4d-1038a001c941 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:45.298046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89527adf-023c-43b6-8d34-f292f7007502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:45.299246 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527adf-023c-43b6-8d34-f292f7007502 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:45.299448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527adf-023c-43b6-8d34-f292f7007502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:45.299801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527adf-023c-43b6-8d34-f292f7007502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:45.300687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89527adf-023c-43b6-8d34-f292f7007502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:45.303982 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89527adf-023c-43b6-8d34-f292f7007502 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:45.333304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 898/1822] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:45.340706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 925/1823] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:31:45.379818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acee90-bc43-4956-8d4d-1038a001c941 service nova] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:45.408905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acee90-bc43-4956-8d4d-1038a001c941 service nova] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:45.423248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefbe7c-56cf-484c-9292-3b4dc578cae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:45.423884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbe7c-56cf-484c-9292-3b4dc578cae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:45.424178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbe7c-56cf-484c-9292-3b4dc578cae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:45.424603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbe7c-56cf-484c-9292-3b4dc578cae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:45.425280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefbe7c-56cf-484c-9292-3b4dc578cae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:45.427630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefbe7c-56cf-484c-9292-3b4dc578cae7 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:45.459055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 899/1824] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:45.469632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89527adf-023c-43b6-8d34-f292f7007502 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:45.485150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89527adf-023c-43b6-8d34-f292f7007502 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:45.496945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d5acf-64dc-49b7-b347-4361f56fcef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:45.497652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d5acf-64dc-49b7-b347-4361f56fcef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:45.497918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d5acf-64dc-49b7-b347-4361f56fcef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:45.498661 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d5acf-64dc-49b7-b347-4361f56fcef8 admin admin] PATH_INFO: `/v3/projects/50afb0e54bd743b186f7d6d6f890afe6/users/b3e7c85bb7244a6f8f77a827094fe189/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:45.553701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d5acf-64dc-49b7-b347-4361f56fcef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50afb0e54bd743b186f7d6d6f890afe6, user_id=b3e7c85bb7244a6f8f77a827094fe189, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:45.556858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d5acf-64dc-49b7-b347-4361f56fcef8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:46.159653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 926/1825] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:45 2022] PUT /identity/v3/projects/50afb0e54bd743b186f7d6d6f890afe6/users/b3e7c85bb7244a6f8f77a827094fe189/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:46.169652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161d54f-cb4c-4c92-bc96-b850c29ee5f6 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.170282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161d54f-cb4c-4c92-bc96-b850c29ee5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.170282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161d54f-cb4c-4c92-bc96-b850c29ee5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.222454 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-2161d54f-cb4c-4c92-bc96-b850c29ee5f6 None None] MFA Rules not processed for user `b3e7c85bb7244a6f8f77a827094fe189`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:46.223910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2161d54f-cb4c-4c92-bc96-b850c29ee5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:46.332325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818bac9-55ef-4bdd-b7d6-d2a92b04d024 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.332325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818bac9-55ef-4bdd-b7d6-d2a92b04d024 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.332325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818bac9-55ef-4bdd-b7d6-d2a92b04d024 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.332325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 927/1826] 10.222.0.81 () {54 vars in 921 bytes} [Mon Aug 29 20:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:46.339951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98b46-c666-4cd2-8332-de4d5d6171d8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.343281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98b46-c666-4cd2-8332-de4d5d6171d8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.343281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98b46-c666-4cd2-8332-de4d5d6171d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.360748 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 900/1827] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:46.368132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161d54f-cb4c-4c92-bc96-b850c29ee5f6 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:46.388155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-64f98b46-c666-4cd2-8332-de4d5d6171d8 None None] MFA Rules not processed for user `884b748550d546b7a0bb2bc5b0c614d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:46.389836 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-64f98b46-c666-4cd2-8332-de4d5d6171d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:46.487274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161d54f-cb4c-4c92-bc96-b850c29ee5f6 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:46.495616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afaa9a-7825-4134-bc82-b5b5d99572d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:46.496569 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afaa9a-7825-4134-bc82-b5b5d99572d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.497213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afaa9a-7825-4134-bc82-b5b5d99572d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.497678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afaa9a-7825-4134-bc82-b5b5d99572d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.509893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afaa9a-7825-4134-bc82-b5b5d99572d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:46.511976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afaa9a-7825-4134-bc82-b5b5d99572d4 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:46.551003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 928/1828] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Aug 29 20:31:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:46.563862 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9943f-dd89-489d-b10a-b3666b094358 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.570094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9943f-dd89-489d-b10a-b3666b094358 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.570094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9943f-dd89-489d-b10a-b3666b094358 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.570094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 929/1829] 10.222.0.81 () {54 vars in 961 bytes} [Mon Aug 29 20:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:31:46.570673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b636261-3104-4da4-8415-c9e72a1b8d9b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.571143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b636261-3104-4da4-8415-c9e72a1b8d9b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.571454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b636261-3104-4da4-8415-c9e72a1b8d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.592336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6b636261-3104-4da4-8415-c9e72a1b8d9b None None] MFA Rules not processed for user `884b748550d546b7a0bb2bc5b0c614d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:46.593568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6b636261-3104-4da4-8415-c9e72a1b8d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:46.608562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 930/1830] 10.222.0.81 () {58 vars in 1058 bytes} [Mon Aug 29 20:31:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:46.617425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b636261-3104-4da4-8415-c9e72a1b8d9b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:46.635731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 901/1831] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:46 2022] POST /identity/v3/projects => generated 385 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:46.636775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afaa9a-7825-4134-bc82-b5b5d99572d4 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:46.638345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b636261-3104-4da4-8415-c9e72a1b8d9b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:46.654530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:46.740151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fffcc-017e-4f4a-a585-efef612d3de7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:46.741140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fffcc-017e-4f4a-a585-efef612d3de7 service placement] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.741649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fffcc-017e-4f4a-a585-efef612d3de7 service placement] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.742107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fffcc-017e-4f4a-a585-efef612d3de7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.751004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afaa9a-7825-4134-bc82-b5b5d99572d4 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:46.757121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fffcc-017e-4f4a-a585-efef612d3de7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:46.759858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fffcc-017e-4f4a-a585-efef612d3de7 service placement] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:46.760784 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bc5b8-faa4-4f1d-a116-a2da423c8891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:46.762069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bc5b8-faa4-4f1d-a116-a2da423c8891 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.762378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bc5b8-faa4-4f1d-a116-a2da423c8891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.762781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bc5b8-faa4-4f1d-a116-a2da423c8891 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.763437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bc5b8-faa4-4f1d-a116-a2da423c8891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:46.765651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bc5b8-faa4-4f1d-a116-a2da423c8891 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:46.783663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 931/1832] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:31:46.825823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fffcc-017e-4f4a-a585-efef612d3de7 service placement] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:46.827390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ac1fffcc-017e-4f4a-a585-efef612d3de7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:46.842545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fffcc-017e-4f4a-a585-efef612d3de7 service placement] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:46.848950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:46.849256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.849604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.849943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] PATH_INFO: `/v3/projects/f4d36f215f4148f2ae15813909066e6c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.851882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d36f215f4148f2ae15813909066e6c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:46.854019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:46.958653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 902/1833] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:46 2022] POST /identity/v3/users => generated 299 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:46.959935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bc5b8-faa4-4f1d-a116-a2da423c8891 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:46.971037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bc5b8-faa4-4f1d-a116-a2da423c8891 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:46.976029 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1947d-c2bc-4a5d-82ac-042b2c3b9a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:46.976658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1947d-c2bc-4a5d-82ac-042b2c3b9a7a admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.976934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1947d-c2bc-4a5d-82ac-042b2c3b9a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.977209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1947d-c2bc-4a5d-82ac-042b2c3b9a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.978118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1947d-c2bc-4a5d-82ac-042b2c3b9a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:46.980254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1947d-c2bc-4a5d-82ac-042b2c3b9a7a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:46.994899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 903/1834] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:46.996516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1947d-c2bc-4a5d-82ac-042b2c3b9a7a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:47.009831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1947d-c2bc-4a5d-82ac-042b2c3b9a7a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:47.015226 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f154c9d-0e29-4994-9d74-c5086a9b821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:47.015909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f154c9d-0e29-4994-9d74-c5086a9b821c admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:47.016186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f154c9d-0e29-4994-9d74-c5086a9b821c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:47.016456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f154c9d-0e29-4994-9d74-c5086a9b821c admin admin] PATH_INFO: `/v3/projects/9164f7d86f354db28be6e43307d16269/users/466e748dc55e455b874165ba3ef9bf09/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:47.036610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f154c9d-0e29-4994-9d74-c5086a9b821c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9164f7d86f354db28be6e43307d16269, user_id=466e748dc55e455b874165ba3ef9bf09, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:47.039585 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f154c9d-0e29-4994-9d74-c5086a9b821c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:47.191614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 904/1835] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:46 2022] PUT /identity/v3/projects/9164f7d86f354db28be6e43307d16269/users/466e748dc55e455b874165ba3ef9bf09/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:47.200613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f154c9d-0e29-4994-9d74-c5086a9b821c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:47.200808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d36f215f4148f2ae15813909066e6c', 'request_id': 'req-a02cf634-1752-41da-99c3-47276f12c1e4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.204447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8f154c9d-0e29-4994-9d74-c5086a9b821c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:47.228841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d36f215f4148f2ae15813909066e6c', 'request_id': 'req-a02cf634-1752-41da-99c3-47276f12c1e4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.322474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f154c9d-0e29-4994-9d74-c5086a9b821c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:47.324232 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d36f215f4148f2ae15813909066e6c', 'request_id': 'req-a02cf634-1752-41da-99c3-47276f12c1e4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.343370 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] The token cache is being invalidate because project f4d36f215f4148f2ae15813909066e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:47.343597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.344808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:47.346266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.348168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:47.348523 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:47.355520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] PATH_INFO: `/v3/projects/0dedcd1a31f74c2abba52aeb124e738b` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:47.357054 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 932/1836] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:46 2022] DELETE /identity/v3/projects/f4d36f215f4148f2ae15813909066e6c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:31:47.357190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dedcd1a31f74c2abba52aeb124e738b)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:47.357310 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:47.386138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:47.388759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:47.549884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cf634-1752-41da-99c3-47276f12c1e4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:47.554925 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d6884-8397-4090-9a8b-24b6755e82ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:47.555711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6884-8397-4090-9a8b-24b6755e82ec admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:47.556432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6884-8397-4090-9a8b-24b6755e82ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:47.556868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6884-8397-4090-9a8b-24b6755e82ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:47.557820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d6884-8397-4090-9a8b-24b6755e82ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:47.560910 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d6884-8397-4090-9a8b-24b6755e82ec admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:47.571253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 933/1837] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:47.573929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853732-dfba-4930-b1c2-891b91caeb9d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:47.574460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853732-dfba-4930-b1c2-891b91caeb9d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:47.574944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853732-dfba-4930-b1c2-891b91caeb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:47.597907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3d853732-dfba-4930-b1c2-891b91caeb9d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:47.599198 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3d853732-dfba-4930-b1c2-891b91caeb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:47.612448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 934/1838] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:47.613435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d853732-dfba-4930-b1c2-891b91caeb9d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:47.624948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d853732-dfba-4930-b1c2-891b91caeb9d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:47.629895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563512a-4fa5-42e0-b586-f558fc31335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:47.630598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563512a-4fa5-42e0-b586-f558fc31335c admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:47.630879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563512a-4fa5-42e0-b586-f558fc31335c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:47.631170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563512a-4fa5-42e0-b586-f558fc31335c admin admin] PATH_INFO: `/v3/projects/9164f7d86f354db28be6e43307d16269/users/466e748dc55e455b874165ba3ef9bf09/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:47.633379 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563512a-4fa5-42e0-b586-f558fc31335c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9164f7d86f354db28be6e43307d16269, user_id=466e748dc55e455b874165ba3ef9bf09, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:47.636861 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563512a-4fa5-42e0-b586-f558fc31335c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:47.654309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 935/1839] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:47 2022] PUT /identity/v3/projects/9164f7d86f354db28be6e43307d16269/users/466e748dc55e455b874165ba3ef9bf09/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:47.656164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5ce1-2191-45b8-9566-0cca4721df6f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:47.656652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5ce1-2191-45b8-9566-0cca4721df6f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:47.657127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5ce1-2191-45b8-9566-0cca4721df6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:47.678720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a09f5ce1-2191-45b8-9566-0cca4721df6f None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:47.680003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a09f5ce1-2191-45b8-9566-0cca4721df6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:47.738686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dedcd1a31f74c2abba52aeb124e738b', 'request_id': 'req-397a1682-3327-4bc4-9041-04cec9a1c812'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.746286 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dedcd1a31f74c2abba52aeb124e738b', 'request_id': 'req-397a1682-3327-4bc4-9041-04cec9a1c812'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.752630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dedcd1a31f74c2abba52aeb124e738b', 'request_id': 'req-397a1682-3327-4bc4-9041-04cec9a1c812'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.783731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 936/1840] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:47.783731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade0885-db38-47e4-8f24-8eac90e426cd None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:47.783731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade0885-db38-47e4-8f24-8eac90e426cd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:47.783731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade0885-db38-47e4-8f24-8eac90e426cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:47.812797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4ade0885-db38-47e4-8f24-8eac90e426cd None None] MFA Rules not processed for user `466e748dc55e455b874165ba3ef9bf09`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:47.822851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4ade0885-db38-47e4-8f24-8eac90e426cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:47.843132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:47.897060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] The token cache is being invalidate because project 0dedcd1a31f74c2abba52aeb124e738b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:47.899293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.899293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.900883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 905/1841] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:47 2022] DELETE /identity/v3/projects/0dedcd1a31f74c2abba52aeb124e738b => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:47.901915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:47.902770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 937/1842] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:47.904793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:47.905582 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade0885-db38-47e4-8f24-8eac90e426cd None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:47.907236 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4ade0885-db38-47e4-8f24-8eac90e426cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:47.987342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a1682-3327-4bc4-9041-04cec9a1c812 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:47.992920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e94d6-f50f-441b-956f-4e26e487e2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:47.995092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e94d6-f50f-441b-956f-4e26e487e2ac admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:47.995092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e94d6-f50f-441b-956f-4e26e487e2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:47.995092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e94d6-f50f-441b-956f-4e26e487e2ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:47.995580 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e94d6-f50f-441b-956f-4e26e487e2ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:47.995963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e94d6-f50f-441b-956f-4e26e487e2ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:47.997718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e94d6-f50f-441b-956f-4e26e487e2ac admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:48.016890 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 906/1843] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:48.017941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e94d6-f50f-441b-956f-4e26e487e2ac admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:48.022760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b56e94d6-f50f-441b-956f-4e26e487e2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:48.035175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade0885-db38-47e4-8f24-8eac90e426cd None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:48.041981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:48.042963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.043252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.043529 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] PATH_INFO: `/v3/users/31c8990a79c44a82b4ea1122a8e356fb` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:48.044811 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c8990a79c44a82b4ea1122a8e356fb)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:48.047108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:48.113058 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e94d6-f50f-441b-956f-4e26e487e2ac admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:48.118885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90361b4f-224f-4322-96b6-3606ce9d6592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:48.120305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90361b4f-224f-4322-96b6-3606ce9d6592 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.120305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90361b4f-224f-4322-96b6-3606ce9d6592 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.120305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90361b4f-224f-4322-96b6-3606ce9d6592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:48.123288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-90361b4f-224f-4322-96b6-3606ce9d6592 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:48.141990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90361b4f-224f-4322-96b6-3606ce9d6592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:48.148552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90361b4f-224f-4322-96b6-3606ce9d6592 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:48.160295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 907/1844] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:48.161181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90361b4f-224f-4322-96b6-3606ce9d6592 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:48.177617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90361b4f-224f-4322-96b6-3606ce9d6592 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:48.184988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad07be5-1340-49a3-baa4-7d02d0c93284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:48.196162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad07be5-1340-49a3-baa4-7d02d0c93284 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.196162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad07be5-1340-49a3-baa4-7d02d0c93284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.196162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad07be5-1340-49a3-baa4-7d02d0c93284 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:48.196162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad07be5-1340-49a3-baa4-7d02d0c93284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:48.196162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad07be5-1340-49a3-baa4-7d02d0c93284 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:48.358646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 908/1845] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:48 2022] POST /identity/v3/projects => generated 359 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:48.360688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7e42f-bedf-4079-bf37-0e921f2753b3 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.361256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7e42f-bedf-4079-bf37-0e921f2753b3 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.361697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7e42f-bedf-4079-bf37-0e921f2753b3 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:48.363071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 909/1846] 10.222.0.81 () {54 vars in 921 bytes} [Mon Aug 29 20:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:48.363775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7e42f-bedf-4079-bf37-0e921f2753b3 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:48.365487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b9c7e42f-bedf-4079-bf37-0e921f2753b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:48.407899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c8990a79c44a82b4ea1122a8e356fb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.422271 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c8990a79c44a82b4ea1122a8e356fb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.424238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c8990a79c44a82b4ea1122a8e356fb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.425061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c8990a79c44a82b4ea1122a8e356fb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.433602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c8990a79c44a82b4ea1122a8e356fb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.437180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7e42f-bedf-4079-bf37-0e921f2753b3 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:48.442582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:48.443272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.443495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.443770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] PATH_INFO: `/v3/users/b3e7c85bb7244a6f8f77a827094fe189` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:48.445032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e7c85bb7244a6f8f77a827094fe189)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:48.447021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:48.615143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 938/1847] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:47 2022] DELETE /identity/v3/users/31c8990a79c44a82b4ea1122a8e356fb => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:48.616194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:48.617552 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:48.659454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:48.712942 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b764f-b94a-4f34-84fb-308e315a7624 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:48.717055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de5003-5f04-4a75-a74c-9e0c0540edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:48.717699 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de5003-5f04-4a75-a74c-9e0c0540edeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.717973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de5003-5f04-4a75-a74c-9e0c0540edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.718261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de5003-5f04-4a75-a74c-9e0c0540edeb admin admin] PATH_INFO: `/v3/users/916c6069352e4fe9b3a4ad6a29a2d58d` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:48.719423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de5003-5f04-4a75-a74c-9e0c0540edeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=916c6069352e4fe9b3a4ad6a29a2d58d)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:48.721587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de5003-5f04-4a75-a74c-9e0c0540edeb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:48.749247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e7c85bb7244a6f8f77a827094fe189'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.763029 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e7c85bb7244a6f8f77a827094fe189'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.769114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e7c85bb7244a6f8f77a827094fe189'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.886642 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e7c85bb7244a6f8f77a827094fe189'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.908924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e7c85bb7244a6f8f77a827094fe189'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.918717 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 910/1848] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:48 2022] DELETE /identity/v3/users/b3e7c85bb7244a6f8f77a827094fe189 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:48.922693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:48.924130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:48.996862 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a70f00-b540-41cc-b66a-bc3a45350935 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.004834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada59705-6ab9-4639-bcad-5fe594038a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.005460 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada59705-6ab9-4639-bcad-5fe594038a80 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.005742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada59705-6ab9-4639-bcad-5fe594038a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.006016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada59705-6ab9-4639-bcad-5fe594038a80 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.006698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada59705-6ab9-4639-bcad-5fe594038a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.010992 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada59705-6ab9-4639-bcad-5fe594038a80 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.011966 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f3de5003-5f04-4a75-a74c-9e0c0540edeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916c6069352e4fe9b3a4ad6a29a2d58d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:49.025604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f3de5003-5f04-4a75-a74c-9e0c0540edeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916c6069352e4fe9b3a4ad6a29a2d58d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:49.026553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f3de5003-5f04-4a75-a74c-9e0c0540edeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916c6069352e4fe9b3a4ad6a29a2d58d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:49.027192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f3de5003-5f04-4a75-a74c-9e0c0540edeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916c6069352e4fe9b3a4ad6a29a2d58d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:49.034268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f3de5003-5f04-4a75-a74c-9e0c0540edeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916c6069352e4fe9b3a4ad6a29a2d58d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:49.184572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 911/1849] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:48 2022] POST /identity/v3/users => generated 280 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:49.184572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b8ef-d7f9-49aa-8c21-b5aff5c57454 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.194284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b8ef-d7f9-49aa-8c21-b5aff5c57454 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.194284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b8ef-d7f9-49aa-8c21-b5aff5c57454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.194592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 939/1850] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:48 2022] DELETE /identity/v3/users/916c6069352e4fe9b3a4ad6a29a2d58d => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:49.194592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daef03-f256-46ac-8d52-d2fc1a624d37 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.194592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daef03-f256-46ac-8d52-d2fc1a624d37 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.194592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daef03-f256-46ac-8d52-d2fc1a624d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.229663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-8937b8ef-d7f9-49aa-8c21-b5aff5c57454 None None] MFA Rules not processed for user `884b748550d546b7a0bb2bc5b0c614d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:49.231211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8937b8ef-d7f9-49aa-8c21-b5aff5c57454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:49.237945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b6daef03-f256-46ac-8d52-d2fc1a624d37 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:49.240000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b6daef03-f256-46ac-8d52-d2fc1a624d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:49.360638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 940/1851] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:49.362082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6daef03-f256-46ac-8d52-d2fc1a624d37 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.363738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b6daef03-f256-46ac-8d52-d2fc1a624d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:49.368572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 912/1852] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Aug 29 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:49.369730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937b8ef-d7f9-49aa-8c21-b5aff5c57454 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.376576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8937b8ef-d7f9-49aa-8c21-b5aff5c57454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:49.387093 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6daef03-f256-46ac-8d52-d2fc1a624d37 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.389201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937b8ef-d7f9-49aa-8c21-b5aff5c57454 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.393901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.395435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb59bf-e7de-40c5-931a-e6eb55868c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.395813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.396197 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb59bf-e7de-40c5-931a-e6eb55868c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.396348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.396576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb59bf-e7de-40c5-931a-e6eb55868c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.396785 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] PATH_INFO: `/v3/projects/e01f34f4c50646f7b7c278fabd07be2f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.396936 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb59bf-e7de-40c5-931a-e6eb55868c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.397767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb59bf-e7de-40c5-931a-e6eb55868c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.398286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e01f34f4c50646f7b7c278fabd07be2f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.400488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb59bf-e7de-40c5-931a-e6eb55868c55 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.400989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.418278 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 913/1853] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:49.423369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb59bf-e7de-40c5-931a-e6eb55868c55 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.444694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb59bf-e7de-40c5-931a-e6eb55868c55 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.459545 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2998b-792c-4f8c-a897-33bed5fcf401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.460439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2998b-792c-4f8c-a897-33bed5fcf401 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.460928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2998b-792c-4f8c-a897-33bed5fcf401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.461565 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2998b-792c-4f8c-a897-33bed5fcf401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.463007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2998b-792c-4f8c-a897-33bed5fcf401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.465415 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2998b-792c-4f8c-a897-33bed5fcf401 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.485786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 914/1854] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:49.485786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2998b-792c-4f8c-a897-33bed5fcf401 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.492971 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d8a2998b-792c-4f8c-a897-33bed5fcf401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:49.595938 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e01f34f4c50646f7b7c278fabd07be2f', 'request_id': 'req-048af19f-523d-4d09-9546-1bc704463c9c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:49.606291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e01f34f4c50646f7b7c278fabd07be2f', 'request_id': 'req-048af19f-523d-4d09-9546-1bc704463c9c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:49.630315 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2998b-792c-4f8c-a897-33bed5fcf401 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.700356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e01f34f4c50646f7b7c278fabd07be2f', 'request_id': 'req-048af19f-523d-4d09-9546-1bc704463c9c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:49.729849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] The token cache is being invalidate because project e01f34f4c50646f7b7c278fabd07be2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:49.730481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:49.732610 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:49.735448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 941/1855] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:49 2022] DELETE /identity/v3/projects/e01f34f4c50646f7b7c278fabd07be2f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:49.738803 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.742193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:49.792195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a61ef-04d7-46f0-8709-5dce71b1ae70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.793012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a61ef-04d7-46f0-8709-5dce71b1ae70 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.793485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a61ef-04d7-46f0-8709-5dce71b1ae70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.793856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a61ef-04d7-46f0-8709-5dce71b1ae70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.798433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-1a8a61ef-04d7-46f0-8709-5dce71b1ae70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:49.839705 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048af19f-523d-4d09-9546-1bc704463c9c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.846578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322763ef-d6d9-43f0-8304-50cea5410e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.852299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322763ef-d6d9-43f0-8304-50cea5410e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.852299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322763ef-d6d9-43f0-8304-50cea5410e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.852299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322763ef-d6d9-43f0-8304-50cea5410e4a admin admin] PATH_INFO: `/v3/projects/03353d6491b34b6b8d711aa2a441b68f/users/b1ea160b1d82467db83413592d02f8fd/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.877408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322763ef-d6d9-43f0-8304-50cea5410e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03353d6491b34b6b8d711aa2a441b68f, user_id=b1ea160b1d82467db83413592d02f8fd, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.880589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322763ef-d6d9-43f0-8304-50cea5410e4a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.927602 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a61ef-04d7-46f0-8709-5dce71b1ae70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.929430 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a61ef-04d7-46f0-8709-5dce71b1ae70 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.945593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 915/1856] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:49.962372 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a61ef-04d7-46f0-8709-5dce71b1ae70 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.963270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-1a8a61ef-04d7-46f0-8709-5dce71b1ae70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:50.074476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a61ef-04d7-46f0-8709-5dce71b1ae70 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:50.080116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1889122-643b-4221-a665-3811dbcabdf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:50.080935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1889122-643b-4221-a665-3811dbcabdf9 service placement] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.081302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1889122-643b-4221-a665-3811dbcabdf9 service placement] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.081578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1889122-643b-4221-a665-3811dbcabdf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.083452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a1889122-643b-4221-a665-3811dbcabdf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:50.096179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1889122-643b-4221-a665-3811dbcabdf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:50.098036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1889122-643b-4221-a665-3811dbcabdf9 service placement] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.111293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 916/1857] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:50.112573 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fbd43-d410-4344-af7c-f7262afcee5e None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.112930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fbd43-d410-4344-af7c-f7262afcee5e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.113271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fbd43-d410-4344-af7c-f7262afcee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.136431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 942/1858] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:49 2022] PUT /identity/v3/projects/03353d6491b34b6b8d711aa2a441b68f/users/b1ea160b1d82467db83413592d02f8fd/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:50.156189 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0343521-c495-431e-9c2d-7e67c8657e75 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.156448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0343521-c495-431e-9c2d-7e67c8657e75 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.158740 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0343521-c495-431e-9c2d-7e67c8657e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.166306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-4c8fbd43-d410-4344-af7c-f7262afcee5e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:50.166306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4c8fbd43-d410-4344-af7c-f7262afcee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:50.197619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a0343521-c495-431e-9c2d-7e67c8657e75 None None] MFA Rules not processed for user `b1ea160b1d82467db83413592d02f8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:50.199143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a0343521-c495-431e-9c2d-7e67c8657e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:50.267233 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 917/1859] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:50.275141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fbd43-d410-4344-af7c-f7262afcee5e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:50.297459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4c8fbd43-d410-4344-af7c-f7262afcee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:50.307107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 943/1860] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:50.313775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fbd43-d410-4344-af7c-f7262afcee5e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:50.326891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9ebd0-4aa9-46d7-a4a3-8c54138120e4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.329552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:50.330501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.330962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.331145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9ebd0-4aa9-46d7-a4a3-8c54138120e4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.331345 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] PATH_INFO: `/v3/projects/ab531119751c4a40be30136ab7d63836` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.331429 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9ebd0-4aa9-46d7-a4a3-8c54138120e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.332878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab531119751c4a40be30136ab7d63836)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:50.335746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.374904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-48b9ebd0-4aa9-46d7-a4a3-8c54138120e4 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:50.376183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-48b9ebd0-4aa9-46d7-a4a3-8c54138120e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:50.391888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 944/1861] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:50.392872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9ebd0-4aa9-46d7-a4a3-8c54138120e4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:50.394381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-48b9ebd0-4aa9-46d7-a4a3-8c54138120e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:50.456928 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9ebd0-4aa9-46d7-a4a3-8c54138120e4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:50.460800 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff894921-5c9e-48b9-84de-2be4c7c321ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:50.461409 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff894921-5c9e-48b9-84de-2be4c7c321ee service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.461682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff894921-5c9e-48b9-84de-2be4c7c321ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.462638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff894921-5c9e-48b9-84de-2be4c7c321ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.471323 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff894921-5c9e-48b9-84de-2be4c7c321ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:50.472750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff894921-5c9e-48b9-84de-2be4c7c321ee service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.484636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 945/1862] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:50.484636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff894921-5c9e-48b9-84de-2be4c7c321ee service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:50.500762 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff894921-5c9e-48b9-84de-2be4c7c321ee service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:50.501216 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab531119751c4a40be30136ab7d63836', 'request_id': 'req-82fef132-fe09-4dfe-be65-223c90738c4c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:50.509215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab531119751c4a40be30136ab7d63836', 'request_id': 'req-82fef132-fe09-4dfe-be65-223c90738c4c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:50.515557 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab531119751c4a40be30136ab7d63836', 'request_id': 'req-82fef132-fe09-4dfe-be65-223c90738c4c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:50.561074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a9c56-c819-465a-b715-ba6884d53322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:50.561596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a9c56-c819-465a-b715-ba6884d53322 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.561872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a9c56-c819-465a-b715-ba6884d53322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.562140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a9c56-c819-465a-b715-ba6884d53322 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.562809 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a9c56-c819-465a-b715-ba6884d53322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:50.563110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a9c56-c819-465a-b715-ba6884d53322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:50.564781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a9c56-c819-465a-b715-ba6884d53322 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.579435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 946/1863] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:50.581308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a9c56-c819-465a-b715-ba6884d53322 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:50.593142 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a9c56-c819-465a-b715-ba6884d53322 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:50.598456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:50.599122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.599370 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.599642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] PATH_INFO: `/v3/users/b1ea160b1d82467db83413592d02f8fd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.600799 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ea160b1d82467db83413592d02f8fd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:50.602782 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.660568 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] The token cache is being invalidate because project ab531119751c4a40be30136ab7d63836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:50.660882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:50.668046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:50.668046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 918/1864] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:50 2022] DELETE /identity/v3/projects/ab531119751c4a40be30136ab7d63836 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:50.668046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:50.668046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:50.682711 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fef132-fe09-4dfe-be65-223c90738c4c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:50.691784 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c6390-ee92-4c55-a44e-63df50152143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:50.692733 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c6390-ee92-4c55-a44e-63df50152143 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.693259 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c6390-ee92-4c55-a44e-63df50152143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.693736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c6390-ee92-4c55-a44e-63df50152143 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.694847 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c6390-ee92-4c55-a44e-63df50152143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:50.699226 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c6390-ee92-4c55-a44e-63df50152143 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.792017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:50.862204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 919/1865] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:50 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:50.863561 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c6390-ee92-4c55-a44e-63df50152143 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:50.865227 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f37c6390-ee92-4c55-a44e-63df50152143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:50.936365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c6390-ee92-4c55-a44e-63df50152143 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:50.943190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23105c27-62a4-49b9-b727-fb794212a00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:50.943845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23105c27-62a4-49b9-b727-fb794212a00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.944133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23105c27-62a4-49b9-b727-fb794212a00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.944524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23105c27-62a4-49b9-b727-fb794212a00b admin admin] PATH_INFO: `/v3/users/370e856631fc4b0bb80b019dd35ca799` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.945579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23105c27-62a4-49b9-b727-fb794212a00b admin admin] RBAC: Authorizing `identity:delete_user(user_id=370e856631fc4b0bb80b019dd35ca799)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:50.948166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23105c27-62a4-49b9-b727-fb794212a00b admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.958298 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ea160b1d82467db83413592d02f8fd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:50.971452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ea160b1d82467db83413592d02f8fd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:50.972363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ea160b1d82467db83413592d02f8fd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:50.973224 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ea160b1d82467db83413592d02f8fd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:50.981931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ea160b1d82467db83413592d02f8fd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.115787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 947/1866] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:50 2022] DELETE /identity/v3/users/b1ea160b1d82467db83413592d02f8fd => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:51.117336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:51.120620 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.193235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484d9b-a143-4af5-8f8d-db7bb4cba47c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:51.198192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd70e57-e7a7-4f31-a19d-575c78b8c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:51.198829 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd70e57-e7a7-4f31-a19d-575c78b8c18b admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.199105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd70e57-e7a7-4f31-a19d-575c78b8c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.199376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd70e57-e7a7-4f31-a19d-575c78b8c18b admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.200012 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd70e57-e7a7-4f31-a19d-575c78b8c18b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:51.201919 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd70e57-e7a7-4f31-a19d-575c78b8c18b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:51.243057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-23105c27-62a4-49b9-b727-fb794212a00b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370e856631fc4b0bb80b019dd35ca799'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.250942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-23105c27-62a4-49b9-b727-fb794212a00b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370e856631fc4b0bb80b019dd35ca799'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.251665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-23105c27-62a4-49b9-b727-fb794212a00b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370e856631fc4b0bb80b019dd35ca799'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.335416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 948/1867] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:51 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:51.336272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd70e57-e7a7-4f31-a19d-575c78b8c18b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:51.340636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4cd70e57-e7a7-4f31-a19d-575c78b8c18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.356197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd70e57-e7a7-4f31-a19d-575c78b8c18b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:51.361754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:51.362421 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.362704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.362976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] PATH_INFO: `/v3/projects/50afb0e54bd743b186f7d6d6f890afe6` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.364113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50afb0e54bd743b186f7d6d6f890afe6)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:51.366272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:51.370010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-23105c27-62a4-49b9-b727-fb794212a00b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370e856631fc4b0bb80b019dd35ca799'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.385857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-23105c27-62a4-49b9-b727-fb794212a00b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370e856631fc4b0bb80b019dd35ca799'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.393030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 920/1868] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:50 2022] DELETE /identity/v3/users/370e856631fc4b0bb80b019dd35ca799 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:51.394820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7713-82ca-46b0-af47-ed44b85adf8e None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.395319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7713-82ca-46b0-af47-ed44b85adf8e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.395850 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7713-82ca-46b0-af47-ed44b85adf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.437901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-1f3c7713-82ca-46b0-af47-ed44b85adf8e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:51.439562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-1f3c7713-82ca-46b0-af47-ed44b85adf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.518431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 921/1869] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:51.519719 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c7713-82ca-46b0-af47-ed44b85adf8e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:51.521508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-1f3c7713-82ca-46b0-af47-ed44b85adf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.535893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c7713-82ca-46b0-af47-ed44b85adf8e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:51.550737 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca2318-5d49-468d-a0c6-52073c104280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:51.553828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca2318-5d49-468d-a0c6-52073c104280 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.558447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca2318-5d49-468d-a0c6-52073c104280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.559150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca2318-5d49-468d-a0c6-52073c104280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.561269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca2318-5d49-468d-a0c6-52073c104280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:51.563890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:51.570560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca2318-5d49-468d-a0c6-52073c104280 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:51.593350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 922/1870] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:51.594387 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca2318-5d49-468d-a0c6-52073c104280 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:51.595582 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50afb0e54bd743b186f7d6d6f890afe6', 'request_id': 'req-d6daf1ea-fc0e-4616-99a3-25071c99a785'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.603581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c2ca2318-5d49-468d-a0c6-52073c104280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.603920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50afb0e54bd743b186f7d6d6f890afe6', 'request_id': 'req-d6daf1ea-fc0e-4616-99a3-25071c99a785'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.722147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca2318-5d49-468d-a0c6-52073c104280 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:51.797744 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50afb0e54bd743b186f7d6d6f890afe6', 'request_id': 'req-d6daf1ea-fc0e-4616-99a3-25071c99a785'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.815264 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] The token cache is being invalidate because project 50afb0e54bd743b186f7d6d6f890afe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:51.815821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.816888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.818897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 949/1871] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:51 2022] DELETE /identity/v3/projects/50afb0e54bd743b186f7d6d6f890afe6 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:51.824329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:51.832125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f84a91-fc97-4da0-b5a7-d75d3502e069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:51.833360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f84a91-fc97-4da0-b5a7-d75d3502e069 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.833763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f84a91-fc97-4da0-b5a7-d75d3502e069 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.834170 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f84a91-fc97-4da0-b5a7-d75d3502e069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.841753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.843209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b1f84a91-fc97-4da0-b5a7-d75d3502e069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.974072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f84a91-fc97-4da0-b5a7-d75d3502e069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:51.976683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f84a91-fc97-4da0-b5a7-d75d3502e069 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:51.995020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 923/1872] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:51.996468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f84a91-fc97-4da0-b5a7-d75d3502e069 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:51.998276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b1f84a91-fc97-4da0-b5a7-d75d3502e069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.015443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daf1ea-fc0e-4616-99a3-25071c99a785 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:52.017594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f84a91-fc97-4da0-b5a7-d75d3502e069 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:52.020890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd9069-dc7e-43be-b2df-9eff953f0095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:52.021658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd9069-dc7e-43be-b2df-9eff953f0095 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.021949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd9069-dc7e-43be-b2df-9eff953f0095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.022567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd9069-dc7e-43be-b2df-9eff953f0095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.023237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd9069-dc7e-43be-b2df-9eff953f0095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:52.025254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:52.025703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd9069-dc7e-43be-b2df-9eff953f0095 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:52.027120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.027650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.028317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] PATH_INFO: `/v3/users/466e748dc55e455b874165ba3ef9bf09` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.029759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=466e748dc55e455b874165ba3ef9bf09)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:52.032499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:52.043355 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 950/1873] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:52.045440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd9069-dc7e-43be-b2df-9eff953f0095 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:52.072745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd9069-dc7e-43be-b2df-9eff953f0095 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:52.086649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06e878-0bb2-4d24-b2f7-2dd26a4a347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:52.087580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e878-0bb2-4d24-b2f7-2dd26a4a347b admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.088012 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e878-0bb2-4d24-b2f7-2dd26a4a347b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.088433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e878-0bb2-4d24-b2f7-2dd26a4a347b admin admin] PATH_INFO: `/v3/projects/52f7201a21b64014b10354ec12879bf2/users/5aa0acb67d19473cba94daeedde11397/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.115893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06e878-0bb2-4d24-b2f7-2dd26a4a347b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f7201a21b64014b10354ec12879bf2, user_id=5aa0acb67d19473cba94daeedde11397, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:52.119682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06e878-0bb2-4d24-b2f7-2dd26a4a347b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:52.250447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 951/1874] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:52 2022] PUT /identity/v3/projects/52f7201a21b64014b10354ec12879bf2/users/5aa0acb67d19473cba94daeedde11397/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:52.262052 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c3571-bc47-4a03-8cdb-f783bf8e070c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.262677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c3571-bc47-4a03-8cdb-f783bf8e070c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.263153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c3571-bc47-4a03-8cdb-f783bf8e070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.280925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466e748dc55e455b874165ba3ef9bf09'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.295822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466e748dc55e455b874165ba3ef9bf09'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.296729 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466e748dc55e455b874165ba3ef9bf09'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.317404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-906c3571-bc47-4a03-8cdb-f783bf8e070c None None] MFA Rules not processed for user `5aa0acb67d19473cba94daeedde11397`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:52.318860 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-906c3571-bc47-4a03-8cdb-f783bf8e070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.386437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466e748dc55e455b874165ba3ef9bf09'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.412439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466e748dc55e455b874165ba3ef9bf09'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.420459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 952/1875] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:52.457943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c3571-bc47-4a03-8cdb-f783bf8e070c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:52.457943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-906c3571-bc47-4a03-8cdb-f783bf8e070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.459570 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 924/1876] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:51 2022] DELETE /identity/v3/users/466e748dc55e455b874165ba3ef9bf09 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:52.556559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c3571-bc47-4a03-8cdb-f783bf8e070c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:52.626755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c207b97-9f48-4370-9e2a-849d2175a266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:52.627928 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c207b97-9f48-4370-9e2a-849d2175a266 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.628751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c207b97-9f48-4370-9e2a-849d2175a266 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.629068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c207b97-9f48-4370-9e2a-849d2175a266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.758558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c207b97-9f48-4370-9e2a-849d2175a266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:52.770179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c207b97-9f48-4370-9e2a-849d2175a266 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:52.797578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 953/1877] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:52.812530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:52.814015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.870101 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c207b97-9f48-4370-9e2a-849d2175a266 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:52.870101 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1c207b97-9f48-4370-9e2a-849d2175a266 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.949878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af688251-34c9-45bb-94e4-2f8b927315e7 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:52.972757 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04279e54-5bc0-417b-a38e-092feba42b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:52.973718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04279e54-5bc0-417b-a38e-092feba42b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.974355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04279e54-5bc0-417b-a38e-092feba42b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.974930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04279e54-5bc0-417b-a38e-092feba42b61 admin admin] PATH_INFO: `/v3/users/5aa0acb67d19473cba94daeedde11397` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.976361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04279e54-5bc0-417b-a38e-092feba42b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa0acb67d19473cba94daeedde11397)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:52.980365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04279e54-5bc0-417b-a38e-092feba42b61 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.046478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c207b97-9f48-4370-9e2a-849d2175a266 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.054447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.055469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.055469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.056321 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01 admin admin] PATH_INFO: `/v3/projects/f3573c715ceb4d78bb03790268ac028e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.058072 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3573c715ceb4d78bb03790268ac028e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.063240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.289244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-04279e54-5bc0-417b-a38e-092feba42b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa0acb67d19473cba94daeedde11397'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:53.311511 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-04279e54-5bc0-417b-a38e-092feba42b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa0acb67d19473cba94daeedde11397'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:53.314033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-04279e54-5bc0-417b-a38e-092feba42b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa0acb67d19473cba94daeedde11397'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:53.315176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3573c715ceb4d78bb03790268ac028e', 'request_id': 'req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:53.360144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3573c715ceb4d78bb03790268ac028e', 'request_id': 'req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:53.466615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-04279e54-5bc0-417b-a38e-092feba42b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa0acb67d19473cba94daeedde11397'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:53.490928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-04279e54-5bc0-417b-a38e-092feba42b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa0acb67d19473cba94daeedde11397'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:53.513788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 925/1878] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:52 2022] DELETE /identity/v3/users/5aa0acb67d19473cba94daeedde11397 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:53.515818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eede6-c2db-4caf-8a8d-a9020e3b99b1 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.516321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eede6-c2db-4caf-8a8d-a9020e3b99b1 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.516794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eede6-c2db-4caf-8a8d-a9020e3b99b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.540643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-af1eede6-c2db-4caf-8a8d-a9020e3b99b1 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:53.542322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-af1eede6-c2db-4caf-8a8d-a9020e3b99b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:53.570519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3573c715ceb4d78bb03790268ac028e', 'request_id': 'req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:53.591218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01 admin admin] The token cache is being invalidate because project f3573c715ceb4d78bb03790268ac028e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:53.591632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:53.592577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1b61ad76-b99f-45cc-bccc-51ee44fa5c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:53.595277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 954/1879] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:52 2022] DELETE /identity/v3/projects/f3573c715ceb4d78bb03790268ac028e => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:31:53.601848 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e494b7a-713d-4496-b4e6-4f9ce1de04d6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.602831 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e494b7a-713d-4496-b4e6-4f9ce1de04d6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.603512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e494b7a-713d-4496-b4e6-4f9ce1de04d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.683106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0e494b7a-713d-4496-b4e6-4f9ce1de04d6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:53.684150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 926/1880] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:53.684330 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0e494b7a-713d-4496-b4e6-4f9ce1de04d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:53.688426 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eede6-c2db-4caf-8a8d-a9020e3b99b1 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.690393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-af1eede6-c2db-4caf-8a8d-a9020e3b99b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:53.707699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eede6-c2db-4caf-8a8d-a9020e3b99b1 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.708385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 955/1881] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:53.716123 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce6ff7-d775-476b-a0a9-b32ebff2647a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.716408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce6ff7-d775-476b-a0a9-b32ebff2647a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.716685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce6ff7-d775-476b-a0a9-b32ebff2647a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.721667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.722376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.722664 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.722938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] PATH_INFO: `/v3/projects/03353d6491b34b6b8d711aa2a441b68f` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.724206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03353d6491b34b6b8d711aa2a441b68f)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.727143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.763937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3cce6ff7-d775-476b-a0a9-b32ebff2647a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:53.764706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3cce6ff7-d775-476b-a0a9-b32ebff2647a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:53.776384 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 956/1882] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:53.777574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce6ff7-d775-476b-a0a9-b32ebff2647a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.789980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce6ff7-d775-476b-a0a9-b32ebff2647a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.796866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96906f-6182-4161-b468-909294408103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.797785 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96906f-6182-4161-b468-909294408103 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.807900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96906f-6182-4161-b468-909294408103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.807900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96906f-6182-4161-b468-909294408103 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.807900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96906f-6182-4161-b468-909294408103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:53.807900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96906f-6182-4161-b468-909294408103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.807900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96906f-6182-4161-b468-909294408103 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.822177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 957/1883] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:53.822177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96906f-6182-4161-b468-909294408103 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.822177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9c96906f-6182-4161-b468-909294408103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:53.957007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03353d6491b34b6b8d711aa2a441b68f', 'request_id': 'req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:53.975395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03353d6491b34b6b8d711aa2a441b68f', 'request_id': 'req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:53.998153 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03353d6491b34b6b8d711aa2a441b68f', 'request_id': 'req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:54.004286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96906f-6182-4161-b468-909294408103 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.079121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37707f75-914c-426e-be44-f87eebc94363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.079756 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37707f75-914c-426e-be44-f87eebc94363 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.080233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37707f75-914c-426e-be44-f87eebc94363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.081004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37707f75-914c-426e-be44-f87eebc94363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.140531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] The token cache is being invalidate because project 03353d6491b34b6b8d711aa2a441b68f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:54.140875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:54.141959 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:54.147265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 927/1884] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:53 2022] DELETE /identity/v3/projects/03353d6491b34b6b8d711aa2a441b68f => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:31:54.148166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.159844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:54.278095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37707f75-914c-426e-be44-f87eebc94363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.295243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37707f75-914c-426e-be44-f87eebc94363 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.315684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf305e-f2a7-4fe3-8041-f95af9e0c556 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.323455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 958/1885] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:54.326029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37707f75-914c-426e-be44-f87eebc94363 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.328268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-37707f75-914c-426e-be44-f87eebc94363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:54.328415 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6b7fd-3fec-4cce-892e-a3322e455269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.329009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6b7fd-3fec-4cce-892e-a3322e455269 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.329509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6b7fd-3fec-4cce-892e-a3322e455269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.329843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6b7fd-3fec-4cce-892e-a3322e455269 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.330554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6b7fd-3fec-4cce-892e-a3322e455269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.332938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6b7fd-3fec-4cce-892e-a3322e455269 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.375252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37707f75-914c-426e-be44-f87eebc94363 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.395055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.395870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.396787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.397214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4 admin admin] PATH_INFO: `/v3/projects/9164f7d86f354db28be6e43307d16269` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.401064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9164f7d86f354db28be6e43307d16269)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.405813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.523356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 928/1886] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/projects => generated 371 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:54.527334 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610be9d9-2fb0-40b1-8561-eca85bad6247 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.527882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610be9d9-2fb0-40b1-8561-eca85bad6247 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.530930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610be9d9-2fb0-40b1-8561-eca85bad6247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.578329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-610be9d9-2fb0-40b1-8561-eca85bad6247 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:54.579277 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-610be9d9-2fb0-40b1-8561-eca85bad6247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:54.597409 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9164f7d86f354db28be6e43307d16269', 'request_id': 'req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:54.605724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9164f7d86f354db28be6e43307d16269', 'request_id': 'req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:54.637969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:54.692611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 929/1887] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:54.693724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610be9d9-2fb0-40b1-8561-eca85bad6247 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.708330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610be9d9-2fb0-40b1-8561-eca85bad6247 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.715448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9164f7d86f354db28be6e43307d16269', 'request_id': 'req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:54.719310 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137673f-1d5b-4e72-bb7f-3d4d2cd20bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.719940 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137673f-1d5b-4e72-bb7f-3d4d2cd20bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.720222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137673f-1d5b-4e72-bb7f-3d4d2cd20bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.720495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137673f-1d5b-4e72-bb7f-3d4d2cd20bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.721137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137673f-1d5b-4e72-bb7f-3d4d2cd20bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.723173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137673f-1d5b-4e72-bb7f-3d4d2cd20bb6 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.728972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4 admin admin] The token cache is being invalidate because project 9164f7d86f354db28be6e43307d16269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:54.729685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:54.730845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f36e90d3-b404-4a48-80e5-b54a2f6d67d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:54.738345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 959/1888] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:54 2022] DELETE /identity/v3/projects/9164f7d86f354db28be6e43307d16269 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:54.741085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c772e2-ab52-43c7-821c-31bb8ab5abc7 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.742074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c772e2-ab52-43c7-821c-31bb8ab5abc7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.742074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c772e2-ab52-43c7-821c-31bb8ab5abc7 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.745199 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 960/1889] 10.222.0.81 () {54 vars in 921 bytes} [Mon Aug 29 20:31:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:54.747139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecfe15-d9a7-4ecd-9414-8f58aa7544e7 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.747337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecfe15-d9a7-4ecd-9414-8f58aa7544e7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.747710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecfe15-d9a7-4ecd-9414-8f58aa7544e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.774910 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-cfecfe15-d9a7-4ecd-9414-8f58aa7544e7 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:54.776462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cfecfe15-d9a7-4ecd-9414-8f58aa7544e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:54.785176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 961/1890] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:54.787150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63c839-ef00-43c2-9457-fa7b73975126 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.787150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63c839-ef00-43c2-9457-fa7b73975126 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.787150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63c839-ef00-43c2-9457-fa7b73975126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.814383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ab63c839-ef00-43c2-9457-fa7b73975126 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:54.815902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ab63c839-ef00-43c2-9457-fa7b73975126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:54.825018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 962/1891] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:54.826477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cc80e-58e7-486c-a910-3ca240fabb90 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.827181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cc80e-58e7-486c-a910-3ca240fabb90 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.827181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cc80e-58e7-486c-a910-3ca240fabb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.849953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3f4cc80e-58e7-486c-a910-3ca240fabb90 None None] MFA Rules not processed for user `30946d3b3f0f4a81b2ae5aa6e84f3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:54.851229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3f4cc80e-58e7-486c-a910-3ca240fabb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:54.880599 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 930/1892] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:54.881421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137673f-1d5b-4e72-bb7f-3d4d2cd20bb6 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.893895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137673f-1d5b-4e72-bb7f-3d4d2cd20bb6 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.898967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41086e71-5150-4df1-b8b0-fc6247870fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.900250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41086e71-5150-4df1-b8b0-fc6247870fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.900578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41086e71-5150-4df1-b8b0-fc6247870fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.900921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41086e71-5150-4df1-b8b0-fc6247870fd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.901638 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41086e71-5150-4df1-b8b0-fc6247870fd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:54.902012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41086e71-5150-4df1-b8b0-fc6247870fd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.903726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41086e71-5150-4df1-b8b0-fc6247870fd8 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.918429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 931/1893] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:54.919724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdb789-3d9f-4e18-bea3-50582332b546 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.920012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdb789-3d9f-4e18-bea3-50582332b546 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.920291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdb789-3d9f-4e18-bea3-50582332b546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.936288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 963/1894] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:54.937388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cc80e-58e7-486c-a910-3ca240fabb90 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.939262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3f4cc80e-58e7-486c-a910-3ca240fabb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:54.942384 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-61bdb789-3d9f-4e18-bea3-50582332b546 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:54.944192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-61bdb789-3d9f-4e18-bea3-50582332b546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:54.952718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 932/1895] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:54.956598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdb789-3d9f-4e18-bea3-50582332b546 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.959373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cc80e-58e7-486c-a910-3ca240fabb90 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.969617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdb789-3d9f-4e18-bea3-50582332b546 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.970790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae90cf-1080-4525-b360-6cd7271e38a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.971606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae90cf-1080-4525-b360-6cd7271e38a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.971893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae90cf-1080-4525-b360-6cd7271e38a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.972167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae90cf-1080-4525-b360-6cd7271e38a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.972823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae90cf-1080-4525-b360-6cd7271e38a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.975264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8bb3e-22f1-46f8-96a8-3543703dddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.975794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae90cf-1080-4525-b360-6cd7271e38a7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.976464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8bb3e-22f1-46f8-96a8-3543703dddc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.976884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8bb3e-22f1-46f8-96a8-3543703dddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.977254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8bb3e-22f1-46f8-96a8-3543703dddc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.978673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8bb3e-22f1-46f8-96a8-3543703dddc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.981382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8bb3e-22f1-46f8-96a8-3543703dddc2 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.989479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 964/1896] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:54.990519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae90cf-1080-4525-b360-6cd7271e38a7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.993224 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-10ae90cf-1080-4525-b360-6cd7271e38a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:55.012865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae90cf-1080-4525-b360-6cd7271e38a7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.023077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913dee3-0fe8-47d4-9dad-fc94e6b9e4ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.023213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:55.023318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913dee3-0fe8-47d4-9dad-fc94e6b9e4ef service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.023318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913dee3-0fe8-47d4-9dad-fc94e6b9e4ef service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.023318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913dee3-0fe8-47d4-9dad-fc94e6b9e4ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.031964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913dee3-0fe8-47d4-9dad-fc94e6b9e4ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.033577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913dee3-0fe8-47d4-9dad-fc94e6b9e4ef service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.046826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 965/1897] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:55.052847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913dee3-0fe8-47d4-9dad-fc94e6b9e4ef service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.073695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913dee3-0fe8-47d4-9dad-fc94e6b9e4ef service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.082301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5e076-2f34-4a66-b429-a76365a0682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.082930 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5e076-2f34-4a66-b429-a76365a0682d admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.083093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 933/1898] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:55.084709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5e076-2f34-4a66-b429-a76365a0682d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.084709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5e076-2f34-4a66-b429-a76365a0682d admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.084709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5e076-2f34-4a66-b429-a76365a0682d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:55.085164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8bb3e-22f1-46f8-96a8-3543703dddc2 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.085258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5e076-2f34-4a66-b429-a76365a0682d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.086287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5e076-2f34-4a66-b429-a76365a0682d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.087300 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f1e8bb3e-22f1-46f8-96a8-3543703dddc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:55.104797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 966/1899] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:55.104797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5e076-2f34-4a66-b429-a76365a0682d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.113611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5e076-2f34-4a66-b429-a76365a0682d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.178519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8bb3e-22f1-46f8-96a8-3543703dddc2 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.184915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.185628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.185931 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.186181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] PATH_INFO: `/v3/projects/52f7201a21b64014b10354ec12879bf2` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.187576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f7201a21b64014b10354ec12879bf2)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.189494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.194771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12048dd-ea1e-4350-9605-f0a390b0a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.195630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12048dd-ea1e-4350-9605-f0a390b0a425 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.195980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12048dd-ea1e-4350-9605-f0a390b0a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.196373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12048dd-ea1e-4350-9605-f0a390b0a425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.197461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12048dd-ea1e-4350-9605-f0a390b0a425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.199364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12048dd-ea1e-4350-9605-f0a390b0a425 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.225957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 967/1900] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:55.227008 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12048dd-ea1e-4350-9605-f0a390b0a425 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.239989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12048dd-ea1e-4350-9605-f0a390b0a425 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.245978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b246bd-bf4a-4659-bea3-700e661bfac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.249258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b246bd-bf4a-4659-bea3-700e661bfac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.249258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b246bd-bf4a-4659-bea3-700e661bfac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.249258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b246bd-bf4a-4659-bea3-700e661bfac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.249258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b246bd-bf4a-4659-bea3-700e661bfac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.251628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b246bd-bf4a-4659-bea3-700e661bfac8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.327693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f7201a21b64014b10354ec12879bf2', 'request_id': 'req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:55.336305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f7201a21b64014b10354ec12879bf2', 'request_id': 'req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:55.343048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 968/1901] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:55 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:55.343048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b246bd-bf4a-4659-bea3-700e661bfac8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.350537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f7201a21b64014b10354ec12879bf2', 'request_id': 'req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:55.383605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b246bd-bf4a-4659-bea3-700e661bfac8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.450701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] The token cache is being invalidate because project 52f7201a21b64014b10354ec12879bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:55.453695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:55.453695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:55.453695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 934/1902] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:55 2022] DELETE /identity/v3/projects/52f7201a21b64014b10354ec12879bf2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:55.454411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.455817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:55.563601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a3c78-f92b-4a66-ac3c-4990f298dc4c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.568865 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61ef86-54b3-4fde-b3b9-18881cb9fc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.569446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f6431-5f72-4ecd-a25c-3572ce4bd830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.569739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61ef86-54b3-4fde-b3b9-18881cb9fc2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.570097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61ef86-54b3-4fde-b3b9-18881cb9fc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.570488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61ef86-54b3-4fde-b3b9-18881cb9fc2e admin admin] PATH_INFO: `/v3/projects/808e1d597f484f109cf155ab881cb73b/users/e87702bf4b7d412da8a7cfcd024ec8de/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.570884 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f6431-5f72-4ecd-a25c-3572ce4bd830 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.574002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f6431-5f72-4ecd-a25c-3572ce4bd830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.574593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f6431-5f72-4ecd-a25c-3572ce4bd830 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.575904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f6431-5f72-4ecd-a25c-3572ce4bd830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.586575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f6431-5f72-4ecd-a25c-3572ce4bd830 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.590791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61ef86-54b3-4fde-b3b9-18881cb9fc2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=808e1d597f484f109cf155ab881cb73b, user_id=e87702bf4b7d412da8a7cfcd024ec8de, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.593731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61ef86-54b3-4fde-b3b9-18881cb9fc2e admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.735637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 935/1903] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:55 2022] PUT /identity/v3/projects/808e1d597f484f109cf155ab881cb73b/users/e87702bf4b7d412da8a7cfcd024ec8de/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:55.738041 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61ef86-54b3-4fde-b3b9-18881cb9fc2e admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.748901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3e61ef86-54b3-4fde-b3b9-18881cb9fc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:55.750981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 969/1904] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:55 2022] POST /identity/v3/projects => generated 379 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:55.752325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e7409-370b-4df9-a517-bb10e15ac5eb None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.752646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e7409-370b-4df9-a517-bb10e15ac5eb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.752921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e7409-370b-4df9-a517-bb10e15ac5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.779200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0b3e7409-370b-4df9-a517-bb10e15ac5eb None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:55.780842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0b3e7409-370b-4df9-a517-bb10e15ac5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:55.894278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 970/1905] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:55.894278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87655c-f7e7-45df-b7d7-a4ae59ef9022 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.894278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87655c-f7e7-45df-b7d7-a4ae59ef9022 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.894278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87655c-f7e7-45df-b7d7-a4ae59ef9022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.924232 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-8e87655c-f7e7-45df-b7d7-a4ae59ef9022 None None] MFA Rules not processed for user `e87702bf4b7d412da8a7cfcd024ec8de`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:55.925571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8e87655c-f7e7-45df-b7d7-a4ae59ef9022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:55.944081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61ef86-54b3-4fde-b3b9-18881cb9fc2e admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.959423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d579ac-e387-4919-a09f-76e5a3668474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.960822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d579ac-e387-4919-a09f-76e5a3668474 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.961289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d579ac-e387-4919-a09f-76e5a3668474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.962789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d579ac-e387-4919-a09f-76e5a3668474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.964286 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d579ac-e387-4919-a09f-76e5a3668474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.968542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d579ac-e387-4919-a09f-76e5a3668474 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.019390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 936/1906] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:56.021071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d579ac-e387-4919-a09f-76e5a3668474 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.026166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c5d579ac-e387-4919-a09f-76e5a3668474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:56.037356 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 971/1907] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:56.038730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791c496-6974-481d-ac1f-21ac8e447852 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.040580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791c496-6974-481d-ac1f-21ac8e447852 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.041320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791c496-6974-481d-ac1f-21ac8e447852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.065367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d579ac-e387-4919-a09f-76e5a3668474 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.080113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde63c64-e123-4e46-9cbf-6fcc05d384ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.080747 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde63c64-e123-4e46-9cbf-6fcc05d384ab admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.081161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde63c64-e123-4e46-9cbf-6fcc05d384ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.081429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde63c64-e123-4e46-9cbf-6fcc05d384ab admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.082078 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde63c64-e123-4e46-9cbf-6fcc05d384ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.084098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde63c64-e123-4e46-9cbf-6fcc05d384ab admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.091506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9791c496-6974-481d-ac1f-21ac8e447852 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:56.099776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9791c496-6974-481d-ac1f-21ac8e447852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:56.115198 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 972/1908] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:56.116154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791c496-6974-481d-ac1f-21ac8e447852 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.129028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791c496-6974-481d-ac1f-21ac8e447852 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.141179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea378e55-3221-4e98-92c4-6af4dd0f566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.141870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea378e55-3221-4e98-92c4-6af4dd0f566a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.142152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea378e55-3221-4e98-92c4-6af4dd0f566a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.142454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea378e55-3221-4e98-92c4-6af4dd0f566a admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.143723 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea378e55-3221-4e98-92c4-6af4dd0f566a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.146147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea378e55-3221-4e98-92c4-6af4dd0f566a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.173291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 973/1909] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:56.174929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea378e55-3221-4e98-92c4-6af4dd0f566a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.197284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea378e55-3221-4e98-92c4-6af4dd0f566a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.206605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 937/1910] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:56 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:56.207935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde63c64-e123-4e46-9cbf-6fcc05d384ab admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.212843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d6453-3edf-4b52-b503-8eeba28fb062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.212843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6453-3edf-4b52-b503-8eeba28fb062 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.216074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6453-3edf-4b52-b503-8eeba28fb062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.216540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6453-3edf-4b52-b503-8eeba28fb062 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.217566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d6453-3edf-4b52-b503-8eeba28fb062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.223103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d6453-3edf-4b52-b503-8eeba28fb062 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.231218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde63c64-e123-4e46-9cbf-6fcc05d384ab admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.257623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ccb79-769c-4b04-aa61-de7b4a9bdcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.259852 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ccb79-769c-4b04-aa61-de7b4a9bdcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.260354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ccb79-769c-4b04-aa61-de7b4a9bdcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.260740 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ccb79-769c-4b04-aa61-de7b4a9bdcf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.261657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ccb79-769c-4b04-aa61-de7b4a9bdcf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:56.262072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ccb79-769c-4b04-aa61-de7b4a9bdcf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.265291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ccb79-769c-4b04-aa61-de7b4a9bdcf1 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.292080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 938/1911] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:56.293477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ccb79-769c-4b04-aa61-de7b4a9bdcf1 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.312099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ccb79-769c-4b04-aa61-de7b4a9bdcf1 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.321082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209e9d7-2daf-4e40-b771-0b6461f0562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.322549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209e9d7-2daf-4e40-b771-0b6461f0562a admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.323184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209e9d7-2daf-4e40-b771-0b6461f0562a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.323804 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209e9d7-2daf-4e40-b771-0b6461f0562a admin admin] PATH_INFO: `/v3/projects/e2f8a8dc38af495e8186e5e7658de9d8/users/e37f41d7a83047cbb2b45b7f1d6c8d49/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.354357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209e9d7-2daf-4e40-b771-0b6461f0562a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f8a8dc38af495e8186e5e7658de9d8, user_id=e37f41d7a83047cbb2b45b7f1d6c8d49, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.358928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209e9d7-2daf-4e40-b771-0b6461f0562a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.379718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 974/1912] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:56 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:56.382245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d6453-3edf-4b52-b503-8eeba28fb062 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.498461 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 939/1913] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:56 2022] PUT /identity/v3/projects/e2f8a8dc38af495e8186e5e7658de9d8/users/e37f41d7a83047cbb2b45b7f1d6c8d49/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:56.498461 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209e9d7-2daf-4e40-b771-0b6461f0562a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.552729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d6453-3edf-4b52-b503-8eeba28fb062 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.626762 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209e9d7-2daf-4e40-b771-0b6461f0562a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.634192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d835b-d49d-472c-bbb9-11ce69ce91c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.636250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d835b-d49d-472c-bbb9-11ce69ce91c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.636250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d835b-d49d-472c-bbb9-11ce69ce91c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.636250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d835b-d49d-472c-bbb9-11ce69ce91c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.636914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d835b-d49d-472c-bbb9-11ce69ce91c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.639596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d835b-d49d-472c-bbb9-11ce69ce91c3 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.642637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ccafd-267f-458d-b07c-830aae774115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.643414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ccafd-267f-458d-b07c-830aae774115 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.643797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ccafd-267f-458d-b07c-830aae774115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.644228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ccafd-267f-458d-b07c-830aae774115 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.645530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ccafd-267f-458d-b07c-830aae774115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.647642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ccafd-267f-458d-b07c-830aae774115 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.660731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 975/1914] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:56.663988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ccafd-267f-458d-b07c-830aae774115 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.676472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ccafd-267f-458d-b07c-830aae774115 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.681872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96245e-a8ad-4df3-bde4-3cc45c95e2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.682274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96245e-a8ad-4df3-bde4-3cc45c95e2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.682627 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96245e-a8ad-4df3-bde4-3cc45c95e2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.682830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96245e-a8ad-4df3-bde4-3cc45c95e2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.683469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96245e-a8ad-4df3-bde4-3cc45c95e2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.685434 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96245e-a8ad-4df3-bde4-3cc45c95e2a3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.776184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 940/1915] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:56 2022] POST /identity/v3/projects => generated 383 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:56.776184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e7264-c162-4cfe-8f1b-6eddad75ecd6 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.776184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e7264-c162-4cfe-8f1b-6eddad75ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.776184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e7264-c162-4cfe-8f1b-6eddad75ecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.812829 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 976/1916] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:56 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:56.812829 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96245e-a8ad-4df3-bde4-3cc45c95e2a3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.829547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-408e7264-c162-4cfe-8f1b-6eddad75ecd6 None None] MFA Rules not processed for user `e37f41d7a83047cbb2b45b7f1d6c8d49`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:56.831419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-408e7264-c162-4cfe-8f1b-6eddad75ecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:56.891662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96245e-a8ad-4df3-bde4-3cc45c95e2a3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.938100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 941/1917] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:56.939157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e7264-c162-4cfe-8f1b-6eddad75ecd6 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.980852 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841be714-633b-4eee-aa69-f0724c19a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.981845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841be714-633b-4eee-aa69-f0724c19a7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.982338 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841be714-633b-4eee-aa69-f0724c19a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.982812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841be714-633b-4eee-aa69-f0724c19a7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.983763 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841be714-633b-4eee-aa69-f0724c19a7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.986067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841be714-633b-4eee-aa69-f0724c19a7a7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.001161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 977/1918] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:57.002144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841be714-633b-4eee-aa69-f0724c19a7a7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.010758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:57.016857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841be714-633b-4eee-aa69-f0724c19a7a7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.023226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6eadb-dc8d-4853-a51c-42d4d68c1988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.024078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6eadb-dc8d-4853-a51c-42d4d68c1988 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.024564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6eadb-dc8d-4853-a51c-42d4d68c1988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.024838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6eadb-dc8d-4853-a51c-42d4d68c1988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.025665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6eadb-dc8d-4853-a51c-42d4d68c1988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.025778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e7264-c162-4cfe-8f1b-6eddad75ecd6 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.027457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6eadb-dc8d-4853-a51c-42d4d68c1988 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.031711 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87c2e1-81ee-4447-97c2-6ad3a0a2df48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.032546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c2e1-81ee-4447-97c2-6ad3a0a2df48 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.032901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c2e1-81ee-4447-97c2-6ad3a0a2df48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.033245 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c2e1-81ee-4447-97c2-6ad3a0a2df48 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.034662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87c2e1-81ee-4447-97c2-6ad3a0a2df48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.036784 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87c2e1-81ee-4447-97c2-6ad3a0a2df48 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.042932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 978/1919] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:57.042932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6eadb-dc8d-4853-a51c-42d4d68c1988 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.053312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6eadb-dc8d-4853-a51c-42d4d68c1988 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.059254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e81b-ef1a-4246-b96b-f497f2f6757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.059885 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e81b-ef1a-4246-b96b-f497f2f6757f admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.060156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e81b-ef1a-4246-b96b-f497f2f6757f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.060419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e81b-ef1a-4246-b96b-f497f2f6757f admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.061057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84e81b-ef1a-4246-b96b-f497f2f6757f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.063039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84e81b-ef1a-4246-b96b-f497f2f6757f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.142515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 942/1920] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:56 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:57.142515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87c2e1-81ee-4447-97c2-6ad3a0a2df48 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.151967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87c2e1-81ee-4447-97c2-6ad3a0a2df48 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.157074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441249b-aa96-4ce5-9892-fe56336cb113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.157744 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441249b-aa96-4ce5-9892-fe56336cb113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.158023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441249b-aa96-4ce5-9892-fe56336cb113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.158364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441249b-aa96-4ce5-9892-fe56336cb113 admin admin] PATH_INFO: `/v3/projects/3b6729be1c804e82a0be92f15268172e/users/b19d3ae323ab47568f2dd74ccc7085df/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.173228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 979/1921] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:57 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:57.174981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e81b-ef1a-4246-b96b-f497f2f6757f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.184206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441249b-aa96-4ce5-9892-fe56336cb113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6729be1c804e82a0be92f15268172e, user_id=b19d3ae323ab47568f2dd74ccc7085df, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.186997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441249b-aa96-4ce5-9892-fe56336cb113 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.246965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e81b-ef1a-4246-b96b-f497f2f6757f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.252397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cc1c3-15cb-4914-a918-f2387f5598ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.253117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc1c3-15cb-4914-a918-f2387f5598ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.253417 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc1c3-15cb-4914-a918-f2387f5598ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.253674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc1c3-15cb-4914-a918-f2387f5598ad admin admin] PATH_INFO: `/v3/projects/1c266bc437c04a2eb05a37f1828d9ade/users/2eb8c874ee3e44ed81c4a275fd4bfa63/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.275452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cc1c3-15cb-4914-a918-f2387f5598ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c266bc437c04a2eb05a37f1828d9ade, user_id=2eb8c874ee3e44ed81c4a275fd4bfa63, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.278503 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cc1c3-15cb-4914-a918-f2387f5598ad admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.288008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 943/1922] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:57 2022] PUT /identity/v3/projects/3b6729be1c804e82a0be92f15268172e/users/b19d3ae323ab47568f2dd74ccc7085df/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:57.289020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441249b-aa96-4ce5-9892-fe56336cb113 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.359212 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 980/1923] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:57 2022] PUT /identity/v3/projects/1c266bc437c04a2eb05a37f1828d9ade/users/2eb8c874ee3e44ed81c4a275fd4bfa63/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:57.360070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cc1c3-15cb-4914-a918-f2387f5598ad admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.371661 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:57.377900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441249b-aa96-4ce5-9892-fe56336cb113 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.448035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cc1c3-15cb-4914-a918-f2387f5598ad admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.454421 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524b9c0-bc51-41a9-a8cc-4a2a5bee547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.456443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524b9c0-bc51-41a9-a8cc-4a2a5bee547c admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.456443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524b9c0-bc51-41a9-a8cc-4a2a5bee547c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.456443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524b9c0-bc51-41a9-a8cc-4a2a5bee547c admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.456443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524b9c0-bc51-41a9-a8cc-4a2a5bee547c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.456802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b1945-eafd-4411-bebf-045192452092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.457458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b1945-eafd-4411-bebf-045192452092 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.457694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b1945-eafd-4411-bebf-045192452092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.458098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b1945-eafd-4411-bebf-045192452092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.458183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524b9c0-bc51-41a9-a8cc-4a2a5bee547c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.459069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b1945-eafd-4411-bebf-045192452092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.460818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b1945-eafd-4411-bebf-045192452092 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.473460 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 944/1924] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:57.474831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88652c0e-a1dd-472d-8f5d-2adf938c9422 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.475118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88652c0e-a1dd-472d-8f5d-2adf938c9422 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.475396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88652c0e-a1dd-472d-8f5d-2adf938c9422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.517642 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-88652c0e-a1dd-472d-8f5d-2adf938c9422 None None] MFA Rules not processed for user `b19d3ae323ab47568f2dd74ccc7085df`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:57.519366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-88652c0e-a1dd-472d-8f5d-2adf938c9422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:57.564388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 981/1925] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:57 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:57.565986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524b9c0-bc51-41a9-a8cc-4a2a5bee547c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.581208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524b9c0-bc51-41a9-a8cc-4a2a5bee547c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.601305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee29ee-5899-4a43-a113-c3f9d074ceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.602120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee29ee-5899-4a43-a113-c3f9d074ceb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.602582 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee29ee-5899-4a43-a113-c3f9d074ceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.603716 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee29ee-5899-4a43-a113-c3f9d074ceb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.603716 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee29ee-5899-4a43-a113-c3f9d074ceb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.608287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee29ee-5899-4a43-a113-c3f9d074ceb9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.632282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 982/1926] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:57.637981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee29ee-5899-4a43-a113-c3f9d074ceb9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.656342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee29ee-5899-4a43-a113-c3f9d074ceb9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.658439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 945/1927] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:57.659791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88652c0e-a1dd-472d-8f5d-2adf938c9422 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.676737 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88652c0e-a1dd-472d-8f5d-2adf938c9422 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.677569 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc54f6-5de9-40fd-a005-990fa40bdde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.678390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc54f6-5de9-40fd-a005-990fa40bdde9 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.678782 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc54f6-5de9-40fd-a005-990fa40bdde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.679162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc54f6-5de9-40fd-a005-990fa40bdde9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.679927 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc54f6-5de9-40fd-a005-990fa40bdde9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.682634 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc54f6-5de9-40fd-a005-990fa40bdde9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.686064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d8752-72e3-48ff-bb23-177b92a62aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.686908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8752-72e3-48ff-bb23-177b92a62aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.688400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8752-72e3-48ff-bb23-177b92a62aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.689064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8752-72e3-48ff-bb23-177b92a62aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.690735 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d8752-72e3-48ff-bb23-177b92a62aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.693419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d8752-72e3-48ff-bb23-177b92a62aa2 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.701644 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 983/1928] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:57.706054 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc54f6-5de9-40fd-a005-990fa40bdde9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.715140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 946/1929] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:57.716550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d8752-72e3-48ff-bb23-177b92a62aa2 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.725084 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc54f6-5de9-40fd-a005-990fa40bdde9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.741888 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d8752-72e3-48ff-bb23-177b92a62aa2 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.745951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667b1fc-068e-4c1c-915f-d471cb489628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.746825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667b1fc-068e-4c1c-915f-d471cb489628 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.747217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667b1fc-068e-4c1c-915f-d471cb489628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.747625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667b1fc-068e-4c1c-915f-d471cb489628 admin admin] PATH_INFO: `/v3/projects/1c266bc437c04a2eb05a37f1828d9ade/users/2eb8c874ee3e44ed81c4a275fd4bfa63/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.750799 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667b1fc-068e-4c1c-915f-d471cb489628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c266bc437c04a2eb05a37f1828d9ade, user_id=2eb8c874ee3e44ed81c4a275fd4bfa63, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.752957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667b1fc-068e-4c1c-915f-d471cb489628 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.760715 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07514f03-2b86-45cc-9b62-c94c3368707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.761722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07514f03-2b86-45cc-9b62-c94c3368707c admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.762012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07514f03-2b86-45cc-9b62-c94c3368707c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.762330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07514f03-2b86-45cc-9b62-c94c3368707c admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.762980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07514f03-2b86-45cc-9b62-c94c3368707c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.767018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07514f03-2b86-45cc-9b62-c94c3368707c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.779964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 984/1930] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:57 2022] PUT /identity/v3/projects/1c266bc437c04a2eb05a37f1828d9ade/users/2eb8c874ee3e44ed81c4a275fd4bfa63/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:57.781079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667b1fc-068e-4c1c-915f-d471cb489628 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.935716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 947/1931] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:57 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:57.936684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07514f03-2b86-45cc-9b62-c94c3368707c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.952256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667b1fc-068e-4c1c-915f-d471cb489628 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.028376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07514f03-2b86-45cc-9b62-c94c3368707c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.035507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f565a-f849-43fa-a8b5-9490048938e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.036146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f565a-f849-43fa-a8b5-9490048938e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.036429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f565a-f849-43fa-a8b5-9490048938e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.036700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f565a-f849-43fa-a8b5-9490048938e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.037374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f565a-f849-43fa-a8b5-9490048938e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.039139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f565a-f849-43fa-a8b5-9490048938e6 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.055848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 948/1932] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:58.057317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4d2ac-7a4d-4f0a-b21e-95f6c372e28b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.057601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4d2ac-7a4d-4f0a-b21e-95f6c372e28b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.058095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4d2ac-7a4d-4f0a-b21e-95f6c372e28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.097550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c428a0-65c5-4ef9-a8e1-b8f29157839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.098289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c428a0-65c5-4ef9-a8e1-b8f29157839d admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.098537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c428a0-65c5-4ef9-a8e1-b8f29157839d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.098806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c428a0-65c5-4ef9-a8e1-b8f29157839d admin admin] PATH_INFO: `/v3/projects/34c6dae60509434e9cf8dd2788a04226/users/c03d0b7289d347d8bf45db5680ad72a8/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.102861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-07b4d2ac-7a4d-4f0a-b21e-95f6c372e28b None None] MFA Rules not processed for user `2eb8c874ee3e44ed81c4a275fd4bfa63`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:58.104228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-07b4d2ac-7a4d-4f0a-b21e-95f6c372e28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:58.125474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c428a0-65c5-4ef9-a8e1-b8f29157839d admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c6dae60509434e9cf8dd2788a04226, user_id=c03d0b7289d347d8bf45db5680ad72a8, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.129206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c428a0-65c5-4ef9-a8e1-b8f29157839d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.206577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 949/1933] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:58.211116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4d2ac-7a4d-4f0a-b21e-95f6c372e28b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:58.219058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 985/1934] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:57 2022] PUT /identity/v3/projects/34c6dae60509434e9cf8dd2788a04226/users/c03d0b7289d347d8bf45db5680ad72a8/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:58.219984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c428a0-65c5-4ef9-a8e1-b8f29157839d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:58.235387 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4d2ac-7a4d-4f0a-b21e-95f6c372e28b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.323291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b49c3-a89d-4f68-baa4-0aafdea317dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.324037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b49c3-a89d-4f68-baa4-0aafdea317dd admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.324318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b49c3-a89d-4f68-baa4-0aafdea317dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.324591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b49c3-a89d-4f68-baa4-0aafdea317dd admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.325233 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b49c3-a89d-4f68-baa4-0aafdea317dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.327535 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b49c3-a89d-4f68-baa4-0aafdea317dd admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.339112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c428a0-65c5-4ef9-a8e1-b8f29157839d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.345011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3ff6-2249-4e59-a335-529dad89e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.345653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3ff6-2249-4e59-a335-529dad89e173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.346011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3ff6-2249-4e59-a335-529dad89e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.346384 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3ff6-2249-4e59-a335-529dad89e173 admin admin] PATH_INFO: `/v3/projects/f073baae77484c899a80ebba379200cb/users/f53edc09f108421ca32a7d86812d4170/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.364147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb3ff6-2249-4e59-a335-529dad89e173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f073baae77484c899a80ebba379200cb, user_id=f53edc09f108421ca32a7d86812d4170, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.370480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb3ff6-2249-4e59-a335-529dad89e173 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.479440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 950/1935] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:58 2022] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:58.480858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b49c3-a89d-4f68-baa4-0aafdea317dd admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:58.483481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-533b49c3-a89d-4f68-baa4-0aafdea317dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:58.518718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 986/1936] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:58 2022] PUT /identity/v3/projects/f073baae77484c899a80ebba379200cb/users/f53edc09f108421ca32a7d86812d4170/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:58.520685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff746cc-6031-45fc-b288-00c903b54cfe None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.521121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff746cc-6031-45fc-b288-00c903b54cfe None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.521639 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff746cc-6031-45fc-b288-00c903b54cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.558573 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-aff746cc-6031-45fc-b288-00c903b54cfe None None] MFA Rules not processed for user `c03d0b7289d347d8bf45db5680ad72a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:58.560896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-aff746cc-6031-45fc-b288-00c903b54cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:58.569761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b49c3-a89d-4f68-baa4-0aafdea317dd admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.575505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:58.659765 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c3a29-b4ba-4907-971e-cbce5bd5723d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.660882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c3a29-b4ba-4907-971e-cbce5bd5723d service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.660882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c3a29-b4ba-4907-971e-cbce5bd5723d service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.661162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c3a29-b4ba-4907-971e-cbce5bd5723d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.671708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 987/1937] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:58.672921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff746cc-6031-45fc-b288-00c903b54cfe None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:58.738706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c3a29-b4ba-4907-971e-cbce5bd5723d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.741142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c3a29-b4ba-4907-971e-cbce5bd5723d service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.756432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 951/1938] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:58.758491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6796b-bf7a-40fb-9dcb-8d574bce7782 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.759311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6796b-bf7a-40fb-9dcb-8d574bce7782 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.759963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6796b-bf7a-40fb-9dcb-8d574bce7782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.762760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff746cc-6031-45fc-b288-00c903b54cfe None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.775396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0aca7-2b51-436e-961b-5253036b8e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.775396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0aca7-2b51-436e-961b-5253036b8e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.775396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0aca7-2b51-436e-961b-5253036b8e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.775396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0aca7-2b51-436e-961b-5253036b8e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.775894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0aca7-2b51-436e-961b-5253036b8e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.775894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0aca7-2b51-436e-961b-5253036b8e3b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.799240 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-1de6796b-bf7a-40fb-9dcb-8d574bce7782 None None] MFA Rules not processed for user `f53edc09f108421ca32a7d86812d4170`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:58.800639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-1de6796b-bf7a-40fb-9dcb-8d574bce7782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:58.809814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:58.814572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 988/1939] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:58.816136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0aca7-2b51-436e-961b-5253036b8e3b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:58.817876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-aab0aca7-2b51-436e-961b-5253036b8e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:58.833822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0aca7-2b51-436e-961b-5253036b8e3b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.838083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b082f-1dd1-42d0-8608-eb87b001e72b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.838740 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b082f-1dd1-42d0-8608-eb87b001e72b service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.839037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b082f-1dd1-42d0-8608-eb87b001e72b service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.839354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b082f-1dd1-42d0-8608-eb87b001e72b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.850649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b082f-1dd1-42d0-8608-eb87b001e72b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.852240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b082f-1dd1-42d0-8608-eb87b001e72b service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.862967 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 989/1940] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:58.863794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b082f-1dd1-42d0-8608-eb87b001e72b service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:58.891117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b082f-1dd1-42d0-8608-eb87b001e72b service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.896853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78623ed8-ef6a-4ba0-a6a5-cc31ce5e7864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.897569 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78623ed8-ef6a-4ba0-a6a5-cc31ce5e7864 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.897862 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78623ed8-ef6a-4ba0-a6a5-cc31ce5e7864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.898296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78623ed8-ef6a-4ba0-a6a5-cc31ce5e7864 admin admin] PATH_INFO: `/v3/projects/789b925bbdad4faa8d8dfb3563a93f85/users/654112713a7c460a9cd7627ac283f521/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.913300 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 952/1941] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:58.918625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6796b-bf7a-40fb-9dcb-8d574bce7782 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:58.938902 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6796b-bf7a-40fb-9dcb-8d574bce7782 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.945722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78623ed8-ef6a-4ba0-a6a5-cc31ce5e7864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789b925bbdad4faa8d8dfb3563a93f85, user_id=654112713a7c460a9cd7627ac283f521, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.947313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e4271-93e3-4094-9bd1-87287769ccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.948319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4271-93e3-4094-9bd1-87287769ccdf admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.948752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4271-93e3-4094-9bd1-87287769ccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.949199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4271-93e3-4094-9bd1-87287769ccdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.950323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e4271-93e3-4094-9bd1-87287769ccdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.952660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e4271-93e3-4094-9bd1-87287769ccdf admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.953918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78623ed8-ef6a-4ba0-a6a5-cc31ce5e7864 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:59.058458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 990/1942] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:58 2022] PUT /identity/v3/projects/789b925bbdad4faa8d8dfb3563a93f85/users/654112713a7c460a9cd7627ac283f521/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:59.062376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78623ed8-ef6a-4ba0-a6a5-cc31ce5e7864 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:59.064420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 953/1943] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:58 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:31:59.068437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e4271-93e3-4094-9bd1-87287769ccdf admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:59.186995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78623ed8-ef6a-4ba0-a6a5-cc31ce5e7864 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:59.187817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e4271-93e3-4094-9bd1-87287769ccdf admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:59.192383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64c01c-eb50-4841-807c-19a73439e469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:59.199083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64c01c-eb50-4841-807c-19a73439e469 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.199083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64c01c-eb50-4841-807c-19a73439e469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.199368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064d6d4-babd-4302-abf8-ab22729890d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:59.199508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64c01c-eb50-4841-807c-19a73439e469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.199596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064d6d4-babd-4302-abf8-ab22729890d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.199725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64c01c-eb50-4841-807c-19a73439e469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:59.199831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064d6d4-babd-4302-abf8-ab22729890d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.199831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064d6d4-babd-4302-abf8-ab22729890d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.199831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064d6d4-babd-4302-abf8-ab22729890d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:59.200057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64c01c-eb50-4841-807c-19a73439e469 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:59.200150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064d6d4-babd-4302-abf8-ab22729890d6 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:59.208303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 991/1944] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:31:59.209259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64c01c-eb50-4841-807c-19a73439e469 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:59.263156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64c01c-eb50-4841-807c-19a73439e469 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:59.266950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5df481-536d-4052-bba0-6597cab03fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:59.267553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5df481-536d-4052-bba0-6597cab03fde service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.267826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5df481-536d-4052-bba0-6597cab03fde service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.268091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5df481-536d-4052-bba0-6597cab03fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.314166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 954/1945] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:59 2022] POST /identity/v3/users => generated 299 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:59.314166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064d6d4-babd-4302-abf8-ab22729890d6 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:59.322164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064d6d4-babd-4302-abf8-ab22729890d6 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:59.327401 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89fed3-9bb5-47a3-b3d5-f2ea4b08409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:59.328082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89fed3-9bb5-47a3-b3d5-f2ea4b08409b admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.328365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89fed3-9bb5-47a3-b3d5-f2ea4b08409b admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.328644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89fed3-9bb5-47a3-b3d5-f2ea4b08409b admin admin] PATH_INFO: `/v3/projects/789b925bbdad4faa8d8dfb3563a93f85/users/654112713a7c460a9cd7627ac283f521/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.330635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89fed3-9bb5-47a3-b3d5-f2ea4b08409b admin admin] RBAC: Authorizing `identity:create_grant(project_id=789b925bbdad4faa8d8dfb3563a93f85, user_id=654112713a7c460a9cd7627ac283f521, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:59.332521 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5df481-536d-4052-bba0-6597cab03fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:59.333371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89fed3-9bb5-47a3-b3d5-f2ea4b08409b admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:59.334003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5df481-536d-4052-bba0-6597cab03fde service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:59.343921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 992/1946] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:59.344781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5df481-536d-4052-bba0-6597cab03fde service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:59.357014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 955/1947] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:59 2022] PUT /identity/v3/projects/789b925bbdad4faa8d8dfb3563a93f85/users/654112713a7c460a9cd7627ac283f521/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:59.358412 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5df481-536d-4052-bba0-6597cab03fde service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:59.360312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5dc7b-4a69-437a-ab0c-b9a89bbcb552 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.360653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5dc7b-4a69-437a-ab0c-b9a89bbcb552 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.361176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5dc7b-4a69-437a-ab0c-b9a89bbcb552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.402937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-34f5dc7b-4a69-437a-ab0c-b9a89bbcb552 None None] MFA Rules not processed for user `654112713a7c460a9cd7627ac283f521`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:59.404609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-34f5dc7b-4a69-437a-ab0c-b9a89bbcb552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:59.450642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec40f1-378a-4faa-8d34-d39377af8c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:59.451261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec40f1-378a-4faa-8d34-d39377af8c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.451712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec40f1-378a-4faa-8d34-d39377af8c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.451988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec40f1-378a-4faa-8d34-d39377af8c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.452690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec40f1-378a-4faa-8d34-d39377af8c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:59.454419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec40f1-378a-4faa-8d34-d39377af8c6b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:59.474036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 993/1948] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:59.479058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec40f1-378a-4faa-8d34-d39377af8c6b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:59.489981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec40f1-378a-4faa-8d34-d39377af8c6b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:59.496057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f72f9-8e88-4d50-b63f-271e50570cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:59.496816 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f72f9-8e88-4d50-b63f-271e50570cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.497097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f72f9-8e88-4d50-b63f-271e50570cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.497371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f72f9-8e88-4d50-b63f-271e50570cc4 admin admin] PATH_INFO: `/v3/projects/65465a7be8ad41ac9d2297afd6554f5e/users/242e453e91d94f129b33d8b009dd0f59/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.534447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 956/1949] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:59.543636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f72f9-8e88-4d50-b63f-271e50570cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65465a7be8ad41ac9d2297afd6554f5e, user_id=242e453e91d94f129b33d8b009dd0f59, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:59.547261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f72f9-8e88-4d50-b63f-271e50570cc4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:59.673249 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 994/1950] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:59 2022] PUT /identity/v3/projects/65465a7be8ad41ac9d2297afd6554f5e/users/242e453e91d94f129b33d8b009dd0f59/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:31:59.678120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5dc7b-4a69-437a-ab0c-b9a89bbcb552 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:59.699546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5dc7b-4a69-437a-ab0c-b9a89bbcb552 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:59.793896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd33c7-956e-407c-a4a4-420ab9091da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:59.794677 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd33c7-956e-407c-a4a4-420ab9091da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.794954 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd33c7-956e-407c-a4a4-420ab9091da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.795226 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd33c7-956e-407c-a4a4-420ab9091da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.796080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd33c7-956e-407c-a4a4-420ab9091da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:59.797703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd33c7-956e-407c-a4a4-420ab9091da9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:59.812076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 957/1951] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:31:59.813451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f72f9-8e88-4d50-b63f-271e50570cc4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:59.839201 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f72f9-8e88-4d50-b63f-271e50570cc4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:59.859522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796a0e6-8a84-453e-8631-9ac205cecc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:59.860581 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796a0e6-8a84-453e-8631-9ac205cecc11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.861171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796a0e6-8a84-453e-8631-9ac205cecc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.861715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796a0e6-8a84-453e-8631-9ac205cecc11 admin admin] PATH_INFO: `/v3/projects/65465a7be8ad41ac9d2297afd6554f5e/users/242e453e91d94f129b33d8b009dd0f59/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.861859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd33c7-956e-407c-a4a4-420ab9091da9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:59.864357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796a0e6-8a84-453e-8631-9ac205cecc11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65465a7be8ad41ac9d2297afd6554f5e, user_id=242e453e91d94f129b33d8b009dd0f59, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:59.867721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796a0e6-8a84-453e-8631-9ac205cecc11 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:59.886180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 995/1952] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:59 2022] PUT /identity/v3/projects/65465a7be8ad41ac9d2297afd6554f5e/users/242e453e91d94f129b33d8b009dd0f59/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:59.899941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cd638-57ee-4f2d-8a9e-5ef740c1e536 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.900466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cd638-57ee-4f2d-8a9e-5ef740c1e536 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.900724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cd638-57ee-4f2d-8a9e-5ef740c1e536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.938458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-356cd638-57ee-4f2d-8a9e-5ef740c1e536 None None] MFA Rules not processed for user `242e453e91d94f129b33d8b009dd0f59`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:59.939825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-356cd638-57ee-4f2d-8a9e-5ef740c1e536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:59.956029 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd33c7-956e-407c-a4a4-420ab9091da9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:00.022259 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903402-58e3-4cd3-bafa-982d2cbb554a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:00.022895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903402-58e3-4cd3-bafa-982d2cbb554a service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:00.023247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903402-58e3-4cd3-bafa-982d2cbb554a service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:00.023530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903402-58e3-4cd3-bafa-982d2cbb554a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:00.069765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 996/1953] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:31:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:00.136628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a903402-58e3-4cd3-bafa-982d2cbb554a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:00.138948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a903402-58e3-4cd3-bafa-982d2cbb554a service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:00.150319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 958/1954] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:00.305744 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cd638-57ee-4f2d-8a9e-5ef740c1e536 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:00.316989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cd638-57ee-4f2d-8a9e-5ef740c1e536 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:00.321013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bd332-101e-4746-9f83-7a7c47bf9d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:00.322700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bd332-101e-4746-9f83-7a7c47bf9d87 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:00.323181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bd332-101e-4746-9f83-7a7c47bf9d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:00.323544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bd332-101e-4746-9f83-7a7c47bf9d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:00.425914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bd332-101e-4746-9f83-7a7c47bf9d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:00.427520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bd332-101e-4746-9f83-7a7c47bf9d87 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:00.438358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 997/1955] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:00.918783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:01.546373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:02.813786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903402-58e3-4cd3-bafa-982d2cbb554a service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:02.827546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903402-58e3-4cd3-bafa-982d2cbb554a service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:02.832433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbaeec-f4de-400d-afaf-5e6381f7d4bd tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654112713a7c460a9cd7627ac283f521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789b925bbdad4faa8d8dfb3563a93f85', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:02.833067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbaeec-f4de-400d-afaf-5e6381f7d4bd tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:02.833354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbaeec-f4de-400d-afaf-5e6381f7d4bd tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:02.833801 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbaeec-f4de-400d-afaf-5e6381f7d4bd tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:02.834351 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbaeec-f4de-400d-afaf-5e6381f7d4bd tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:02.834657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbaeec-f4de-400d-afaf-5e6381f7d4bd tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:02.836676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbaeec-f4de-400d-afaf-5e6381f7d4bd tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:02.854161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 959/1956] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:02.858694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bd332-101e-4746-9f83-7a7c47bf9d87 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:02.872756 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bd332-101e-4746-9f83-7a7c47bf9d87 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:02.906511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6659a-a9f5-4aa4-9474-affc3f797592 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654112713a7c460a9cd7627ac283f521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789b925bbdad4faa8d8dfb3563a93f85', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:02.906976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6659a-a9f5-4aa4-9474-affc3f797592 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:02.907262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6659a-a9f5-4aa4-9474-affc3f797592 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:02.907593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6659a-a9f5-4aa4-9474-affc3f797592 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:02.910880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6659a-a9f5-4aa4-9474-affc3f797592 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:02.914333 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6659a-a9f5-4aa4-9474-affc3f797592 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:03.098547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 998/1957] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:02 2022] POST /identity/v3/projects => generated 354 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:03.100393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbaeec-f4de-400d-afaf-5e6381f7d4bd tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:03.129375 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbaeec-f4de-400d-afaf-5e6381f7d4bd tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:03.205487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e34b7-a4c0-483b-acc9-7c8eb2a8edb6 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654112713a7c460a9cd7627ac283f521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789b925bbdad4faa8d8dfb3563a93f85', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:03.206125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e34b7-a4c0-483b-acc9-7c8eb2a8edb6 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:03.206521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e34b7-a4c0-483b-acc9-7c8eb2a8edb6 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:03.206799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e34b7-a4c0-483b-acc9-7c8eb2a8edb6 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:03.207480 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e34b7-a4c0-483b-acc9-7c8eb2a8edb6 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:03.207791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e34b7-a4c0-483b-acc9-7c8eb2a8edb6 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:03.209633 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e34b7-a4c0-483b-acc9-7c8eb2a8edb6 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:03.223991 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 960/1958] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:03.296603 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6659a-a9f5-4aa4-9474-affc3f797592 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:03.316299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6659a-a9f5-4aa4-9474-affc3f797592 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:03.326369 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654112713a7c460a9cd7627ac283f521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789b925bbdad4faa8d8dfb3563a93f85', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:03.326369 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:03.326369 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:03.326850 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] PATH_INFO: `/v3/projects/7bdc88443a2b4fe993f769890711c008` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:03.326850 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7bdc88443a2b4fe993f769890711c008)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:03.327094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:03.481924 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bdc88443a2b4fe993f769890711c008', 'request_id': 'req-f6b6929d-bc7b-409a-83b4-1c17e111f65e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.490568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bdc88443a2b4fe993f769890711c008', 'request_id': 'req-f6b6929d-bc7b-409a-83b4-1c17e111f65e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.580577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bdc88443a2b4fe993f769890711c008', 'request_id': 'req-f6b6929d-bc7b-409a-83b4-1c17e111f65e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.612893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] The token cache is being invalidate because project 7bdc88443a2b4fe993f769890711c008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:03.613213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.614140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.617851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 999/1959] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:03 2022] DELETE /identity/v3/projects/7bdc88443a2b4fe993f769890711c008 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:04.285178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:04.523808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:04.780716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:04.874595 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e34b7-a4c0-483b-acc9-7c8eb2a8edb6 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:04.876380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f10e34b7-a4c0-483b-acc9-7c8eb2a8edb6 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:04.963654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e34b7-a4c0-483b-acc9-7c8eb2a8edb6 tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.028547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.028993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.029301 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.029639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] PATH_INFO: `/v3/users/b19d3ae323ab47568f2dd74ccc7085df` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.030853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19d3ae323ab47568f2dd74ccc7085df)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.032817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.076339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.079305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:05.147196 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6929d-bc7b-409a-83b4-1c17e111f65e tempest-VolumeQuotaClassesTest-769839532 tempest-VolumeQuotaClassesTest-769839532-project-admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.151550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4907e6-0591-4e31-9367-ff129de071ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.152299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4907e6-0591-4e31-9367-ff129de071ee service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.152433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4907e6-0591-4e31-9367-ff129de071ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.154385 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4907e6-0591-4e31-9367-ff129de071ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.156420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ff4907e6-0591-4e31-9367-ff129de071ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:05.223696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4907e6-0591-4e31-9367-ff129de071ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.225057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4907e6-0591-4e31-9367-ff129de071ee service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.234501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1000/1960] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:05.258620 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19d3ae323ab47568f2dd74ccc7085df'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.268693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19d3ae323ab47568f2dd74ccc7085df'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.270058 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19d3ae323ab47568f2dd74ccc7085df'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.380467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19d3ae323ab47568f2dd74ccc7085df'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.405458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19d3ae323ab47568f2dd74ccc7085df'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.420885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 961/1961] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:04 2022] DELETE /identity/v3/users/b19d3ae323ab47568f2dd74ccc7085df => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:05.424468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13c652-9c33-436a-bb13-aa1d47168d76 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.425229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13c652-9c33-436a-bb13-aa1d47168d76 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.425667 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13c652-9c33-436a-bb13-aa1d47168d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.453019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0a13c652-9c33-436a-bb13-aa1d47168d76 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:05.454426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0a13c652-9c33-436a-bb13-aa1d47168d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:05.533564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1001/1962] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:05.543526 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.545151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:05.613305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf2d78-a19d-415c-af76-bef3b0458902 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.617186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1847f6-f0ae-4d31-a5f6-d0909de95358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.617812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1847f6-f0ae-4d31-a5f6-d0909de95358 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.618149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1847f6-f0ae-4d31-a5f6-d0909de95358 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.618440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1847f6-f0ae-4d31-a5f6-d0909de95358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.628378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1847f6-f0ae-4d31-a5f6-d0909de95358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.629822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1847f6-f0ae-4d31-a5f6-d0909de95358 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.641263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 962/1963] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:06.084699 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:06.340136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13c652-9c33-436a-bb13-aa1d47168d76 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:06.341962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0a13c652-9c33-436a-bb13-aa1d47168d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:06.356812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13c652-9c33-436a-bb13-aa1d47168d76 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:06.366040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:06.367695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:06.368040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:06.370466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] PATH_INFO: `/v3/projects/3b6729be1c804e82a0be92f15268172e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:06.371230 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6729be1c804e82a0be92f15268172e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:06.375177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:06.574313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6729be1c804e82a0be92f15268172e', 'request_id': 'req-22c2b278-0a0b-4154-b194-ee63157293f6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.580781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6729be1c804e82a0be92f15268172e', 'request_id': 'req-22c2b278-0a0b-4154-b194-ee63157293f6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.715485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6729be1c804e82a0be92f15268172e', 'request_id': 'req-22c2b278-0a0b-4154-b194-ee63157293f6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.742727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] The token cache is being invalidate because project 3b6729be1c804e82a0be92f15268172e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:06.743647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.744440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.746186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1002/1964] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:06 2022] DELETE /identity/v3/projects/3b6729be1c804e82a0be92f15268172e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:06.751222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1847f6-f0ae-4d31-a5f6-d0909de95358 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:06.766049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1847f6-f0ae-4d31-a5f6-d0909de95358 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:06.860877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:06.861594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:06.862042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:06.862496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] PATH_INFO: `/v3/users/654112713a7c460a9cd7627ac283f521` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:06.863930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=654112713a7c460a9cd7627ac283f521)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:06.866366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.161849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654112713a7c460a9cd7627ac283f521'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.169813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654112713a7c460a9cd7627ac283f521'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.170587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654112713a7c460a9cd7627ac283f521'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.266023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654112713a7c460a9cd7627ac283f521'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.279195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654112713a7c460a9cd7627ac283f521'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.285400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 963/1965] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:06 2022] DELETE /identity/v3/users/654112713a7c460a9cd7627ac283f521 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:07.565241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:07.951189 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.952671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:07.967267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2b278-0a0b-4154-b194-ee63157293f6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:08.056658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc0cab-d965-4f3d-8fb3-81dff85db281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:08.057354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc0cab-d965-4f3d-8fb3-81dff85db281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.057633 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc0cab-d965-4f3d-8fb3-81dff85db281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.060036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc0cab-d965-4f3d-8fb3-81dff85db281 admin admin] PATH_INFO: `/v3/projects/789b925bbdad4faa8d8dfb3563a93f85` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.063443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc0cab-d965-4f3d-8fb3-81dff85db281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=789b925bbdad4faa8d8dfb3563a93f85)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:08.065513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc0cab-d965-4f3d-8fb3-81dff85db281 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:08.239841 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:08.241723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.260704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4bfc0cab-d965-4f3d-8fb3-81dff85db281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789b925bbdad4faa8d8dfb3563a93f85', 'request_id': 'req-4bfc0cab-d965-4f3d-8fb3-81dff85db281'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.273487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4bfc0cab-d965-4f3d-8fb3-81dff85db281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789b925bbdad4faa8d8dfb3563a93f85', 'request_id': 'req-4bfc0cab-d965-4f3d-8fb3-81dff85db281'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.336154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564566f-8f56-4e0c-8bea-f770332eea69 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:08.351775 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4bfc0cab-d965-4f3d-8fb3-81dff85db281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789b925bbdad4faa8d8dfb3563a93f85', 'request_id': 'req-4bfc0cab-d965-4f3d-8fb3-81dff85db281'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.374662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4bfc0cab-d965-4f3d-8fb3-81dff85db281 admin admin] The token cache is being invalidate because project 789b925bbdad4faa8d8dfb3563a93f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:08.375515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4bfc0cab-d965-4f3d-8fb3-81dff85db281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.376275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4bfc0cab-d965-4f3d-8fb3-81dff85db281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.377972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1003/1966] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:07 2022] DELETE /identity/v3/projects/789b925bbdad4faa8d8dfb3563a93f85 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:08.389166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1668c9-7b12-476b-b857-9e80980ef511 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.389166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1668c9-7b12-476b-b857-9e80980ef511 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.389166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1668c9-7b12-476b-b857-9e80980ef511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.439186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae42881-a75c-4440-b97c-c4c40d6259bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:08.440293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0b1668c9-7b12-476b-b857-9e80980ef511 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:08.440875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae42881-a75c-4440-b97c-c4c40d6259bf service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.441399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae42881-a75c-4440-b97c-c4c40d6259bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.442039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae42881-a75c-4440-b97c-c4c40d6259bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.442266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0b1668c9-7b12-476b-b857-9e80980ef511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.444424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bae42881-a75c-4440-b97c-c4c40d6259bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.530848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae42881-a75c-4440-b97c-c4c40d6259bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:08.533909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae42881-a75c-4440-b97c-c4c40d6259bf service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:08.536141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1004/1967] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:08.546714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4257ea-47ef-413d-940a-9d85fc028351 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.547098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4257ea-47ef-413d-940a-9d85fc028351 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.547344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4257ea-47ef-413d-940a-9d85fc028351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.551766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 964/1968] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:08.602142 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5a4257ea-47ef-413d-940a-9d85fc028351 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:08.602142 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5a4257ea-47ef-413d-940a-9d85fc028351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.625718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1005/1969] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:08.630687 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae42881-a75c-4440-b97c-c4c40d6259bf service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:08.646939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae42881-a75c-4440-b97c-c4c40d6259bf service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:08.654897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719290c-d323-4c55-b1b5-133ee79058bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:08.655939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719290c-d323-4c55-b1b5-133ee79058bb admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.656243 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719290c-d323-4c55-b1b5-133ee79058bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.656564 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719290c-d323-4c55-b1b5-133ee79058bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.657697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719290c-d323-4c55-b1b5-133ee79058bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:08.658013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719290c-d323-4c55-b1b5-133ee79058bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:08.659752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719290c-d323-4c55-b1b5-133ee79058bb admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:08.678288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 965/1970] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:08.682134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4257ea-47ef-413d-940a-9d85fc028351 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:08.695793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4257ea-47ef-413d-940a-9d85fc028351 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:08.701344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39b322-66ed-4fcc-93f1-a5189d29df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:08.702007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39b322-66ed-4fcc-93f1-a5189d29df20 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.702338 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39b322-66ed-4fcc-93f1-a5189d29df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.702605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39b322-66ed-4fcc-93f1-a5189d29df20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.703553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39b322-66ed-4fcc-93f1-a5189d29df20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:08.711852 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39b322-66ed-4fcc-93f1-a5189d29df20 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:08.870874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1006/1971] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:08 2022] POST /identity/v3/projects => generated 389 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:08.875887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719290c-d323-4c55-b1b5-133ee79058bb admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:08.888218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719290c-d323-4c55-b1b5-133ee79058bb admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:08.988241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc1002-d06c-460c-90cd-9130f87da5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:08.990004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc1002-d06c-460c-90cd-9130f87da5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.990506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc1002-d06c-460c-90cd-9130f87da5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.990853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc1002-d06c-460c-90cd-9130f87da5d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.991603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc1002-d06c-460c-90cd-9130f87da5d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:08.993933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc1002-d06c-460c-90cd-9130f87da5d7 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.066702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:09.154869 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 966/1972] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:08 2022] POST /identity/v3/users => generated 295 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:09.160111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39b322-66ed-4fcc-93f1-a5189d29df20 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.179947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39b322-66ed-4fcc-93f1-a5189d29df20 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.190792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a4a3c-3709-445d-9814-0c3b9c1bf2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.191574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a4a3c-3709-445d-9814-0c3b9c1bf2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.191853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a4a3c-3709-445d-9814-0c3b9c1bf2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.192118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a4a3c-3709-445d-9814-0c3b9c1bf2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.192865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a4a3c-3709-445d-9814-0c3b9c1bf2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.194545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a4a3c-3709-445d-9814-0c3b9c1bf2e3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.208964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1007/1973] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:09.215572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc1002-d06c-460c-90cd-9130f87da5d7 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.225908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc1002-d06c-460c-90cd-9130f87da5d7 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.232017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03773ef-bdc9-4bad-9db2-ceb865d4f308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.232645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03773ef-bdc9-4bad-9db2-ceb865d4f308 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.232971 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03773ef-bdc9-4bad-9db2-ceb865d4f308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.233196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03773ef-bdc9-4bad-9db2-ceb865d4f308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.233923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03773ef-bdc9-4bad-9db2-ceb865d4f308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.235584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03773ef-bdc9-4bad-9db2-ceb865d4f308 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.246145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a4a3c-3709-445d-9814-0c3b9c1bf2e3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.248616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ad3a4a3c-3709-445d-9814-0c3b9c1bf2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.252820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 967/1974] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:09.262273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03773ef-bdc9-4bad-9db2-ceb865d4f308 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.273112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a4a3c-3709-445d-9814-0c3b9c1bf2e3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.273555 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03773ef-bdc9-4bad-9db2-ceb865d4f308 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.284412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634abc7-5f52-490b-9ee1-a5b9257e5a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.285177 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634abc7-5f52-490b-9ee1-a5b9257e5a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.285611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f54785-e143-4a5c-92ef-3a3f830ad18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.286305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f54785-e143-4a5c-92ef-3a3f830ad18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.286630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f54785-e143-4a5c-92ef-3a3f830ad18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.286742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634abc7-5f52-490b-9ee1-a5b9257e5a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.286866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f54785-e143-4a5c-92ef-3a3f830ad18e admin admin] PATH_INFO: `/v3/users/c03d0b7289d347d8bf45db5680ad72a8` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.287199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634abc7-5f52-490b-9ee1-a5b9257e5a57 admin admin] PATH_INFO: `/v3/projects/cd507c7d30aa4e709d53c968f366f6de/users/c6af1e9c46fb4fa9a63866955e118a6d/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.288725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f54785-e143-4a5c-92ef-3a3f830ad18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03d0b7289d347d8bf45db5680ad72a8)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.291068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f54785-e143-4a5c-92ef-3a3f830ad18e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.334407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634abc7-5f52-490b-9ee1-a5b9257e5a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd507c7d30aa4e709d53c968f366f6de, user_id=c6af1e9c46fb4fa9a63866955e118a6d, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.340146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634abc7-5f52-490b-9ee1-a5b9257e5a57 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.463608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 968/1975] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:09 2022] PUT /identity/v3/projects/cd507c7d30aa4e709d53c968f366f6de/users/c6af1e9c46fb4fa9a63866955e118a6d/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:09.467439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f33550-6f1b-4383-9535-932baf629ce9 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.467725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f33550-6f1b-4383-9535-932baf629ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.468100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f33550-6f1b-4383-9535-932baf629ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.508820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-b7f33550-6f1b-4383-9535-932baf629ce9 None None] MFA Rules not processed for user `c6af1e9c46fb4fa9a63866955e118a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:09.510739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b7f33550-6f1b-4383-9535-932baf629ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.584416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-91f54785-e143-4a5c-92ef-3a3f830ad18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03d0b7289d347d8bf45db5680ad72a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:09.602625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 969/1976] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:09.607792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f33550-6f1b-4383-9535-932baf629ce9 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.612021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-91f54785-e143-4a5c-92ef-3a3f830ad18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03d0b7289d347d8bf45db5680ad72a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:09.613170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-91f54785-e143-4a5c-92ef-3a3f830ad18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03d0b7289d347d8bf45db5680ad72a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:09.614397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-91f54785-e143-4a5c-92ef-3a3f830ad18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03d0b7289d347d8bf45db5680ad72a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:09.627273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-91f54785-e143-4a5c-92ef-3a3f830ad18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03d0b7289d347d8bf45db5680ad72a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:09.709077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f33550-6f1b-4383-9535-932baf629ce9 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.716938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872cfde-cbac-44fe-9154-d5f8d0af8649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.717492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872cfde-cbac-44fe-9154-d5f8d0af8649 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.717772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872cfde-cbac-44fe-9154-d5f8d0af8649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.718047 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872cfde-cbac-44fe-9154-d5f8d0af8649 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.718808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872cfde-cbac-44fe-9154-d5f8d0af8649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.720888 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872cfde-cbac-44fe-9154-d5f8d0af8649 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.855601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1008/1977] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:09 2022] DELETE /identity/v3/users/c03d0b7289d347d8bf45db5680ad72a8 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:09.860054 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13da4d1-8a74-4e02-a851-7d3c75456da9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.860982 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13da4d1-8a74-4e02-a851-7d3c75456da9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.861263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13da4d1-8a74-4e02-a851-7d3c75456da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.881375 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a13da4d1-8a74-4e02-a851-7d3c75456da9 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:09.882614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a13da4d1-8a74-4e02-a851-7d3c75456da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.899450 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 970/1978] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:09 2022] POST /identity/v3/projects => generated 389 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:09.900884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872cfde-cbac-44fe-9154-d5f8d0af8649 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.902757 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e872cfde-cbac-44fe-9154-d5f8d0af8649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.955452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1009/1979] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:09.963508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13da4d1-8a74-4e02-a851-7d3c75456da9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.964918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a13da4d1-8a74-4e02-a851-7d3c75456da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.982639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872cfde-cbac-44fe-9154-d5f8d0af8649 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.990922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024058c-41ca-4afd-a17a-b2542473faf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.000060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024058c-41ca-4afd-a17a-b2542473faf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.000060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024058c-41ca-4afd-a17a-b2542473faf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.000060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024058c-41ca-4afd-a17a-b2542473faf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.000060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024058c-41ca-4afd-a17a-b2542473faf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.000060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024058c-41ca-4afd-a17a-b2542473faf0 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.068061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13da4d1-8a74-4e02-a851-7d3c75456da9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.134601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28b82-236d-421a-b63a-24f47041a4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.135312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28b82-236d-421a-b63a-24f47041a4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.135626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28b82-236d-421a-b63a-24f47041a4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.135897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28b82-236d-421a-b63a-24f47041a4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.146770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c28b82-236d-421a-b63a-24f47041a4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.148228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c28b82-236d-421a-b63a-24f47041a4d0 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.148434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 971/1980] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:09 2022] POST /identity/v3/users => generated 301 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:10.153484 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024058c-41ca-4afd-a17a-b2542473faf0 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.162192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1010/1981] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:10.174040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024058c-41ca-4afd-a17a-b2542473faf0 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.181703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629230b-ddeb-4ca1-abc4-e2beaf0aac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.181703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629230b-ddeb-4ca1-abc4-e2beaf0aac37 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.190587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629230b-ddeb-4ca1-abc4-e2beaf0aac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.190587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629230b-ddeb-4ca1-abc4-e2beaf0aac37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.190587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629230b-ddeb-4ca1-abc4-e2beaf0aac37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.190587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629230b-ddeb-4ca1-abc4-e2beaf0aac37 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.200961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 972/1982] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:10.201655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28b82-236d-421a-b63a-24f47041a4d0 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.215189 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28b82-236d-421a-b63a-24f47041a4d0 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.219022 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5b993-c481-4ffc-b750-f9d026348fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.219726 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5b993-c481-4ffc-b750-f9d026348fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.220089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5b993-c481-4ffc-b750-f9d026348fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.220439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5b993-c481-4ffc-b750-f9d026348fe4 admin admin] PATH_INFO: `/v3/projects/8274a37d869e494ca25476b3a7bdaff2/users/b0728c5281a1499cbfedf1368b8ce225/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.241166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5b993-c481-4ffc-b750-f9d026348fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8274a37d869e494ca25476b3a7bdaff2, user_id=b0728c5281a1499cbfedf1368b8ce225, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.244262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5b993-c481-4ffc-b750-f9d026348fe4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.381722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1011/1983] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:10 2022] PUT /identity/v3/projects/8274a37d869e494ca25476b3a7bdaff2/users/b0728c5281a1499cbfedf1368b8ce225/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:10.386594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629230b-ddeb-4ca1-abc4-e2beaf0aac37 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.396788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629230b-ddeb-4ca1-abc4-e2beaf0aac37 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.476698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f2af0-1139-4cf5-b164-a5a0028c48c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.478565 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f2af0-1139-4cf5-b164-a5a0028c48c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.478565 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f2af0-1139-4cf5-b164-a5a0028c48c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.478796 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f2af0-1139-4cf5-b164-a5a0028c48c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.479520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f2af0-1139-4cf5-b164-a5a0028c48c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.481135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f2af0-1139-4cf5-b164-a5a0028c48c5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.495099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 973/1984] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:10.502317 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5b993-c481-4ffc-b750-f9d026348fe4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.516714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5b993-c481-4ffc-b750-f9d026348fe4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.523204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a321ff7-7c76-4a38-9469-8ae431b54407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.524212 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a321ff7-7c76-4a38-9469-8ae431b54407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.525198 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a321ff7-7c76-4a38-9469-8ae431b54407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.525709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a321ff7-7c76-4a38-9469-8ae431b54407 admin admin] PATH_INFO: `/v3/projects/8274a37d869e494ca25476b3a7bdaff2/users/b0728c5281a1499cbfedf1368b8ce225/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.530548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a321ff7-7c76-4a38-9469-8ae431b54407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8274a37d869e494ca25476b3a7bdaff2, user_id=b0728c5281a1499cbfedf1368b8ce225, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.533930 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a321ff7-7c76-4a38-9469-8ae431b54407 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.548403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1012/1985] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:10 2022] PUT /identity/v3/projects/8274a37d869e494ca25476b3a7bdaff2/users/b0728c5281a1499cbfedf1368b8ce225/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:10.560614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4085d81-5646-4715-b852-03dd4208c91f None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.561257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4085d81-5646-4715-b852-03dd4208c91f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.561837 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4085d81-5646-4715-b852-03dd4208c91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.605545 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a4085d81-5646-4715-b852-03dd4208c91f None None] MFA Rules not processed for user `b0728c5281a1499cbfedf1368b8ce225`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:10.606814 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a4085d81-5646-4715-b852-03dd4208c91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:10.644717 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:10.686018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 974/1986] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:10.697635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a321ff7-7c76-4a38-9469-8ae431b54407 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.699453 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7a321ff7-7c76-4a38-9469-8ae431b54407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:10.784822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a321ff7-7c76-4a38-9469-8ae431b54407 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.797295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4085d81-5646-4715-b852-03dd4208c91f None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.799770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a4085d81-5646-4715-b852-03dd4208c91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:10.811426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56940ea2-1371-4aa6-8da9-5a13fd78c923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.815289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56940ea2-1371-4aa6-8da9-5a13fd78c923 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.815289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56940ea2-1371-4aa6-8da9-5a13fd78c923 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.818644 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56940ea2-1371-4aa6-8da9-5a13fd78c923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.843668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56940ea2-1371-4aa6-8da9-5a13fd78c923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.845627 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56940ea2-1371-4aa6-8da9-5a13fd78c923 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.860388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1013/1987] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:10.977145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4085d81-5646-4715-b852-03dd4208c91f None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.984689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e17a79-54c3-46da-9891-4103dd53187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.986141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e17a79-54c3-46da-9891-4103dd53187d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.986578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e17a79-54c3-46da-9891-4103dd53187d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.986963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e17a79-54c3-46da-9891-4103dd53187d admin admin] PATH_INFO: `/v3/projects/34c6dae60509434e9cf8dd2788a04226` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.988840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e17a79-54c3-46da-9891-4103dd53187d admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c6dae60509434e9cf8dd2788a04226)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.991426 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e17a79-54c3-46da-9891-4103dd53187d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.081465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56940ea2-1371-4aa6-8da9-5a13fd78c923 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.093176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56940ea2-1371-4aa6-8da9-5a13fd78c923 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.101032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a8f2b-cef2-41b2-9010-1fc436e1eea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.102042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a8f2b-cef2-41b2-9010-1fc436e1eea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.104291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a8f2b-cef2-41b2-9010-1fc436e1eea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.104291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a8f2b-cef2-41b2-9010-1fc436e1eea9 admin admin] PATH_INFO: `/v3/users/c6af1e9c46fb4fa9a63866955e118a6d` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.104515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a8f2b-cef2-41b2-9010-1fc436e1eea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6af1e9c46fb4fa9a63866955e118a6d)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.131905 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a8f2b-cef2-41b2-9010-1fc436e1eea9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.163866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b3e17a79-54c3-46da-9891-4103dd53187d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c6dae60509434e9cf8dd2788a04226', 'request_id': 'req-b3e17a79-54c3-46da-9891-4103dd53187d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.173237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b3e17a79-54c3-46da-9891-4103dd53187d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c6dae60509434e9cf8dd2788a04226', 'request_id': 'req-b3e17a79-54c3-46da-9891-4103dd53187d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.179693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b3e17a79-54c3-46da-9891-4103dd53187d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c6dae60509434e9cf8dd2788a04226', 'request_id': 'req-b3e17a79-54c3-46da-9891-4103dd53187d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.308692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b3e17a79-54c3-46da-9891-4103dd53187d admin admin] The token cache is being invalidate because project 34c6dae60509434e9cf8dd2788a04226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:11.309139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b3e17a79-54c3-46da-9891-4103dd53187d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.311382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b3e17a79-54c3-46da-9891-4103dd53187d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.312676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 975/1988] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:10 2022] DELETE /identity/v3/projects/34c6dae60509434e9cf8dd2788a04226 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:11.317653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b74db0-9e75-42ed-9fc2-356e32799ac6 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.318166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b74db0-9e75-42ed-9fc2-356e32799ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.318657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b74db0-9e75-42ed-9fc2-356e32799ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.342887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-32b74db0-9e75-42ed-9fc2-356e32799ac6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:11.344771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-32b74db0-9e75-42ed-9fc2-356e32799ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:11.420271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 976/1989] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:11.428233 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d27e0-f605-4011-807e-9538df41df87 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.428523 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d27e0-f605-4011-807e-9538df41df87 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.428798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d27e0-f605-4011-807e-9538df41df87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.450414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-829d27e0-f605-4011-807e-9538df41df87 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:11.451633 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-829d27e0-f605-4011-807e-9538df41df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:11.452546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7b6a8f2b-cef2-41b2-9010-1fc436e1eea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6af1e9c46fb4fa9a63866955e118a6d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.467238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 977/1990] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:11.471560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d27e0-f605-4011-807e-9538df41df87 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.471707 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7b6a8f2b-cef2-41b2-9010-1fc436e1eea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6af1e9c46fb4fa9a63866955e118a6d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.472485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7b6a8f2b-cef2-41b2-9010-1fc436e1eea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6af1e9c46fb4fa9a63866955e118a6d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.473852 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7b6a8f2b-cef2-41b2-9010-1fc436e1eea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6af1e9c46fb4fa9a63866955e118a6d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.482331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d27e0-f605-4011-807e-9538df41df87 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.482618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7b6a8f2b-cef2-41b2-9010-1fc436e1eea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6af1e9c46fb4fa9a63866955e118a6d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.487734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a1a98-604b-47da-b444-0e237f47ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.488457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1a98-604b-47da-b444-0e237f47ec86 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.488810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1a98-604b-47da-b444-0e237f47ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.489156 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1a98-604b-47da-b444-0e237f47ec86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.489971 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a1a98-604b-47da-b444-0e237f47ec86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:11.490346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a1a98-604b-47da-b444-0e237f47ec86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.491941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a1a98-604b-47da-b444-0e237f47ec86 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.505894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 978/1991] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:11.511760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a1a98-604b-47da-b444-0e237f47ec86 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.513532 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-865a1a98-604b-47da-b444-0e237f47ec86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:11.527810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a1a98-604b-47da-b444-0e237f47ec86 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.533216 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4b571-a2b4-48fb-bef7-a7d9c0ec7ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.533372 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4b571-a2b4-48fb-bef7-a7d9c0ec7ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.533562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4b571-a2b4-48fb-bef7-a7d9c0ec7ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.533834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4b571-a2b4-48fb-bef7-a7d9c0ec7ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.534780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4b571-a2b4-48fb-bef7-a7d9c0ec7ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.536722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4b571-a2b4-48fb-bef7-a7d9c0ec7ff3 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.590992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1014/1992] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:11 2022] DELETE /identity/v3/users/c6af1e9c46fb4fa9a63866955e118a6d => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:11.601499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce330b55-ea76-45fb-b753-ef50c11e51bb None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.601790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce330b55-ea76-45fb-b753-ef50c11e51bb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.602070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce330b55-ea76-45fb-b753-ef50c11e51bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.626011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ce330b55-ea76-45fb-b753-ef50c11e51bb None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:11.627650 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ce330b55-ea76-45fb-b753-ef50c11e51bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:11.670394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 979/1993] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:11 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:11.674790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4b571-a2b4-48fb-bef7-a7d9c0ec7ff3 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.696018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:11.718364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1015/1994] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:11.727775 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce330b55-ea76-45fb-b753-ef50c11e51bb None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.730530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ce330b55-ea76-45fb-b753-ef50c11e51bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:11.768968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4b571-a2b4-48fb-bef7-a7d9c0ec7ff3 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.773888 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435f271-1870-4309-81ab-fa238a39d60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.774788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f271-1870-4309-81ab-fa238a39d60a admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.775330 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f271-1870-4309-81ab-fa238a39d60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.775626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f271-1870-4309-81ab-fa238a39d60a admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.786008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435f271-1870-4309-81ab-fa238a39d60a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.786008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435f271-1870-4309-81ab-fa238a39d60a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.814438 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce330b55-ea76-45fb-b753-ef50c11e51bb None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.875310 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a3941-0e32-4ca0-86d6-f5f38df79455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.875948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a3941-0e32-4ca0-86d6-f5f38df79455 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.876224 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a3941-0e32-4ca0-86d6-f5f38df79455 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.876558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a3941-0e32-4ca0-86d6-f5f38df79455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.889832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a3941-0e32-4ca0-86d6-f5f38df79455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.891620 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a3941-0e32-4ca0-86d6-f5f38df79455 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.901867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 980/1995] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:11 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:11.905972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435f271-1870-4309-81ab-fa238a39d60a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.907035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1016/1996] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:32:11.917755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435f271-1870-4309-81ab-fa238a39d60a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.922799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00b76d-e0e3-4cbc-b0a9-4d38b8971e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.923444 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b76d-e0e3-4cbc-b0a9-4d38b8971e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.923730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b76d-e0e3-4cbc-b0a9-4d38b8971e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.924005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b76d-e0e3-4cbc-b0a9-4d38b8971e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.924672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00b76d-e0e3-4cbc-b0a9-4d38b8971e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.926339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00b76d-e0e3-4cbc-b0a9-4d38b8971e68 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.940575 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 981/1997] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:11.945505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a3941-0e32-4ca0-86d6-f5f38df79455 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.957259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a3941-0e32-4ca0-86d6-f5f38df79455 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.963459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7dc4f-9cd1-4e5d-8fdd-99e5cbf97602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.964269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7dc4f-9cd1-4e5d-8fdd-99e5cbf97602 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.964716 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7dc4f-9cd1-4e5d-8fdd-99e5cbf97602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.966361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7dc4f-9cd1-4e5d-8fdd-99e5cbf97602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.967246 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7dc4f-9cd1-4e5d-8fdd-99e5cbf97602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.969324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7dc4f-9cd1-4e5d-8fdd-99e5cbf97602 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:12.012801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1017/1998] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:12.018520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00b76d-e0e3-4cbc-b0a9-4d38b8971e68 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:12.036017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00b76d-e0e3-4cbc-b0a9-4d38b8971e68 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:12.043407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc0ed1-f32d-4592-8cfc-3b6bdeb3e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:12.044372 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc0ed1-f32d-4592-8cfc-3b6bdeb3e900 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.044731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc0ed1-f32d-4592-8cfc-3b6bdeb3e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.045107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc0ed1-f32d-4592-8cfc-3b6bdeb3e900 admin admin] PATH_INFO: `/v3/projects/7fe968db46dc4ce282ed44eb26b7f2ba/users/12317ecf864f4d25a908a0751ef177d1/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.094710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc0ed1-f32d-4592-8cfc-3b6bdeb3e900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe968db46dc4ce282ed44eb26b7f2ba, user_id=12317ecf864f4d25a908a0751ef177d1, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:12.094710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc0ed1-f32d-4592-8cfc-3b6bdeb3e900 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:12.224919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 982/1999] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:12 2022] PUT /identity/v3/projects/7fe968db46dc4ce282ed44eb26b7f2ba/users/12317ecf864f4d25a908a0751ef177d1/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:12.239362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d33b82-f388-411b-ba51-778fc4c186c3 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.239896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d33b82-f388-411b-ba51-778fc4c186c3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.240097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d33b82-f388-411b-ba51-778fc4c186c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.290627 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d0d33b82-f388-411b-ba51-778fc4c186c3 None None] MFA Rules not processed for user `12317ecf864f4d25a908a0751ef177d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:12.292230 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d0d33b82-f388-411b-ba51-778fc4c186c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.397709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1018/2000] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:12.415466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc0ed1-f32d-4592-8cfc-3b6bdeb3e900 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:12.418378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2ffc0ed1-f32d-4592-8cfc-3b6bdeb3e900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.489291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc0ed1-f32d-4592-8cfc-3b6bdeb3e900 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:12.494021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05354cfa-10e9-4385-a460-52b65ca6e744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:12.494710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05354cfa-10e9-4385-a460-52b65ca6e744 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.494998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05354cfa-10e9-4385-a460-52b65ca6e744 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.495301 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05354cfa-10e9-4385-a460-52b65ca6e744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.505343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05354cfa-10e9-4385-a460-52b65ca6e744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:12.506910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05354cfa-10e9-4385-a460-52b65ca6e744 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:12.517496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 983/2001] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:32:12.567104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d33b82-f388-411b-ba51-778fc4c186c3 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:12.568718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d0d33b82-f388-411b-ba51-778fc4c186c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.600509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:12.647336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d33b82-f388-411b-ba51-778fc4c186c3 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:12.652623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:12.653269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.653545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.653815 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] PATH_INFO: `/v3/projects/cd507c7d30aa4e709d53c968f366f6de` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.654976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd507c7d30aa4e709d53c968f366f6de)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:12.656889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:12.835335 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd507c7d30aa4e709d53c968f366f6de', 'request_id': 'req-86f68ff1-1052-4e0a-88b8-495efb7af80e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.842454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd507c7d30aa4e709d53c968f366f6de', 'request_id': 'req-86f68ff1-1052-4e0a-88b8-495efb7af80e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.946820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd507c7d30aa4e709d53c968f366f6de', 'request_id': 'req-86f68ff1-1052-4e0a-88b8-495efb7af80e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.966750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] The token cache is being invalidate because project cd507c7d30aa4e709d53c968f366f6de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:12.966750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.966750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.966750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1019/2002] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:12 2022] DELETE /identity/v3/projects/cd507c7d30aa4e709d53c968f366f6de => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:12.969189 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05354cfa-10e9-4385-a460-52b65ca6e744 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:12.981766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05354cfa-10e9-4385-a460-52b65ca6e744 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.051241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:13.067070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fe21e-6485-4bec-b3aa-c824d1fae5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.067070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fe21e-6485-4bec-b3aa-c824d1fae5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.067070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fe21e-6485-4bec-b3aa-c824d1fae5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.067464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fe21e-6485-4bec-b3aa-c824d1fae5c2 admin admin] PATH_INFO: `/v3/users/b0728c5281a1499cbfedf1368b8ce225` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.068615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fe21e-6485-4bec-b3aa-c824d1fae5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0728c5281a1499cbfedf1368b8ce225)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.070908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fe21e-6485-4bec-b3aa-c824d1fae5c2 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.347409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-949fe21e-6485-4bec-b3aa-c824d1fae5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0728c5281a1499cbfedf1368b8ce225'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:13.362947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-949fe21e-6485-4bec-b3aa-c824d1fae5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0728c5281a1499cbfedf1368b8ce225'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:13.364245 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-949fe21e-6485-4bec-b3aa-c824d1fae5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0728c5281a1499cbfedf1368b8ce225'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:13.455825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-949fe21e-6485-4bec-b3aa-c824d1fae5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0728c5281a1499cbfedf1368b8ce225'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:13.473443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-949fe21e-6485-4bec-b3aa-c824d1fae5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0728c5281a1499cbfedf1368b8ce225'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:13.485416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 984/2003] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:12 2022] DELETE /identity/v3/users/b0728c5281a1499cbfedf1368b8ce225 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:14.060754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.062257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:14.076156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f68ff1-1052-4e0a-88b8-495efb7af80e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:14.145633 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c79954-6842-4edd-a02e-382a564cba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:14.146123 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c79954-6842-4edd-a02e-382a564cba54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.146586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c79954-6842-4edd-a02e-382a564cba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.146715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c79954-6842-4edd-a02e-382a564cba54 admin admin] PATH_INFO: `/v3/projects/8274a37d869e494ca25476b3a7bdaff2` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.148000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c79954-6842-4edd-a02e-382a564cba54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8274a37d869e494ca25476b3a7bdaff2)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:14.149988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c79954-6842-4edd-a02e-382a564cba54 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:14.339229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d7c79954-6842-4edd-a02e-382a564cba54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8274a37d869e494ca25476b3a7bdaff2', 'request_id': 'req-d7c79954-6842-4edd-a02e-382a564cba54'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:14.359780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d7c79954-6842-4edd-a02e-382a564cba54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8274a37d869e494ca25476b3a7bdaff2', 'request_id': 'req-d7c79954-6842-4edd-a02e-382a564cba54'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:14.535350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d7c79954-6842-4edd-a02e-382a564cba54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8274a37d869e494ca25476b3a7bdaff2', 'request_id': 'req-d7c79954-6842-4edd-a02e-382a564cba54'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:14.551397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d7c79954-6842-4edd-a02e-382a564cba54 admin admin] The token cache is being invalidate because project 8274a37d869e494ca25476b3a7bdaff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:14.551819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d7c79954-6842-4edd-a02e-382a564cba54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:14.553162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d7c79954-6842-4edd-a02e-382a564cba54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:14.558296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1020/2004] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:14 2022] DELETE /identity/v3/projects/8274a37d869e494ca25476b3a7bdaff2 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:14.561547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d2451-4b43-4ce0-b428-9265cf007d5e None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.562312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d2451-4b43-4ce0-b428-9265cf007d5e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.562312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d2451-4b43-4ce0-b428-9265cf007d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.585692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-651d2451-4b43-4ce0-b428-9265cf007d5e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:14.587688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-651d2451-4b43-4ce0-b428-9265cf007d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:14.663651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 985/2005] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:14.671832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4380df-34e6-4250-9151-17c06c04ed18 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.672122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4380df-34e6-4250-9151-17c06c04ed18 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.672402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4380df-34e6-4250-9151-17c06c04ed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.694648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0e4380df-34e6-4250-9151-17c06c04ed18 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:14.695996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0e4380df-34e6-4250-9151-17c06c04ed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:14.709736 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1021/2006] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:14.713830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d2451-4b43-4ce0-b428-9265cf007d5e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.732834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d2451-4b43-4ce0-b428-9265cf007d5e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:14.741660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1381e02-c5cd-4ec4-aa23-37c027b8f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:14.742727 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1381e02-c5cd-4ec4-aa23-37c027b8f7ad admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.743769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1381e02-c5cd-4ec4-aa23-37c027b8f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.744256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1381e02-c5cd-4ec4-aa23-37c027b8f7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.745804 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1381e02-c5cd-4ec4-aa23-37c027b8f7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:14.746352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1381e02-c5cd-4ec4-aa23-37c027b8f7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:14.749583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1381e02-c5cd-4ec4-aa23-37c027b8f7ad admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:14.779125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 986/2007] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:14.783526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4380df-34e6-4250-9151-17c06c04ed18 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.800667 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4380df-34e6-4250-9151-17c06c04ed18 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:14.810915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742e4e4-33ae-4beb-9611-6010e8835141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:14.819778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742e4e4-33ae-4beb-9611-6010e8835141 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.819778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742e4e4-33ae-4beb-9611-6010e8835141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.819778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742e4e4-33ae-4beb-9611-6010e8835141 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.819778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742e4e4-33ae-4beb-9611-6010e8835141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:14.819778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742e4e4-33ae-4beb-9611-6010e8835141 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:14.965287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1022/2008] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:14 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:14.969712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1381e02-c5cd-4ec4-aa23-37c027b8f7ad admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.981594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1381e02-c5cd-4ec4-aa23-37c027b8f7ad admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:15.045986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b91b75-1c0a-4eaf-a105-3a280a1937b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:15.046956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b91b75-1c0a-4eaf-a105-3a280a1937b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:15.047238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b91b75-1c0a-4eaf-a105-3a280a1937b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:15.047505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b91b75-1c0a-4eaf-a105-3a280a1937b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:15.048269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b91b75-1c0a-4eaf-a105-3a280a1937b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:15.050289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b91b75-1c0a-4eaf-a105-3a280a1937b5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:15.177178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 987/2009] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:14 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:15.178445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742e4e4-33ae-4beb-9611-6010e8835141 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:15.191339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742e4e4-33ae-4beb-9611-6010e8835141 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:15.197067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5f5ca-32ae-432b-9d3c-3b26b452e366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:15.197696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5f5ca-32ae-432b-9d3c-3b26b452e366 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:15.197978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5f5ca-32ae-432b-9d3c-3b26b452e366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:15.198277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5f5ca-32ae-432b-9d3c-3b26b452e366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:15.201184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5f5ca-32ae-432b-9d3c-3b26b452e366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:15.201184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5f5ca-32ae-432b-9d3c-3b26b452e366 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:15.214879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1023/2010] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:15.220222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b91b75-1c0a-4eaf-a105-3a280a1937b5 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:15.231893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b91b75-1c0a-4eaf-a105-3a280a1937b5 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:15.236757 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66c903-0b2f-498f-aaff-9e9ca3622150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:15.237845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66c903-0b2f-498f-aaff-9e9ca3622150 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:15.238309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66c903-0b2f-498f-aaff-9e9ca3622150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:15.238726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66c903-0b2f-498f-aaff-9e9ca3622150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:15.239541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66c903-0b2f-498f-aaff-9e9ca3622150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:15.241518 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66c903-0b2f-498f-aaff-9e9ca3622150 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:15.261816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 988/2011] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:15.262881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5f5ca-32ae-432b-9d3c-3b26b452e366 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:15.275602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5f5ca-32ae-432b-9d3c-3b26b452e366 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:15.280773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09949fe2-8e8e-4189-8f63-4164809f3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:15.281562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949fe2-8e8e-4189-8f63-4164809f3409 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:15.282559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949fe2-8e8e-4189-8f63-4164809f3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:15.282934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949fe2-8e8e-4189-8f63-4164809f3409 admin admin] PATH_INFO: `/v3/projects/8b54803f7a754a68877340344f21b42b/users/cc568628e8e94ec3ac23b475b9b78641/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:15.301976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09949fe2-8e8e-4189-8f63-4164809f3409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b54803f7a754a68877340344f21b42b, user_id=cc568628e8e94ec3ac23b475b9b78641, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:15.304922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09949fe2-8e8e-4189-8f63-4164809f3409 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:15.519819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:15.528241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1024/2012] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:15 2022] PUT /identity/v3/projects/8b54803f7a754a68877340344f21b42b/users/cc568628e8e94ec3ac23b475b9b78641/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:15.534391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd525b9a-7b16-4da5-9b46-92d52ffb6205 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:15.534874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd525b9a-7b16-4da5-9b46-92d52ffb6205 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:15.535566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd525b9a-7b16-4da5-9b46-92d52ffb6205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:15.560860 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-bd525b9a-7b16-4da5-9b46-92d52ffb6205 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:15.562725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bd525b9a-7b16-4da5-9b46-92d52ffb6205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:15.648432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 989/2013] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:15.662578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09949fe2-8e8e-4189-8f63-4164809f3409 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:15.667078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-09949fe2-8e8e-4189-8f63-4164809f3409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:15.751999 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09949fe2-8e8e-4189-8f63-4164809f3409 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:15.755981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cf6e1-7a06-4ede-bfed-754efc0b654d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:15.756651 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cf6e1-7a06-4ede-bfed-754efc0b654d service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:15.756932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cf6e1-7a06-4ede-bfed-754efc0b654d service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:15.757209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cf6e1-7a06-4ede-bfed-754efc0b654d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:15.772150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cf6e1-7a06-4ede-bfed-754efc0b654d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:15.774207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cf6e1-7a06-4ede-bfed-754efc0b654d service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:15.787570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1025/2014] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:32:16.293706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd525b9a-7b16-4da5-9b46-92d52ffb6205 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:16.296209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bd525b9a-7b16-4da5-9b46-92d52ffb6205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:16.349481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd525b9a-7b16-4da5-9b46-92d52ffb6205 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:16.367580 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:16.369114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:16.369635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:16.370119 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] PATH_INFO: `/v3/users/e37f41d7a83047cbb2b45b7f1d6c8d49` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:16.374637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37f41d7a83047cbb2b45b7f1d6c8d49)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:16.377460 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:17.196045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37f41d7a83047cbb2b45b7f1d6c8d49'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.204245 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37f41d7a83047cbb2b45b7f1d6c8d49'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.205867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37f41d7a83047cbb2b45b7f1d6c8d49'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.283152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:17.453444 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37f41d7a83047cbb2b45b7f1d6c8d49'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.467710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37f41d7a83047cbb2b45b7f1d6c8d49'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.473993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 990/2015] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:16 2022] DELETE /identity/v3/users/e37f41d7a83047cbb2b45b7f1d6c8d49 => generated 0 bytes in 1182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:17.479037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8c13a-1a8b-430c-a36e-527d34af5c45 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:17.479851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8c13a-1a8b-430c-a36e-527d34af5c45 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:17.480014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8c13a-1a8b-430c-a36e-527d34af5c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:17.500898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f7a8c13a-1a8b-430c-a36e-527d34af5c45 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:17.502689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f7a8c13a-1a8b-430c-a36e-527d34af5c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:17.578119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1026/2016] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:17.592193 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:17.594143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:17.668616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33266ed-ddd3-4b31-a481-b556b8e56a03 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:17.674046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be55c9-17e2-4cd4-9fa3-2eb3482c5bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:17.674702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be55c9-17e2-4cd4-9fa3-2eb3482c5bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:17.674994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be55c9-17e2-4cd4-9fa3-2eb3482c5bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:17.675256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be55c9-17e2-4cd4-9fa3-2eb3482c5bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:17.687130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be55c9-17e2-4cd4-9fa3-2eb3482c5bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:17.689186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be55c9-17e2-4cd4-9fa3-2eb3482c5bd4 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:17.706545 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 991/2017] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:18.337578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8c13a-1a8b-430c-a36e-527d34af5c45 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:18.351757 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f7a8c13a-1a8b-430c-a36e-527d34af5c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.369289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6be896-2e65-4a6a-809b-dc82f80f96f4 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.369796 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6be896-2e65-4a6a-809b-dc82f80f96f4 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.370291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6be896-2e65-4a6a-809b-dc82f80f96f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.376879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8c13a-1a8b-430c-a36e-527d34af5c45 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:18.393789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:18.394509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.394847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.395382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] PATH_INFO: `/v3/projects/e2f8a8dc38af495e8186e5e7658de9d8` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.397030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f8a8dc38af495e8186e5e7658de9d8)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:18.401017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:18.416975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-be6be896-2e65-4a6a-809b-dc82f80f96f4 None None] MFA Rules not processed for user `cc568628e8e94ec3ac23b475b9b78641`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:18.418417 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-be6be896-2e65-4a6a-809b-dc82f80f96f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.490028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 992/2018] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:18.496049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6be896-2e65-4a6a-809b-dc82f80f96f4 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:18.497689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-be6be896-2e65-4a6a-809b-dc82f80f96f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.523709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6be896-2e65-4a6a-809b-dc82f80f96f4 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:18.528980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e8546-5062-4758-a64b-e3926e74ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:18.529635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e8546-5062-4758-a64b-e3926e74ae6d admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.529914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e8546-5062-4758-a64b-e3926e74ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.530185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e8546-5062-4758-a64b-e3926e74ae6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.530887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e8546-5062-4758-a64b-e3926e74ae6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:18.532836 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e8546-5062-4758-a64b-e3926e74ae6d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:18.557336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f8a8dc38af495e8186e5e7658de9d8', 'request_id': 'req-5f77fac0-4b59-4d48-a90c-28d92c17dedd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.565302 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f8a8dc38af495e8186e5e7658de9d8', 'request_id': 'req-5f77fac0-4b59-4d48-a90c-28d92c17dedd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.643148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f8a8dc38af495e8186e5e7658de9d8', 'request_id': 'req-5f77fac0-4b59-4d48-a90c-28d92c17dedd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.653704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 993/2019] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:18 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:18.658423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] The token cache is being invalidate because project e2f8a8dc38af495e8186e5e7658de9d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:18.658423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.658423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.658800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e8546-5062-4758-a64b-e3926e74ae6d admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:18.659397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1027/2020] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:18 2022] DELETE /identity/v3/projects/e2f8a8dc38af495e8186e5e7658de9d8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:18.661854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-401e8546-5062-4758-a64b-e3926e74ae6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.663140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:18.664431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.755209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e8546-5062-4758-a64b-e3926e74ae6d admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:18.755466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77fac0-4b59-4d48-a90c-28d92c17dedd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:18.762211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:18.762591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1020b74-13ab-49b1-9c97-70aee396f50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:18.762962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1020b74-13ab-49b1-9c97-70aee396f50f admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.763164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.763344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1020b74-13ab-49b1-9c97-70aee396f50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.763610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1020b74-13ab-49b1-9c97-70aee396f50f admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.763783 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.764075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] PATH_INFO: `/v3/users/f53edc09f108421ca32a7d86812d4170` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.764320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1020b74-13ab-49b1-9c97-70aee396f50f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:18.765567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f53edc09f108421ca32a7d86812d4170)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:18.766586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1020b74-13ab-49b1-9c97-70aee396f50f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:18.767902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:18.913736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 994/2021] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:18 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:18.918205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1020b74-13ab-49b1-9c97-70aee396f50f admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:18.929632 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1020b74-13ab-49b1-9c97-70aee396f50f admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:18.935032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bdccc-6779-424b-9d4c-197074f0ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:18.935608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bdccc-6779-424b-9d4c-197074f0ff80 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.935973 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bdccc-6779-424b-9d4c-197074f0ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.936289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bdccc-6779-424b-9d4c-197074f0ff80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.937094 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bdccc-6779-424b-9d4c-197074f0ff80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:18.938942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bdccc-6779-424b-9d4c-197074f0ff80 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:18.951051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 995/2022] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:18.956454 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bdccc-6779-424b-9d4c-197074f0ff80 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:18.972223 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bdccc-6779-424b-9d4c-197074f0ff80 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:18.980237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5531ee4-ba09-4c13-978c-14a740174e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:18.981007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5531ee4-ba09-4c13-978c-14a740174e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.981288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5531ee4-ba09-4c13-978c-14a740174e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.981559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5531ee4-ba09-4c13-978c-14a740174e9f admin admin] PATH_INFO: `/v3/projects/4518479ed353400785e0e675fee9a4a2/users/528e1becf5c94d2fab4a089eb619dfbf/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:19.000186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5531ee4-ba09-4c13-978c-14a740174e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4518479ed353400785e0e675fee9a4a2, user_id=528e1becf5c94d2fab4a089eb619dfbf, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:19.004219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5531ee4-ba09-4c13-978c-14a740174e9f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:19.048072 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f53edc09f108421ca32a7d86812d4170'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.060668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f53edc09f108421ca32a7d86812d4170'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.061951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f53edc09f108421ca32a7d86812d4170'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.062128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f53edc09f108421ca32a7d86812d4170'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.070758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f53edc09f108421ca32a7d86812d4170'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.149320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 996/2023] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:18 2022] PUT /identity/v3/projects/4518479ed353400785e0e675fee9a4a2/users/528e1becf5c94d2fab4a089eb619dfbf/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:19.155518 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5531ee4-ba09-4c13-978c-14a740174e9f admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:19.162264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c5531ee4-ba09-4c13-978c-14a740174e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:19.176815 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1028/2024] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:18 2022] DELETE /identity/v3/users/f53edc09f108421ca32a7d86812d4170 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:19.248763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5531ee4-ba09-4c13-978c-14a740174e9f admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:19.318798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0651e0-99ee-44e7-bb79-84018f70bff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:19.319667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0651e0-99ee-44e7-bb79-84018f70bff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:19.320018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0651e0-99ee-44e7-bb79-84018f70bff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:19.320369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0651e0-99ee-44e7-bb79-84018f70bff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:19.322151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0651e0-99ee-44e7-bb79-84018f70bff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:19.324099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0651e0-99ee-44e7-bb79-84018f70bff5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:19.345432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 997/2025] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:19.352131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:19.372389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2280e2d-ae38-4fb1-b736-5036fcdf63e6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:19.418441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709c212-2fea-40d8-ba63-844a54993055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:19.422570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709c212-2fea-40d8-ba63-844a54993055 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:19.423085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709c212-2fea-40d8-ba63-844a54993055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:19.424889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709c212-2fea-40d8-ba63-844a54993055 admin admin] PATH_INFO: `/v3/projects/4518479ed353400785e0e675fee9a4a2/users/528e1becf5c94d2fab4a089eb619dfbf/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:19.432113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709c212-2fea-40d8-ba63-844a54993055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4518479ed353400785e0e675fee9a4a2, user_id=528e1becf5c94d2fab4a089eb619dfbf, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:19.440170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709c212-2fea-40d8-ba63-844a54993055 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:19.482523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1029/2026] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:19 2022] PUT /identity/v3/projects/4518479ed353400785e0e675fee9a4a2/users/528e1becf5c94d2fab4a089eb619dfbf/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:19.627708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:20.010884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0651e0-99ee-44e7-bb79-84018f70bff5 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:20.013166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-de0651e0-99ee-44e7-bb79-84018f70bff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:20.029346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0651e0-99ee-44e7-bb79-84018f70bff5 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:20.030259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:20.123748 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ba151-836b-4f34-9eb5-a5d913a3a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.124411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ba151-836b-4f34-9eb5-a5d913a3a537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.125183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ba151-836b-4f34-9eb5-a5d913a3a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.126113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ba151-836b-4f34-9eb5-a5d913a3a537 admin admin] PATH_INFO: `/v3/projects/f073baae77484c899a80ebba379200cb` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.127566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ba151-836b-4f34-9eb5-a5d913a3a537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f073baae77484c899a80ebba379200cb)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.129972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ba151-836b-4f34-9eb5-a5d913a3a537 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:20.333089 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-1d5ba151-836b-4f34-9eb5-a5d913a3a537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f073baae77484c899a80ebba379200cb', 'request_id': 'req-1d5ba151-836b-4f34-9eb5-a5d913a3a537'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.340069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-1d5ba151-836b-4f34-9eb5-a5d913a3a537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f073baae77484c899a80ebba379200cb', 'request_id': 'req-1d5ba151-836b-4f34-9eb5-a5d913a3a537'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.346323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-1d5ba151-836b-4f34-9eb5-a5d913a3a537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f073baae77484c899a80ebba379200cb', 'request_id': 'req-1d5ba151-836b-4f34-9eb5-a5d913a3a537'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.478434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-1d5ba151-836b-4f34-9eb5-a5d913a3a537 admin admin] The token cache is being invalidate because project f073baae77484c899a80ebba379200cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:20.478764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-1d5ba151-836b-4f34-9eb5-a5d913a3a537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.479458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-1d5ba151-836b-4f34-9eb5-a5d913a3a537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.481183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 998/2027] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:20 2022] DELETE /identity/v3/projects/f073baae77484c899a80ebba379200cb => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:20.486392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709c212-2fea-40d8-ba63-844a54993055 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:20.488198 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e709c212-2fea-40d8-ba63-844a54993055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:20.514291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709c212-2fea-40d8-ba63-844a54993055 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:20.603579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.604221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.604494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.605048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] PATH_INFO: `/v3/users/242e453e91d94f129b33d8b009dd0f59` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.606484 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=242e453e91d94f129b33d8b009dd0f59)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.609593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:20.849196 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242e453e91d94f129b33d8b009dd0f59'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.865162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242e453e91d94f129b33d8b009dd0f59'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.866556 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242e453e91d94f129b33d8b009dd0f59'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.872270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242e453e91d94f129b33d8b009dd0f59'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.877709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242e453e91d94f129b33d8b009dd0f59'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.057496 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1030/2028] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:20 2022] DELETE /identity/v3/users/242e453e91d94f129b33d8b009dd0f59 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:21.887367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:22.500856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68939-b322-4948-88e5-42a1018b47fc None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.501675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68939-b322-4948-88e5-42a1018b47fc None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.502332 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68939-b322-4948-88e5-42a1018b47fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.555673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-25a68939-b322-4948-88e5-42a1018b47fc None None] MFA Rules not processed for user `528e1becf5c94d2fab4a089eb619dfbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:22.557578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-25a68939-b322-4948-88e5-42a1018b47fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.576428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.576428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.661388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 999/2029] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:22.677865 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5c3f8-3c4a-44b9-bf84-1cd2e0eba8aa None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.678171 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5c3f8-3c4a-44b9-bf84-1cd2e0eba8aa None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.678684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5c3f8-3c4a-44b9-bf84-1cd2e0eba8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.687131 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:22.698883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7a61e-dfc7-4255-8e45-78787fc16734 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.704914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.705849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.706313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.706750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5 admin admin] PATH_INFO: `/v3/projects/65465a7be8ad41ac9d2297afd6554f5e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.708327 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65465a7be8ad41ac9d2297afd6554f5e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.710617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.714594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-90f5c3f8-3c4a-44b9-bf84-1cd2e0eba8aa None None] MFA Rules not processed for user `cc568628e8e94ec3ac23b475b9b78641`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:22.715852 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-90f5c3f8-3c4a-44b9-bf84-1cd2e0eba8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.788610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1000/2030] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:22.800549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5c3f8-3c4a-44b9-bf84-1cd2e0eba8aa None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.802566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-90f5c3f8-3c4a-44b9-bf84-1cd2e0eba8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.904612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5c3f8-3c4a-44b9-bf84-1cd2e0eba8aa None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.911818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9713c-71df-42b5-a3c8-aba8d2650b79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.912608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9713c-71df-42b5-a3c8-aba8d2650b79 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.912876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9713c-71df-42b5-a3c8-aba8d2650b79 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.913156 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9713c-71df-42b5-a3c8-aba8d2650b79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.916331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-07a9713c-71df-42b5-a3c8-aba8d2650b79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.929737 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9713c-71df-42b5-a3c8-aba8d2650b79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.933489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9713c-71df-42b5-a3c8-aba8d2650b79 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.953541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1001/2031] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:32:22.971710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65465a7be8ad41ac9d2297afd6554f5e', 'request_id': 'req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:22.980115 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65465a7be8ad41ac9d2297afd6554f5e', 'request_id': 'req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:23.129511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65465a7be8ad41ac9d2297afd6554f5e', 'request_id': 'req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:23.148670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5 admin admin] The token cache is being invalidate because project 65465a7be8ad41ac9d2297afd6554f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:23.150181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:23.150181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4a11b6bb-ae9c-432f-a3a1-8983c3d43ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:23.153984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1031/2032] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:22 2022] DELETE /identity/v3/projects/65465a7be8ad41ac9d2297afd6554f5e => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:23.162154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea17f8-dcb7-47f4-bf00-285941384533 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.162537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea17f8-dcb7-47f4-bf00-285941384533 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.162936 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea17f8-dcb7-47f4-bf00-285941384533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.200027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-69ea17f8-dcb7-47f4-bf00-285941384533 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:23.200995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-69ea17f8-dcb7-47f4-bf00-285941384533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:23.361867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1002/2033] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:23.364790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00351e76-bef8-443a-986d-cdd630aa3853 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.365329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00351e76-bef8-443a-986d-cdd630aa3853 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.365797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00351e76-bef8-443a-986d-cdd630aa3853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.392399 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-00351e76-bef8-443a-986d-cdd630aa3853 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:23.394069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-00351e76-bef8-443a-986d-cdd630aa3853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:23.404210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1032/2034] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:23.409033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea17f8-dcb7-47f4-bf00-285941384533 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.432102 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea17f8-dcb7-47f4-bf00-285941384533 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.438247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3713a42-1424-4060-869b-2ec2933f5a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.438923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3713a42-1424-4060-869b-2ec2933f5a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.441832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3713a42-1424-4060-869b-2ec2933f5a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.441832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3713a42-1424-4060-869b-2ec2933f5a38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.441832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3713a42-1424-4060-869b-2ec2933f5a38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:23.441832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3713a42-1424-4060-869b-2ec2933f5a38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.442666 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3713a42-1424-4060-869b-2ec2933f5a38 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.466897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1003/2035] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:23.470943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00351e76-bef8-443a-986d-cdd630aa3853 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.491978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00351e76-bef8-443a-986d-cdd630aa3853 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.504297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f4e7-3c13-4bde-b785-186ed393e059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.505962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f4e7-3c13-4bde-b785-186ed393e059 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.507266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f4e7-3c13-4bde-b785-186ed393e059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.507266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f4e7-3c13-4bde-b785-186ed393e059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.510963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3f4e7-3c13-4bde-b785-186ed393e059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.516497 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3f4e7-3c13-4bde-b785-186ed393e059 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.729128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1033/2036] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:23 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:23.733185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3713a42-1424-4060-869b-2ec2933f5a38 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.736821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:23.751358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3713a42-1424-4060-869b-2ec2933f5a38 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.877663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb218c-51cd-483e-9b58-14f4ed1653d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.878443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb218c-51cd-483e-9b58-14f4ed1653d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.878756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb218c-51cd-483e-9b58-14f4ed1653d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.879005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb218c-51cd-483e-9b58-14f4ed1653d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.879669 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb218c-51cd-483e-9b58-14f4ed1653d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.881878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb218c-51cd-483e-9b58-14f4ed1653d9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.053350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1004/2037] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:23 2022] POST /identity/v3/users => generated 287 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:24.059184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f4e7-3c13-4bde-b785-186ed393e059 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:24.083703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f4e7-3c13-4bde-b785-186ed393e059 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:24.096313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa5c5c-e14f-41bd-b17d-9c53cf60b8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:24.099214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa5c5c-e14f-41bd-b17d-9c53cf60b8be admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.100346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa5c5c-e14f-41bd-b17d-9c53cf60b8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.101244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa5c5c-e14f-41bd-b17d-9c53cf60b8be admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.102741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa5c5c-e14f-41bd-b17d-9c53cf60b8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:24.106367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa5c5c-e14f-41bd-b17d-9c53cf60b8be admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.137067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1034/2038] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:24.143054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb218c-51cd-483e-9b58-14f4ed1653d9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:24.175718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:24.181431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb218c-51cd-483e-9b58-14f4ed1653d9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:24.197336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a48f2-a291-4ae1-9ef7-678a1d704a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:24.197976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a48f2-a291-4ae1-9ef7-678a1d704a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.199252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a48f2-a291-4ae1-9ef7-678a1d704a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.199954 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a48f2-a291-4ae1-9ef7-678a1d704a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.203678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a48f2-a291-4ae1-9ef7-678a1d704a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:24.208379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a48f2-a291-4ae1-9ef7-678a1d704a31 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.238678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1005/2039] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:24.242672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa5c5c-e14f-41bd-b17d-9c53cf60b8be admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:24.255429 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa5c5c-e14f-41bd-b17d-9c53cf60b8be admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:24.263502 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697d401-de57-4952-81ab-17927c54b5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:24.265808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697d401-de57-4952-81ab-17927c54b5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.269492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697d401-de57-4952-81ab-17927c54b5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.270695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697d401-de57-4952-81ab-17927c54b5b3 admin admin] PATH_INFO: `/v3/projects/69241094b2f8431e9096f67a3db397f5/users/8af0cf0895d846458318bae70b7988f4/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.297850 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697d401-de57-4952-81ab-17927c54b5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69241094b2f8431e9096f67a3db397f5, user_id=8af0cf0895d846458318bae70b7988f4, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:24.301163 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697d401-de57-4952-81ab-17927c54b5b3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.408245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1035/2040] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:24 2022] PUT /identity/v3/projects/69241094b2f8431e9096f67a3db397f5/users/8af0cf0895d846458318bae70b7988f4/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:24.415718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94d462-11b1-4f5a-82d5-1569abfd7e76 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.416183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94d462-11b1-4f5a-82d5-1569abfd7e76 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.416658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94d462-11b1-4f5a-82d5-1569abfd7e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.471253 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-5c94d462-11b1-4f5a-82d5-1569abfd7e76 None None] MFA Rules not processed for user `8af0cf0895d846458318bae70b7988f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:24.472599 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5c94d462-11b1-4f5a-82d5-1569abfd7e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:24.583106 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1006/2041] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:24.602821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697d401-de57-4952-81ab-17927c54b5b3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:24.614081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c697d401-de57-4952-81ab-17927c54b5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:24.711420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697d401-de57-4952-81ab-17927c54b5b3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:24.716110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4086e-7b1a-4855-937b-7be48b493924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:24.717325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4086e-7b1a-4855-937b-7be48b493924 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.717961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4086e-7b1a-4855-937b-7be48b493924 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.718540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4086e-7b1a-4855-937b-7be48b493924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.732660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4086e-7b1a-4855-937b-7be48b493924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:24.735774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4086e-7b1a-4855-937b-7be48b493924 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.780382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1036/2042] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:24.837535 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94d462-11b1-4f5a-82d5-1569abfd7e76 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:25.010942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94d462-11b1-4f5a-82d5-1569abfd7e76 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:25.028612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:25.028612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:25.028612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:25.028612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] PATH_INFO: `/v3/users/8af0cf0895d846458318bae70b7988f4` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.029687 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af0cf0895d846458318bae70b7988f4)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:25.031293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:25.396894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af0cf0895d846458318bae70b7988f4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:25.418776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af0cf0895d846458318bae70b7988f4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:25.420450 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af0cf0895d846458318bae70b7988f4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:25.545574 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af0cf0895d846458318bae70b7988f4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:25.557135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af0cf0895d846458318bae70b7988f4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:25.567071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1007/2043] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:24 2022] DELETE /identity/v3/users/8af0cf0895d846458318bae70b7988f4 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:25.579463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc55cc9-5812-4760-b91b-3fd404585d2e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:25.580101 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc55cc9-5812-4760-b91b-3fd404585d2e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:25.580793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc55cc9-5812-4760-b91b-3fd404585d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.593604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:25.627113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5bc55cc9-5812-4760-b91b-3fd404585d2e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:25.628463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5bc55cc9-5812-4760-b91b-3fd404585d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:25.715300 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1037/2044] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:25.725128 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:25.726542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:25.802813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aba89-cb03-4368-b35f-83bb39ca517a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:25.807678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92593e59-4056-40cf-a065-f57646f817f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:25.808261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92593e59-4056-40cf-a065-f57646f817f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:25.808544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92593e59-4056-40cf-a065-f57646f817f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:25.808815 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92593e59-4056-40cf-a065-f57646f817f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.820260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92593e59-4056-40cf-a065-f57646f817f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:25.822361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92593e59-4056-40cf-a065-f57646f817f9 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:25.833459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1008/2045] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:26.468845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc55cc9-5812-4760-b91b-3fd404585d2e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.471054 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5bc55cc9-5812-4760-b91b-3fd404585d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:26.484492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc55cc9-5812-4760-b91b-3fd404585d2e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:26.489778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eead0-62c6-4921-a89f-7087b2b5c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:26.490450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eead0-62c6-4921-a89f-7087b2b5c573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.490839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eead0-62c6-4921-a89f-7087b2b5c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.491033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eead0-62c6-4921-a89f-7087b2b5c573 admin admin] PATH_INFO: `/v3/projects/69241094b2f8431e9096f67a3db397f5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.492245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eead0-62c6-4921-a89f-7087b2b5c573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69241094b2f8431e9096f67a3db397f5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:26.494527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eead0-62c6-4921-a89f-7087b2b5c573 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:26.564725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:26.652725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c09eead0-62c6-4921-a89f-7087b2b5c573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69241094b2f8431e9096f67a3db397f5', 'request_id': 'req-c09eead0-62c6-4921-a89f-7087b2b5c573'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.662907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c09eead0-62c6-4921-a89f-7087b2b5c573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69241094b2f8431e9096f67a3db397f5', 'request_id': 'req-c09eead0-62c6-4921-a89f-7087b2b5c573'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.770435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c09eead0-62c6-4921-a89f-7087b2b5c573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69241094b2f8431e9096f67a3db397f5', 'request_id': 'req-c09eead0-62c6-4921-a89f-7087b2b5c573'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.785987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c09eead0-62c6-4921-a89f-7087b2b5c573 admin admin] The token cache is being invalidate because project 69241094b2f8431e9096f67a3db397f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:26.786324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c09eead0-62c6-4921-a89f-7087b2b5c573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.787077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c09eead0-62c6-4921-a89f-7087b2b5c573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.788685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1038/2046] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:26 2022] DELETE /identity/v3/projects/69241094b2f8431e9096f67a3db397f5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:26.794739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36abeb-c7dd-4ffc-b146-0c2b091cad0a None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.795022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36abeb-c7dd-4ffc-b146-0c2b091cad0a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.795293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36abeb-c7dd-4ffc-b146-0c2b091cad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.823010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-2d36abeb-c7dd-4ffc-b146-0c2b091cad0a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:26.824273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2d36abeb-c7dd-4ffc-b146-0c2b091cad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:26.897179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1009/2047] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:26.912701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec5069-2c53-4986-8ede-d140393e11c3 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.913301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec5069-2c53-4986-8ede-d140393e11c3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.914186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec5069-2c53-4986-8ede-d140393e11c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.949947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e6ec5069-2c53-4986-8ede-d140393e11c3 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:26.952089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e6ec5069-2c53-4986-8ede-d140393e11c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:26.966520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1039/2048] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:26.972014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36abeb-c7dd-4ffc-b146-0c2b091cad0a None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.983327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36abeb-c7dd-4ffc-b146-0c2b091cad0a None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:26.988357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a6c37-f83e-4cca-a54c-76a014ff6fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:26.988985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a6c37-f83e-4cca-a54c-76a014ff6fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.989266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a6c37-f83e-4cca-a54c-76a014ff6fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.989539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a6c37-f83e-4cca-a54c-76a014ff6fd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.990199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a6c37-f83e-4cca-a54c-76a014ff6fd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:26.990539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a6c37-f83e-4cca-a54c-76a014ff6fd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:26.992156 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a6c37-f83e-4cca-a54c-76a014ff6fd3 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.006704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1010/2049] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:27.011322 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec5069-2c53-4986-8ede-d140393e11c3 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.021593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec5069-2c53-4986-8ede-d140393e11c3 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.027164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65863f-113c-4a6b-ba93-d809d6ba8082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.027774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65863f-113c-4a6b-ba93-d809d6ba8082 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.028081 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65863f-113c-4a6b-ba93-d809d6ba8082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.028354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65863f-113c-4a6b-ba93-d809d6ba8082 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.029031 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65863f-113c-4a6b-ba93-d809d6ba8082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.030997 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65863f-113c-4a6b-ba93-d809d6ba8082 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.199036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1040/2050] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:27 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:27.205760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a6c37-f83e-4cca-a54c-76a014ff6fd3 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.224204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a6c37-f83e-4cca-a54c-76a014ff6fd3 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.309659 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86bfb7-1129-4e32-ba6c-0d6573e81d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.310304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86bfb7-1129-4e32-ba6c-0d6573e81d98 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.310589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86bfb7-1129-4e32-ba6c-0d6573e81d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.310860 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86bfb7-1129-4e32-ba6c-0d6573e81d98 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.311498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86bfb7-1129-4e32-ba6c-0d6573e81d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.313690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86bfb7-1129-4e32-ba6c-0d6573e81d98 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.444815 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1011/2051] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:27 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:27.449618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65863f-113c-4a6b-ba93-d809d6ba8082 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.460675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65863f-113c-4a6b-ba93-d809d6ba8082 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.465971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb397c-7c26-4e8d-aefc-3744279725b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.466624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb397c-7c26-4e8d-aefc-3744279725b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.466905 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb397c-7c26-4e8d-aefc-3744279725b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.467196 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb397c-7c26-4e8d-aefc-3744279725b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.467842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb397c-7c26-4e8d-aefc-3744279725b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.469469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb397c-7c26-4e8d-aefc-3744279725b1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.481644 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1041/2052] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:27.485781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86bfb7-1129-4e32-ba6c-0d6573e81d98 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.496558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86bfb7-1129-4e32-ba6c-0d6573e81d98 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.504351 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f878f6a-408b-4a21-806c-cb12982a61f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.505764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f878f6a-408b-4a21-806c-cb12982a61f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.506308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f878f6a-408b-4a21-806c-cb12982a61f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.506810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f878f6a-408b-4a21-806c-cb12982a61f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.508082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f878f6a-408b-4a21-806c-cb12982a61f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.511465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f878f6a-408b-4a21-806c-cb12982a61f4 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.529212 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1012/2053] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:27.533586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb397c-7c26-4e8d-aefc-3744279725b1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.552064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb397c-7c26-4e8d-aefc-3744279725b1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.558877 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d10538-f9e8-40fe-a2d0-388f449951d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.559714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d10538-f9e8-40fe-a2d0-388f449951d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.560089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d10538-f9e8-40fe-a2d0-388f449951d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.560396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d10538-f9e8-40fe-a2d0-388f449951d3 admin admin] PATH_INFO: `/v3/projects/f1145b6597af457da0f5dc09eb281d13/users/b00ef882922446daa24acef99db53519/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.581425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d10538-f9e8-40fe-a2d0-388f449951d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1145b6597af457da0f5dc09eb281d13, user_id=b00ef882922446daa24acef99db53519, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.584148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d10538-f9e8-40fe-a2d0-388f449951d3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.742712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1042/2054] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:27 2022] PUT /identity/v3/projects/f1145b6597af457da0f5dc09eb281d13/users/b00ef882922446daa24acef99db53519/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:27.750719 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f35f1e-4a82-4e92-a753-e164c43febfb None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.751835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f35f1e-4a82-4e92-a753-e164c43febfb None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.752109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f35f1e-4a82-4e92-a753-e164c43febfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.788871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e0f35f1e-4a82-4e92-a753-e164c43febfb None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:27.791169 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e0f35f1e-4a82-4e92-a753-e164c43febfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:27.886590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1013/2055] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:27.897018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d10538-f9e8-40fe-a2d0-388f449951d3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.899167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e4d10538-f9e8-40fe-a2d0-388f449951d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:27.976255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d10538-f9e8-40fe-a2d0-388f449951d3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.980507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a73e-888a-464b-a023-0807fde6f23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.981272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a73e-888a-464b-a023-0807fde6f23a service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.981558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a73e-888a-464b-a023-0807fde6f23a service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.981830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a73e-888a-464b-a023-0807fde6f23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.992266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a73e-888a-464b-a023-0807fde6f23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.994592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a73e-888a-464b-a023-0807fde6f23a service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:28.007743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1043/2056] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:28.136907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:29.112692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:30.029968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0e15-daa7-4880-a289-9895acb6c2f4 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:30.031041 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0e15-daa7-4880-a289-9895acb6c2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:30.031555 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0e15-daa7-4880-a289-9895acb6c2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:30.073359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-403b0e15-daa7-4880-a289-9895acb6c2f4 None None] MFA Rules not processed for user `b00ef882922446daa24acef99db53519`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:30.075029 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-403b0e15-daa7-4880-a289-9895acb6c2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:30.198582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1014/2057] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:30.213408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a73e-888a-464b-a023-0807fde6f23a service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:30.218648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9543a73e-888a-464b-a023-0807fde6f23a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:30.295959 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a73e-888a-464b-a023-0807fde6f23a service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:30.301805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a4330-5d46-4846-840f-ba3697420565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:30.302864 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a4330-5d46-4846-840f-ba3697420565 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:30.303369 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a4330-5d46-4846-840f-ba3697420565 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:30.303820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a4330-5d46-4846-840f-ba3697420565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:30.316730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a4330-5d46-4846-840f-ba3697420565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:30.320200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a4330-5d46-4846-840f-ba3697420565 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:30.339099 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1044/2058] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:30.708075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:32.021869 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:33.371403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:33.974803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a536c4-27cc-47ce-ae03-6d6e4f10961d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:33.975628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a536c4-27cc-47ce-ae03-6d6e4f10961d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:33.975628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a536c4-27cc-47ce-ae03-6d6e4f10961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.003467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-48a536c4-27cc-47ce-ae03-6d6e4f10961d None None] MFA Rules not processed for user `b00ef882922446daa24acef99db53519`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:34.004943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-48a536c4-27cc-47ce-ae03-6d6e4f10961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.012921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1015/2059] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:34.098170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a4330-5d46-4846-840f-ba3697420565 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:34.100753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-df0a4330-5d46-4846-840f-ba3697420565 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.130091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a4330-5d46-4846-840f-ba3697420565 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:34.137095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c807e2-cfef-4dc4-9464-d2ef21c61c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:34.137891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c807e2-cfef-4dc4-9464-d2ef21c61c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.138296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c807e2-cfef-4dc4-9464-d2ef21c61c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.138650 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c807e2-cfef-4dc4-9464-d2ef21c61c59 admin admin] PATH_INFO: `/v3/users/81d4c0fb45114c7098382c3ee2d81b62` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.140113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c807e2-cfef-4dc4-9464-d2ef21c61c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d4c0fb45114c7098382c3ee2d81b62)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:34.143098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c807e2-cfef-4dc4-9464-d2ef21c61c59 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:34.182272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:34.469139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-42c807e2-cfef-4dc4-9464-d2ef21c61c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d4c0fb45114c7098382c3ee2d81b62'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.494324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-42c807e2-cfef-4dc4-9464-d2ef21c61c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d4c0fb45114c7098382c3ee2d81b62'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.495164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-42c807e2-cfef-4dc4-9464-d2ef21c61c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d4c0fb45114c7098382c3ee2d81b62'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.495814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-42c807e2-cfef-4dc4-9464-d2ef21c61c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d4c0fb45114c7098382c3ee2d81b62'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.506776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-42c807e2-cfef-4dc4-9464-d2ef21c61c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d4c0fb45114c7098382c3ee2d81b62'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.612485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1045/2060] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:34 2022] DELETE /identity/v3/users/81d4c0fb45114c7098382c3ee2d81b62 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:34.995333 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a536c4-27cc-47ce-ae03-6d6e4f10961d None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.013707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a536c4-27cc-47ce-ae03-6d6e4f10961d None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.114454 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8151a06-6560-42f7-bd83-99596866c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.114594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8151a06-6560-42f7-bd83-99596866c12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.114883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8151a06-6560-42f7-bd83-99596866c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.115158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8151a06-6560-42f7-bd83-99596866c12d admin admin] PATH_INFO: `/v3/projects/7f1b20dafafa414da75171df59ec9611` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.116701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8151a06-6560-42f7-bd83-99596866c12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1b20dafafa414da75171df59ec9611)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.118999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8151a06-6560-42f7-bd83-99596866c12d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.289533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a8151a06-6560-42f7-bd83-99596866c12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1b20dafafa414da75171df59ec9611', 'request_id': 'req-a8151a06-6560-42f7-bd83-99596866c12d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.299567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a8151a06-6560-42f7-bd83-99596866c12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1b20dafafa414da75171df59ec9611', 'request_id': 'req-a8151a06-6560-42f7-bd83-99596866c12d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.306720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a8151a06-6560-42f7-bd83-99596866c12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1b20dafafa414da75171df59ec9611', 'request_id': 'req-a8151a06-6560-42f7-bd83-99596866c12d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.456097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a8151a06-6560-42f7-bd83-99596866c12d admin admin] The token cache is being invalidate because project 7f1b20dafafa414da75171df59ec9611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:35.471247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a8151a06-6560-42f7-bd83-99596866c12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.471247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a8151a06-6560-42f7-bd83-99596866c12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.471247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1016/2061] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:34 2022] DELETE /identity/v3/projects/7f1b20dafafa414da75171df59ec9611 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:35.476293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bee0ca-acbb-4a5c-beaf-6995f4afc403 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.476840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bee0ca-acbb-4a5c-beaf-6995f4afc403 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.476840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bee0ca-acbb-4a5c-beaf-6995f4afc403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.500641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-99bee0ca-acbb-4a5c-beaf-6995f4afc403 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:35.502106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-99bee0ca-acbb-4a5c-beaf-6995f4afc403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.543153 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:35.570010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1046/2062] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:35.578586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d5555-8eb9-48d3-811b-9fd8b5be1db3 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.578869 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d5555-8eb9-48d3-811b-9fd8b5be1db3 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.579209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d5555-8eb9-48d3-811b-9fd8b5be1db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.601685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e97d5555-8eb9-48d3-811b-9fd8b5be1db3 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:35.603770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e97d5555-8eb9-48d3-811b-9fd8b5be1db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.613984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1017/2063] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:35.622731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bee0ca-acbb-4a5c-beaf-6995f4afc403 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.639260 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bee0ca-acbb-4a5c-beaf-6995f4afc403 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.647168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f58ef6-5446-48f9-a022-954e1d6fb2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.647971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f58ef6-5446-48f9-a022-954e1d6fb2ae admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.648434 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f58ef6-5446-48f9-a022-954e1d6fb2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.648874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f58ef6-5446-48f9-a022-954e1d6fb2ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.651336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f58ef6-5446-48f9-a022-954e1d6fb2ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:35.651892 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f58ef6-5446-48f9-a022-954e1d6fb2ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.655210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f58ef6-5446-48f9-a022-954e1d6fb2ae admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.674395 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1047/2064] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:35.678883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d5555-8eb9-48d3-811b-9fd8b5be1db3 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.688747 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d5555-8eb9-48d3-811b-9fd8b5be1db3 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.693824 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9202ff-692a-430c-9b4a-57d0cd32f2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.694553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9202ff-692a-430c-9b4a-57d0cd32f2dc admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.694835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9202ff-692a-430c-9b4a-57d0cd32f2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.695109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9202ff-692a-430c-9b4a-57d0cd32f2dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.695754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9202ff-692a-430c-9b4a-57d0cd32f2dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.698491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9202ff-692a-430c-9b4a-57d0cd32f2dc admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.753825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:35.862589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1018/2065] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:35.866922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f58ef6-5446-48f9-a022-954e1d6fb2ae admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.877709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f58ef6-5446-48f9-a022-954e1d6fb2ae admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.943208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737fdce-43ce-4bc1-9367-e54b14f6ef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.943838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737fdce-43ce-4bc1-9367-e54b14f6ef69 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.944149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737fdce-43ce-4bc1-9367-e54b14f6ef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.944426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737fdce-43ce-4bc1-9367-e54b14f6ef69 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.945203 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737fdce-43ce-4bc1-9367-e54b14f6ef69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.947881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737fdce-43ce-4bc1-9367-e54b14f6ef69 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.063878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1048/2066] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:36.067968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9202ff-692a-430c-9b4a-57d0cd32f2dc admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.085440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9202ff-692a-430c-9b4a-57d0cd32f2dc admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.094804 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29439976-049d-4a6d-beaa-51b7f40688b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.095635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29439976-049d-4a6d-beaa-51b7f40688b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.096047 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29439976-049d-4a6d-beaa-51b7f40688b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.096341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29439976-049d-4a6d-beaa-51b7f40688b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.097040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29439976-049d-4a6d-beaa-51b7f40688b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.098963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29439976-049d-4a6d-beaa-51b7f40688b6 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.111231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1019/2067] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:36.116207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737fdce-43ce-4bc1-9367-e54b14f6ef69 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.129077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737fdce-43ce-4bc1-9367-e54b14f6ef69 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.135359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b340b8c-2d42-41da-9cce-a496041afe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.136128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b340b8c-2d42-41da-9cce-a496041afe2c admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.136501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b340b8c-2d42-41da-9cce-a496041afe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.136879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b340b8c-2d42-41da-9cce-a496041afe2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.137689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b340b8c-2d42-41da-9cce-a496041afe2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.140056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b340b8c-2d42-41da-9cce-a496041afe2c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.152903 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1049/2068] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:36.158040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29439976-049d-4a6d-beaa-51b7f40688b6 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.169829 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29439976-049d-4a6d-beaa-51b7f40688b6 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.175705 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96e100-d6c0-4b82-a227-e341f402b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.176510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96e100-d6c0-4b82-a227-e341f402b7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.176839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96e100-d6c0-4b82-a227-e341f402b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.177335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96e100-d6c0-4b82-a227-e341f402b7aa admin admin] PATH_INFO: `/v3/projects/45d1801ff0ca4710b10182371cc53c88/users/73fa7f4b05614d1ca6ff4c730f6a0e80/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.195379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96e100-d6c0-4b82-a227-e341f402b7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d1801ff0ca4710b10182371cc53c88, user_id=73fa7f4b05614d1ca6ff4c730f6a0e80, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.198796 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96e100-d6c0-4b82-a227-e341f402b7aa admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.279976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1020/2069] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:36 2022] PUT /identity/v3/projects/45d1801ff0ca4710b10182371cc53c88/users/73fa7f4b05614d1ca6ff4c730f6a0e80/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:36.290455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b48cf7-8939-4312-ade4-d8cc8b235d30 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.290749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b48cf7-8939-4312-ade4-d8cc8b235d30 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.291022 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b48cf7-8939-4312-ade4-d8cc8b235d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.327364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a2b48cf7-8939-4312-ade4-d8cc8b235d30 None None] MFA Rules not processed for user `73fa7f4b05614d1ca6ff4c730f6a0e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:36.328672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a2b48cf7-8939-4312-ade4-d8cc8b235d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:36.414189 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1050/2070] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:36.418506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96e100-d6c0-4b82-a227-e341f402b7aa admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.523165 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96e100-d6c0-4b82-a227-e341f402b7aa admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.531039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d103ec-167b-4bd9-b0d1-35ad8e2786a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.532097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d103ec-167b-4bd9-b0d1-35ad8e2786a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.532580 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d103ec-167b-4bd9-b0d1-35ad8e2786a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.533089 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d103ec-167b-4bd9-b0d1-35ad8e2786a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.534255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d103ec-167b-4bd9-b0d1-35ad8e2786a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.538024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d103ec-167b-4bd9-b0d1-35ad8e2786a8 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.660093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1021/2071] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:36 2022] POST /identity/v3/projects => generated 363 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:36.667645 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b48cf7-8939-4312-ade4-d8cc8b235d30 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.682668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b48cf7-8939-4312-ade4-d8cc8b235d30 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.752139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71d8b3-95ff-4c92-b8e0-49e3addd8d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.752793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71d8b3-95ff-4c92-b8e0-49e3addd8d29 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.753082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71d8b3-95ff-4c92-b8e0-49e3addd8d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.753393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71d8b3-95ff-4c92-b8e0-49e3addd8d29 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.754583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71d8b3-95ff-4c92-b8e0-49e3addd8d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.756652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71d8b3-95ff-4c92-b8e0-49e3addd8d29 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.875110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1051/2072] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:36 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:36.879088 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d103ec-167b-4bd9-b0d1-35ad8e2786a8 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.893307 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d103ec-167b-4bd9-b0d1-35ad8e2786a8 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.897972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248602d3-769a-4fc7-aa4c-e14743d8be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.898626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248602d3-769a-4fc7-aa4c-e14743d8be8b admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.898917 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248602d3-769a-4fc7-aa4c-e14743d8be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.899255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248602d3-769a-4fc7-aa4c-e14743d8be8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.900204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248602d3-769a-4fc7-aa4c-e14743d8be8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.901855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248602d3-769a-4fc7-aa4c-e14743d8be8b admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.920458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1022/2073] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:36.925046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71d8b3-95ff-4c92-b8e0-49e3addd8d29 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.936579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71d8b3-95ff-4c92-b8e0-49e3addd8d29 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.941563 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7bb7c-8f0e-48c3-9451-02d79d89444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.942315 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7bb7c-8f0e-48c3-9451-02d79d89444a admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.942598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7bb7c-8f0e-48c3-9451-02d79d89444a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.942867 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7bb7c-8f0e-48c3-9451-02d79d89444a admin admin] PATH_INFO: `/v3/projects/364882828efb489885cc3c6c4152ccb5/users/e18bfa980fb549adb9969934aa7a0ee9/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.961389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7bb7c-8f0e-48c3-9451-02d79d89444a admin admin] RBAC: Authorizing `identity:create_grant(project_id=364882828efb489885cc3c6c4152ccb5, user_id=e18bfa980fb549adb9969934aa7a0ee9, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.964799 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7bb7c-8f0e-48c3-9451-02d79d89444a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:37.146867 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1052/2074] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:36 2022] PUT /identity/v3/projects/364882828efb489885cc3c6c4152ccb5/users/e18bfa980fb549adb9969934aa7a0ee9/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:37.152900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248602d3-769a-4fc7-aa4c-e14743d8be8b admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:37.165845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248602d3-769a-4fc7-aa4c-e14743d8be8b admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:37.242870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e83301-863f-4750-b4b0-58749f89b6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:37.244775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e83301-863f-4750-b4b0-58749f89b6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:37.245066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e83301-863f-4750-b4b0-58749f89b6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:37.245340 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e83301-863f-4750-b4b0-58749f89b6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:37.247390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e83301-863f-4750-b4b0-58749f89b6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:37.249316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e83301-863f-4750-b4b0-58749f89b6b1 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:37.261315 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1023/2075] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:37.266344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7bb7c-8f0e-48c3-9451-02d79d89444a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:37.279711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7bb7c-8f0e-48c3-9451-02d79d89444a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:37.287181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56db2f-6f70-4e80-9ecf-7ac8a0178ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:37.288069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56db2f-6f70-4e80-9ecf-7ac8a0178ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:37.288494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56db2f-6f70-4e80-9ecf-7ac8a0178ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:37.288774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56db2f-6f70-4e80-9ecf-7ac8a0178ea5 admin admin] PATH_INFO: `/v3/projects/364882828efb489885cc3c6c4152ccb5/users/e18bfa980fb549adb9969934aa7a0ee9/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:37.291058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56db2f-6f70-4e80-9ecf-7ac8a0178ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364882828efb489885cc3c6c4152ccb5, user_id=e18bfa980fb549adb9969934aa7a0ee9, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:37.293919 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56db2f-6f70-4e80-9ecf-7ac8a0178ea5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:37.316550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1053/2076] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:37 2022] PUT /identity/v3/projects/364882828efb489885cc3c6c4152ccb5/users/e18bfa980fb549adb9969934aa7a0ee9/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:37.329568 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb246c-e9f8-4d15-b54f-2feffe08939f None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:37.330110 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb246c-e9f8-4d15-b54f-2feffe08939f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:37.330732 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb246c-e9f8-4d15-b54f-2feffe08939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:37.366405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-9fbb246c-e9f8-4d15-b54f-2feffe08939f None None] MFA Rules not processed for user `e18bfa980fb549adb9969934aa7a0ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:37.375118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9fbb246c-e9f8-4d15-b54f-2feffe08939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:37.474198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1024/2077] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:37.492284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56db2f-6f70-4e80-9ecf-7ac8a0178ea5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:37.494814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-aa56db2f-6f70-4e80-9ecf-7ac8a0178ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:37.578980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56db2f-6f70-4e80-9ecf-7ac8a0178ea5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:37.584252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb64c42-7161-4162-a3d3-605296c91047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:37.585137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb64c42-7161-4162-a3d3-605296c91047 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:37.585521 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb64c42-7161-4162-a3d3-605296c91047 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:37.585792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb64c42-7161-4162-a3d3-605296c91047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:37.597169 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb64c42-7161-4162-a3d3-605296c91047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:37.599145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb64c42-7161-4162-a3d3-605296c91047 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:37.612051 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1054/2078] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:38.085530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb246c-e9f8-4d15-b54f-2feffe08939f None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:38.097019 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb246c-e9f8-4d15-b54f-2feffe08939f None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:38.102209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823e5ef-b17a-4fc9-9baa-76de92aab4d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:38.103922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823e5ef-b17a-4fc9-9baa-76de92aab4d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.104361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823e5ef-b17a-4fc9-9baa-76de92aab4d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.104950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823e5ef-b17a-4fc9-9baa-76de92aab4d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.160271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:38.189917 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823e5ef-b17a-4fc9-9baa-76de92aab4d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:38.191756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823e5ef-b17a-4fc9-9baa-76de92aab4d4 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:38.204035 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1025/2079] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:38.605843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb64c42-7161-4162-a3d3-605296c91047 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:38.607416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-deb64c42-7161-4162-a3d3-605296c91047 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:38.678682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb64c42-7161-4162-a3d3-605296c91047 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:38.687061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:38.687719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.687996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.688289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] PATH_INFO: `/v3/users/12317ecf864f4d25a908a0751ef177d1` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.689535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12317ecf864f4d25a908a0751ef177d1)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:38.692216 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:39.142354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12317ecf864f4d25a908a0751ef177d1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:39.160894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12317ecf864f4d25a908a0751ef177d1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:39.161640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12317ecf864f4d25a908a0751ef177d1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:39.162488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12317ecf864f4d25a908a0751ef177d1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:39.172099 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12317ecf864f4d25a908a0751ef177d1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:39.338076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1055/2080] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:38 2022] DELETE /identity/v3/users/12317ecf864f4d25a908a0751ef177d1 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:39.342952 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c22b-4e9f-4cfa-80f0-1dfb4006ae96 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:39.343453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c22b-4e9f-4cfa-80f0-1dfb4006ae96 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:39.343538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c22b-4e9f-4cfa-80f0-1dfb4006ae96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:39.374846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6cf1c22b-4e9f-4cfa-80f0-1dfb4006ae96 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:39.376907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6cf1c22b-4e9f-4cfa-80f0-1dfb4006ae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:39.479552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1026/2081] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:39.487727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:39.489227 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:39.579354 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9bd96-b9a8-4579-b88f-8f9c99af07b2 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:39.582182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd14ddf-f0ec-4220-ab29-c3d416e7c707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:39.582836 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd14ddf-f0ec-4220-ab29-c3d416e7c707 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:39.583113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd14ddf-f0ec-4220-ab29-c3d416e7c707 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:39.583381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd14ddf-f0ec-4220-ab29-c3d416e7c707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:39.597986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd14ddf-f0ec-4220-ab29-c3d416e7c707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:39.599805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd14ddf-f0ec-4220-ab29-c3d416e7c707 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:39.611874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1056/2082] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:40.243650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c22b-4e9f-4cfa-80f0-1dfb4006ae96 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:40.247746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6cf1c22b-4e9f-4cfa-80f0-1dfb4006ae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:40.261025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c22b-4e9f-4cfa-80f0-1dfb4006ae96 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.267063 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd41657-fe30-4f49-a941-647a388d6fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:40.267700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd41657-fe30-4f49-a941-647a388d6fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.267896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd41657-fe30-4f49-a941-647a388d6fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.268129 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd41657-fe30-4f49-a941-647a388d6fa5 admin admin] PATH_INFO: `/v3/projects/7fe968db46dc4ce282ed44eb26b7f2ba` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.269525 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd41657-fe30-4f49-a941-647a388d6fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe968db46dc4ce282ed44eb26b7f2ba)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:40.272125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd41657-fe30-4f49-a941-647a388d6fa5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:40.486163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8fd41657-fe30-4f49-a941-647a388d6fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe968db46dc4ce282ed44eb26b7f2ba', 'request_id': 'req-8fd41657-fe30-4f49-a941-647a388d6fa5'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:40.493473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8fd41657-fe30-4f49-a941-647a388d6fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe968db46dc4ce282ed44eb26b7f2ba', 'request_id': 'req-8fd41657-fe30-4f49-a941-647a388d6fa5'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:40.500191 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8fd41657-fe30-4f49-a941-647a388d6fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe968db46dc4ce282ed44eb26b7f2ba', 'request_id': 'req-8fd41657-fe30-4f49-a941-647a388d6fa5'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:40.593906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8fd41657-fe30-4f49-a941-647a388d6fa5 admin admin] The token cache is being invalidate because project 7fe968db46dc4ce282ed44eb26b7f2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:40.594456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8fd41657-fe30-4f49-a941-647a388d6fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:40.596036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8fd41657-fe30-4f49-a941-647a388d6fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:40.598730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1027/2083] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:40 2022] DELETE /identity/v3/projects/7fe968db46dc4ce282ed44eb26b7f2ba => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:40.606109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7884a4-55fb-499b-ab17-413c5f36f41c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.606429 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7884a4-55fb-499b-ab17-413c5f36f41c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.606859 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7884a4-55fb-499b-ab17-413c5f36f41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.660027 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ae7884a4-55fb-499b-ab17-413c5f36f41c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:40.664080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ae7884a4-55fb-499b-ab17-413c5f36f41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:40.753183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1057/2084] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:40.762392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73b204-3089-48ce-934a-b968c0183a07 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.763018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73b204-3089-48ce-934a-b968c0183a07 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.763535 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73b204-3089-48ce-934a-b968c0183a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.798388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-3a73b204-3089-48ce-934a-b968c0183a07 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:40.801856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3a73b204-3089-48ce-934a-b968c0183a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:40.814533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1028/2085] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:40.819413 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7884a4-55fb-499b-ab17-413c5f36f41c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:40.832050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7884a4-55fb-499b-ab17-413c5f36f41c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.837840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf4c0a-60a2-4148-812d-e2e5936bc3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:40.838618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf4c0a-60a2-4148-812d-e2e5936bc3ff admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.847574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf4c0a-60a2-4148-812d-e2e5936bc3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.847574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf4c0a-60a2-4148-812d-e2e5936bc3ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.847574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf4c0a-60a2-4148-812d-e2e5936bc3ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:40.847574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf4c0a-60a2-4148-812d-e2e5936bc3ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:40.847574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf4c0a-60a2-4148-812d-e2e5936bc3ff admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:40.859122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1058/2086] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:40.864164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73b204-3089-48ce-934a-b968c0183a07 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:40.875378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73b204-3089-48ce-934a-b968c0183a07 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.881700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79575ba-8b3a-4c85-9442-900cd1ca9be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:40.882630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79575ba-8b3a-4c85-9442-900cd1ca9be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.893488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79575ba-8b3a-4c85-9442-900cd1ca9be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.893488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79575ba-8b3a-4c85-9442-900cd1ca9be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.893488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79575ba-8b3a-4c85-9442-900cd1ca9be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:40.893488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79575ba-8b3a-4c85-9442-900cd1ca9be5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:40.994337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:41.105898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1029/2087] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:40 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:41.108423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf4c0a-60a2-4148-812d-e2e5936bc3ff admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.119594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf4c0a-60a2-4148-812d-e2e5936bc3ff admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.182937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab59b80-ce75-4fb5-9ef0-c51f321f85e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.183551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab59b80-ce75-4fb5-9ef0-c51f321f85e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.184128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab59b80-ce75-4fb5-9ef0-c51f321f85e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.184319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab59b80-ce75-4fb5-9ef0-c51f321f85e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.184982 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab59b80-ce75-4fb5-9ef0-c51f321f85e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.187136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab59b80-ce75-4fb5-9ef0-c51f321f85e7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.354378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1059/2088] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:41 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:41.359788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79575ba-8b3a-4c85-9442-900cd1ca9be5 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.384138 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79575ba-8b3a-4c85-9442-900cd1ca9be5 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.392698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e3823-a1e0-4e47-81dd-d0d35c17d5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.393427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e3823-a1e0-4e47-81dd-d0d35c17d5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.403755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e3823-a1e0-4e47-81dd-d0d35c17d5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.403755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e3823-a1e0-4e47-81dd-d0d35c17d5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.403755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e3823-a1e0-4e47-81dd-d0d35c17d5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.403755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e3823-a1e0-4e47-81dd-d0d35c17d5b6 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.415918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1030/2089] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:41.417833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab59b80-ce75-4fb5-9ef0-c51f321f85e7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.437659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab59b80-ce75-4fb5-9ef0-c51f321f85e7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.443765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b6be4-a939-4d7f-b32a-3d5c91434793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.444639 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6be4-a939-4d7f-b32a-3d5c91434793 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.445034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6be4-a939-4d7f-b32a-3d5c91434793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.445426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6be4-a939-4d7f-b32a-3d5c91434793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.446071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b6be4-a939-4d7f-b32a-3d5c91434793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.448317 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b6be4-a939-4d7f-b32a-3d5c91434793 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.463929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1060/2090] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:41.469793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e3823-a1e0-4e47-81dd-d0d35c17d5b6 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.512810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e3823-a1e0-4e47-81dd-d0d35c17d5b6 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.512810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fcb46-24ec-4723-8989-0d60cdf57619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.512810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fcb46-24ec-4723-8989-0d60cdf57619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.512810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fcb46-24ec-4723-8989-0d60cdf57619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.515469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fcb46-24ec-4723-8989-0d60cdf57619 admin admin] PATH_INFO: `/v3/projects/cfdb8ef4ec664765a29d5b42a6b0b4f9/users/71cbb78bdadd482dab0e3ecd0d508200/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.536237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fcb46-24ec-4723-8989-0d60cdf57619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb8ef4ec664765a29d5b42a6b0b4f9, user_id=71cbb78bdadd482dab0e3ecd0d508200, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.539193 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fcb46-24ec-4723-8989-0d60cdf57619 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.689008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1031/2091] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:41 2022] PUT /identity/v3/projects/cfdb8ef4ec664765a29d5b42a6b0b4f9/users/71cbb78bdadd482dab0e3ecd0d508200/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:41.703534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73df16e-0d12-4206-9f1f-84fac25d6a5e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.704328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73df16e-0d12-4206-9f1f-84fac25d6a5e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.704750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73df16e-0d12-4206-9f1f-84fac25d6a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.746217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a73df16e-0d12-4206-9f1f-84fac25d6a5e None None] MFA Rules not processed for user `71cbb78bdadd482dab0e3ecd0d508200`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:41.747583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a73df16e-0d12-4206-9f1f-84fac25d6a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:41.834691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1061/2092] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:41.839821 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fcb46-24ec-4723-8989-0d60cdf57619 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.923501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fcb46-24ec-4723-8989-0d60cdf57619 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.928323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f63c55-71db-477a-94be-35b61b233fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.928933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f63c55-71db-477a-94be-35b61b233fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.929224 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f63c55-71db-477a-94be-35b61b233fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.929500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f63c55-71db-477a-94be-35b61b233fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.931196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f63c55-71db-477a-94be-35b61b233fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.932689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f63c55-71db-477a-94be-35b61b233fd1 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:42.122260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1032/2093] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:41 2022] POST /identity/v3/projects => generated 381 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:42.127403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73df16e-0d12-4206-9f1f-84fac25d6a5e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:42.139307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73df16e-0d12-4206-9f1f-84fac25d6a5e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:42.217045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7c475-fae0-4d37-8624-0e01bfdc35cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:42.217669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7c475-fae0-4d37-8624-0e01bfdc35cd admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.217953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7c475-fae0-4d37-8624-0e01bfdc35cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.218253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7c475-fae0-4d37-8624-0e01bfdc35cd admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.218951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7c475-fae0-4d37-8624-0e01bfdc35cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:42.220885 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7c475-fae0-4d37-8624-0e01bfdc35cd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:42.367163 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1062/2094] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:42 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:42.370929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f63c55-71db-477a-94be-35b61b233fd1 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:42.397076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f63c55-71db-477a-94be-35b61b233fd1 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:42.409097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f06224-1c06-4600-a4a2-cfb4b875effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:42.410061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f06224-1c06-4600-a4a2-cfb4b875effc admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.411098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f06224-1c06-4600-a4a2-cfb4b875effc admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.411663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f06224-1c06-4600-a4a2-cfb4b875effc admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.412893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f06224-1c06-4600-a4a2-cfb4b875effc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:42.417455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f06224-1c06-4600-a4a2-cfb4b875effc admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:42.439556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1033/2095] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:42.445540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7c475-fae0-4d37-8624-0e01bfdc35cd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:42.463016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7c475-fae0-4d37-8624-0e01bfdc35cd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:42.469553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99530ff-ccd7-4c73-9765-5836241da4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:42.470327 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99530ff-ccd7-4c73-9765-5836241da4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.481677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99530ff-ccd7-4c73-9765-5836241da4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.481677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99530ff-ccd7-4c73-9765-5836241da4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.481677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99530ff-ccd7-4c73-9765-5836241da4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:42.481677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99530ff-ccd7-4c73-9765-5836241da4ab admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:42.486672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1063/2096] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:42.490322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f06224-1c06-4600-a4a2-cfb4b875effc admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:42.501170 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f06224-1c06-4600-a4a2-cfb4b875effc admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:42.506246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e532bbf-23e5-4b48-9c82-b87669cd4c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:42.506914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e532bbf-23e5-4b48-9c82-b87669cd4c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.507190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e532bbf-23e5-4b48-9c82-b87669cd4c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.507461 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e532bbf-23e5-4b48-9c82-b87669cd4c47 admin admin] PATH_INFO: `/v3/projects/1f8a66e260f641a9a770d196dcc4bc52/users/5f242671a3294bb9998b1607ecd072af/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.525542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e532bbf-23e5-4b48-9c82-b87669cd4c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8a66e260f641a9a770d196dcc4bc52, user_id=5f242671a3294bb9998b1607ecd072af, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:42.529436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e532bbf-23e5-4b48-9c82-b87669cd4c47 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:42.649862 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1034/2097] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:42 2022] PUT /identity/v3/projects/1f8a66e260f641a9a770d196dcc4bc52/users/5f242671a3294bb9998b1607ecd072af/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:42.660213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244310c-16fe-4525-a4a2-83087336d15a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.660499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244310c-16fe-4525-a4a2-83087336d15a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.660807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244310c-16fe-4525-a4a2-83087336d15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.692829 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5244310c-16fe-4525-a4a2-83087336d15a None None] MFA Rules not processed for user `5f242671a3294bb9998b1607ecd072af`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:42.694543 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5244310c-16fe-4525-a4a2-83087336d15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:42.773034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1064/2098] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:42.778263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e532bbf-23e5-4b48-9c82-b87669cd4c47 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:42.867074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e532bbf-23e5-4b48-9c82-b87669cd4c47 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:42.872084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd8701-c50d-458b-9fc0-1f77ce1e5e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:42.872692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd8701-c50d-458b-9fc0-1f77ce1e5e3c admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.872974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd8701-c50d-458b-9fc0-1f77ce1e5e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.873247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd8701-c50d-458b-9fc0-1f77ce1e5e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.873906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd8701-c50d-458b-9fc0-1f77ce1e5e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:42.875867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd8701-c50d-458b-9fc0-1f77ce1e5e3c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:43.017705 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1035/2099] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:42 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:43.021629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244310c-16fe-4525-a4a2-83087336d15a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:43.035260 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244310c-16fe-4525-a4a2-83087336d15a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:43.132520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa0da-fc24-4279-a445-c172cc00f3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:43.133302 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa0da-fc24-4279-a445-c172cc00f3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:43.134106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa0da-fc24-4279-a445-c172cc00f3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:43.134876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa0da-fc24-4279-a445-c172cc00f3f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:43.134876 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afa0da-fc24-4279-a445-c172cc00f3f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:43.137612 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afa0da-fc24-4279-a445-c172cc00f3f6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:43.286468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1065/2100] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:43 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:43.291755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd8701-c50d-458b-9fc0-1f77ce1e5e3c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:43.302391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd8701-c50d-458b-9fc0-1f77ce1e5e3c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:43.308364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d002ac-1175-407d-92b1-382036a5ed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:43.309110 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d002ac-1175-407d-92b1-382036a5ed2f admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:43.309508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d002ac-1175-407d-92b1-382036a5ed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:43.309857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d002ac-1175-407d-92b1-382036a5ed2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:43.310724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d002ac-1175-407d-92b1-382036a5ed2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:43.313357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d002ac-1175-407d-92b1-382036a5ed2f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:43.331087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1036/2101] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:43.332110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa0da-fc24-4279-a445-c172cc00f3f6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:43.344842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa0da-fc24-4279-a445-c172cc00f3f6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:43.359956 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e984b-7bbc-49ca-9a31-a0b3887d5765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:43.360980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e984b-7bbc-49ca-9a31-a0b3887d5765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:43.361252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e984b-7bbc-49ca-9a31-a0b3887d5765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:43.361550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e984b-7bbc-49ca-9a31-a0b3887d5765 admin admin] PATH_INFO: `/v3/projects/b564b708bd9d463ea55a36999f5bd9ed/users/5a915d8edae548548c16b8b3681c74fb/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:43.390090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e984b-7bbc-49ca-9a31-a0b3887d5765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b564b708bd9d463ea55a36999f5bd9ed, user_id=5a915d8edae548548c16b8b3681c74fb, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:43.393185 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e984b-7bbc-49ca-9a31-a0b3887d5765 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:43.578662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1066/2102] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:43 2022] PUT /identity/v3/projects/b564b708bd9d463ea55a36999f5bd9ed/users/5a915d8edae548548c16b8b3681c74fb/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:43.583548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d002ac-1175-407d-92b1-382036a5ed2f admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:43.593969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d002ac-1175-407d-92b1-382036a5ed2f admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:43.688556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335a4d8-e0c2-4209-83c8-c5710f42737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:43.689171 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335a4d8-e0c2-4209-83c8-c5710f42737b admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:43.689611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335a4d8-e0c2-4209-83c8-c5710f42737b admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:43.690141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335a4d8-e0c2-4209-83c8-c5710f42737b admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:43.690794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335a4d8-e0c2-4209-83c8-c5710f42737b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:43.692437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335a4d8-e0c2-4209-83c8-c5710f42737b admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:43.705291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1037/2103] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:43.709378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e984b-7bbc-49ca-9a31-a0b3887d5765 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:43.724317 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e984b-7bbc-49ca-9a31-a0b3887d5765 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:43.733047 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989445cb-3090-4b79-811c-85cc0267c536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:43.734499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989445cb-3090-4b79-811c-85cc0267c536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:43.734853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989445cb-3090-4b79-811c-85cc0267c536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:43.735329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989445cb-3090-4b79-811c-85cc0267c536 admin admin] PATH_INFO: `/v3/projects/b564b708bd9d463ea55a36999f5bd9ed/users/5a915d8edae548548c16b8b3681c74fb/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:43.737904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989445cb-3090-4b79-811c-85cc0267c536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b564b708bd9d463ea55a36999f5bd9ed, user_id=5a915d8edae548548c16b8b3681c74fb, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:43.741025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989445cb-3090-4b79-811c-85cc0267c536 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:43.761993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1067/2104] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:43 2022] PUT /identity/v3/projects/b564b708bd9d463ea55a36999f5bd9ed/users/5a915d8edae548548c16b8b3681c74fb/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:43.778436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a94a5c-8b54-4078-bbed-43d5a43c660d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:43.779283 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a94a5c-8b54-4078-bbed-43d5a43c660d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:43.779772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a94a5c-8b54-4078-bbed-43d5a43c660d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:43.834315 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-57a94a5c-8b54-4078-bbed-43d5a43c660d None None] MFA Rules not processed for user `5a915d8edae548548c16b8b3681c74fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:43.836096 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-57a94a5c-8b54-4078-bbed-43d5a43c660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:43.923557 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1038/2105] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:43.968020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989445cb-3090-4b79-811c-85cc0267c536 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:43.970781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-989445cb-3090-4b79-811c-85cc0267c536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:44.061595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989445cb-3090-4b79-811c-85cc0267c536 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:44.061595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaabadb-1895-40c3-b760-0f0b0437c0be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:44.061595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaabadb-1895-40c3-b760-0f0b0437c0be service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:44.061595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaabadb-1895-40c3-b760-0f0b0437c0be service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:44.062060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaabadb-1895-40c3-b760-0f0b0437c0be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:44.176147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaabadb-1895-40c3-b760-0f0b0437c0be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:44.178290 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaabadb-1895-40c3-b760-0f0b0437c0be service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:44.190977 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1068/2106] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:44.324542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:45.615940 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:47.781222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:48.251976 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a94a5c-8b54-4078-bbed-43d5a43c660d None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:48.267059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a94a5c-8b54-4078-bbed-43d5a43c660d None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:48.272318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5969f8-ae07-4ddd-a8ef-5ae8f7983dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:48.272941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5969f8-ae07-4ddd-a8ef-5ae8f7983dfb service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:48.273224 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5969f8-ae07-4ddd-a8ef-5ae8f7983dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:48.273499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5969f8-ae07-4ddd-a8ef-5ae8f7983dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:48.334457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5969f8-ae07-4ddd-a8ef-5ae8f7983dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:48.335903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5969f8-ae07-4ddd-a8ef-5ae8f7983dfb service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:48.345629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1039/2107] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:49.832471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:50.816249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:50.933308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaabadb-1895-40c3-b760-0f0b0437c0be service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:50.944716 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaabadb-1895-40c3-b760-0f0b0437c0be service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:50.952616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035c4a0-a834-4458-910d-2f6c81522384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:50.952616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035c4a0-a834-4458-910d-2f6c81522384 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:50.952616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035c4a0-a834-4458-910d-2f6c81522384 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:50.952616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035c4a0-a834-4458-910d-2f6c81522384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:50.981844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035c4a0-a834-4458-910d-2f6c81522384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:50.985588 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035c4a0-a834-4458-910d-2f6c81522384 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:50.997030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1069/2108] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:51.407535 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5969f8-ae07-4ddd-a8ef-5ae8f7983dfb service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:51.410362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-0a5969f8-ae07-4ddd-a8ef-5ae8f7983dfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:51.422572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5969f8-ae07-4ddd-a8ef-5ae8f7983dfb service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:51.426480 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b17c30-2a9b-44f7-afb1-81c58ce74d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:51.427163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b17c30-2a9b-44f7-afb1-81c58ce74d4d service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:51.427463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b17c30-2a9b-44f7-afb1-81c58ce74d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:51.427752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b17c30-2a9b-44f7-afb1-81c58ce74d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:51.430060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b9b17c30-2a9b-44f7-afb1-81c58ce74d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:51.501497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b17c30-2a9b-44f7-afb1-81c58ce74d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:51.503061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b17c30-2a9b-44f7-afb1-81c58ce74d4d service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:51.515222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1040/2109] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:52.617380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:53.507510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:53.992286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035c4a0-a834-4458-910d-2f6c81522384 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:53.994493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c035c4a0-a834-4458-910d-2f6c81522384 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:54.073520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035c4a0-a834-4458-910d-2f6c81522384 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:54.079714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:54.080551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.080823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.081103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] PATH_INFO: `/v3/users/73fa7f4b05614d1ca6ff4c730f6a0e80` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.082883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73fa7f4b05614d1ca6ff4c730f6a0e80)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:54.085814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:54.406813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73fa7f4b05614d1ca6ff4c730f6a0e80'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:54.420031 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73fa7f4b05614d1ca6ff4c730f6a0e80'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:54.420772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73fa7f4b05614d1ca6ff4c730f6a0e80'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:54.421387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73fa7f4b05614d1ca6ff4c730f6a0e80'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:54.428791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73fa7f4b05614d1ca6ff4c730f6a0e80'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:54.549107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1070/2110] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:53 2022] DELETE /identity/v3/users/73fa7f4b05614d1ca6ff4c730f6a0e80 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:54.553383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00baf4-0e73-4451-80f4-a66af1819e39 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.554084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00baf4-0e73-4451-80f4-a66af1819e39 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.554084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00baf4-0e73-4451-80f4-a66af1819e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.582949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-bb00baf4-0e73-4451-80f4-a66af1819e39 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:54.585500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bb00baf4-0e73-4451-80f4-a66af1819e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:54.682845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1041/2111] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:54.699132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:54.707373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:54.783456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd505286-f122-47c4-ba3f-5550c732c745 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:54.787557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e1adb-93c5-401f-9454-afdb09f97d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:54.788182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e1adb-93c5-401f-9454-afdb09f97d39 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.788463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e1adb-93c5-401f-9454-afdb09f97d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.788780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e1adb-93c5-401f-9454-afdb09f97d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.799972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e1adb-93c5-401f-9454-afdb09f97d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:54.803530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e1adb-93c5-401f-9454-afdb09f97d39 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:54.814006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1071/2112] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:55.304898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00baf4-0e73-4451-80f4-a66af1819e39 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:55.308604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bb00baf4-0e73-4451-80f4-a66af1819e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:55.346839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00baf4-0e73-4451-80f4-a66af1819e39 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:55.353314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:55.354745 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:55.355095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:55.355434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] PATH_INFO: `/v3/projects/45d1801ff0ca4710b10182371cc53c88` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:55.357036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d1801ff0ca4710b10182371cc53c88)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:55.359230 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:55.528291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d1801ff0ca4710b10182371cc53c88', 'request_id': 'req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:55.537457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d1801ff0ca4710b10182371cc53c88', 'request_id': 'req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:55.548609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d1801ff0ca4710b10182371cc53c88', 'request_id': 'req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:55.598821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:55.640488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] The token cache is being invalidate because project 45d1801ff0ca4710b10182371cc53c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:55.641071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:55.641599 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:55.643238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1042/2113] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:55 2022] DELETE /identity/v3/projects/45d1801ff0ca4710b10182371cc53c88 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:55.647349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e1adb-93c5-401f-9454-afdb09f97d39 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:55.659369 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e1adb-93c5-401f-9454-afdb09f97d39 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:55.725959 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c75c-67ef-4f32-92e5-d1d57ef61ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:55.726567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c75c-67ef-4f32-92e5-d1d57ef61ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:55.726957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c75c-67ef-4f32-92e5-d1d57ef61ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:55.727143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c75c-67ef-4f32-92e5-d1d57ef61ed7 admin admin] PATH_INFO: `/v3/users/e18bfa980fb549adb9969934aa7a0ee9` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:55.730366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c75c-67ef-4f32-92e5-d1d57ef61ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18bfa980fb549adb9969934aa7a0ee9)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:55.732365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c75c-67ef-4f32-92e5-d1d57ef61ed7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:56.043174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0953c75c-67ef-4f32-92e5-d1d57ef61ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18bfa980fb549adb9969934aa7a0ee9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.060462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0953c75c-67ef-4f32-92e5-d1d57ef61ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18bfa980fb549adb9969934aa7a0ee9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.061296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0953c75c-67ef-4f32-92e5-d1d57ef61ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18bfa980fb549adb9969934aa7a0ee9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.062039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0953c75c-67ef-4f32-92e5-d1d57ef61ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18bfa980fb549adb9969934aa7a0ee9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.070834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0953c75c-67ef-4f32-92e5-d1d57ef61ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18bfa980fb549adb9969934aa7a0ee9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.113287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:56.147986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1072/2114] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:55 2022] DELETE /identity/v3/users/e18bfa980fb549adb9969934aa7a0ee9 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:56.653908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:56.656300 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:56.684498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985ee1c-f9cb-4b75-a70f-0e62ade56d02 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:56.773930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b594db-7a37-44c1-86e3-b2467fa79339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:56.781378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b594db-7a37-44c1-86e3-b2467fa79339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:56.781378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b594db-7a37-44c1-86e3-b2467fa79339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:56.781378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b594db-7a37-44c1-86e3-b2467fa79339 admin admin] PATH_INFO: `/v3/projects/364882828efb489885cc3c6c4152ccb5` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:56.781378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b594db-7a37-44c1-86e3-b2467fa79339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=364882828efb489885cc3c6c4152ccb5)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:56.782127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b594db-7a37-44c1-86e3-b2467fa79339 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:56.954948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f9b594db-7a37-44c1-86e3-b2467fa79339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364882828efb489885cc3c6c4152ccb5', 'request_id': 'req-f9b594db-7a37-44c1-86e3-b2467fa79339'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.969195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f9b594db-7a37-44c1-86e3-b2467fa79339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364882828efb489885cc3c6c4152ccb5', 'request_id': 'req-f9b594db-7a37-44c1-86e3-b2467fa79339'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.979626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f9b594db-7a37-44c1-86e3-b2467fa79339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364882828efb489885cc3c6c4152ccb5', 'request_id': 'req-f9b594db-7a37-44c1-86e3-b2467fa79339'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:57.095838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f9b594db-7a37-44c1-86e3-b2467fa79339 admin admin] The token cache is being invalidate because project 364882828efb489885cc3c6c4152ccb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:57.096134 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f9b594db-7a37-44c1-86e3-b2467fa79339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:57.096796 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f9b594db-7a37-44c1-86e3-b2467fa79339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:57.098509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1043/2115] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:56 2022] DELETE /identity/v3/projects/364882828efb489885cc3c6c4152ccb5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:57.104387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821413c-449a-4fa3-afd7-fc10644ac92d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:57.105132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821413c-449a-4fa3-afd7-fc10644ac92d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:57.105132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821413c-449a-4fa3-afd7-fc10644ac92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:57.132478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5821413c-449a-4fa3-afd7-fc10644ac92d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:57.133691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5821413c-449a-4fa3-afd7-fc10644ac92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:57.224085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1073/2116] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:57.233242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98aed-29f9-4f4e-9416-2217d2ea2042 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:57.233531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98aed-29f9-4f4e-9416-2217d2ea2042 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:57.233811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98aed-29f9-4f4e-9416-2217d2ea2042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:57.257508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-56b98aed-29f9-4f4e-9416-2217d2ea2042 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:57.259491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-56b98aed-29f9-4f4e-9416-2217d2ea2042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:57.268034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1044/2117] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:57.272761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821413c-449a-4fa3-afd7-fc10644ac92d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:57.285049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821413c-449a-4fa3-afd7-fc10644ac92d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:57.289974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae650727-be8b-4568-b53a-5fce1f0ecbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:57.290937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae650727-be8b-4568-b53a-5fce1f0ecbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:57.291213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae650727-be8b-4568-b53a-5fce1f0ecbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:57.291500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae650727-be8b-4568-b53a-5fce1f0ecbc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:57.292136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae650727-be8b-4568-b53a-5fce1f0ecbc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:57.292429 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae650727-be8b-4568-b53a-5fce1f0ecbc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:57.294147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae650727-be8b-4568-b53a-5fce1f0ecbc6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:57.306926 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1074/2118] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:57.312839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98aed-29f9-4f4e-9416-2217d2ea2042 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:57.323346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98aed-29f9-4f4e-9416-2217d2ea2042 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:57.329289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba78a6-426d-453a-9fab-de345d787b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:57.329914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba78a6-426d-453a-9fab-de345d787b62 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:57.330192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba78a6-426d-453a-9fab-de345d787b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:57.330496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba78a6-426d-453a-9fab-de345d787b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:57.331195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba78a6-426d-453a-9fab-de345d787b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:57.333079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba78a6-426d-453a-9fab-de345d787b62 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:57.337970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:57.475546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1045/2119] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:57 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:57.479095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae650727-be8b-4568-b53a-5fce1f0ecbc6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:57.496411 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae650727-be8b-4568-b53a-5fce1f0ecbc6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:57.566524 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4c079-1598-49c5-ac47-2dad47c4588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:57.567998 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4c079-1598-49c5-ac47-2dad47c4588b admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:57.567998 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4c079-1598-49c5-ac47-2dad47c4588b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:57.567998 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4c079-1598-49c5-ac47-2dad47c4588b admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:57.568555 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4c079-1598-49c5-ac47-2dad47c4588b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:57.570752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4c079-1598-49c5-ac47-2dad47c4588b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:57.669367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba78a6-426d-453a-9fab-de345d787b62 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:57.672699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-64ba78a6-426d-453a-9fab-de345d787b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:57.687433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba78a6-426d-453a-9fab-de345d787b62 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:57.694519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688fae5-96bd-4645-8d0d-7f3b863b01c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:57.695365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688fae5-96bd-4645-8d0d-7f3b863b01c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:57.695654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688fae5-96bd-4645-8d0d-7f3b863b01c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:57.695928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688fae5-96bd-4645-8d0d-7f3b863b01c4 admin admin] PATH_INFO: `/v3/users/71cbb78bdadd482dab0e3ecd0d508200` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:57.698407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688fae5-96bd-4645-8d0d-7f3b863b01c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71cbb78bdadd482dab0e3ecd0d508200)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:57.700854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688fae5-96bd-4645-8d0d-7f3b863b01c4 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:57.711565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1075/2120] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:57 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:57.713493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4c079-1598-49c5-ac47-2dad47c4588b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:57.724091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4c079-1598-49c5-ac47-2dad47c4588b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:57.729975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e80e95-3e50-4e51-b857-c78fad91d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:57.730697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e80e95-3e50-4e51-b857-c78fad91d89f admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:57.731262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e80e95-3e50-4e51-b857-c78fad91d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:57.731681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e80e95-3e50-4e51-b857-c78fad91d89f admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:57.733015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e80e95-3e50-4e51-b857-c78fad91d89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:57.736217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e80e95-3e50-4e51-b857-c78fad91d89f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:57.753215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1076/2121] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:57.761562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e80e95-3e50-4e51-b857-c78fad91d89f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:57.772215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e80e95-3e50-4e51-b857-c78fad91d89f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:57.778044 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f73d65-9446-483e-b171-d7e000cec51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:57.778709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f73d65-9446-483e-b171-d7e000cec51b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:57.778992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f73d65-9446-483e-b171-d7e000cec51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:57.779267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f73d65-9446-483e-b171-d7e000cec51b admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:57.779921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f73d65-9446-483e-b171-d7e000cec51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:57.781522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f73d65-9446-483e-b171-d7e000cec51b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:57.793194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1077/2122] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:57.797445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f73d65-9446-483e-b171-d7e000cec51b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:57.808268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f73d65-9446-483e-b171-d7e000cec51b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:57.813153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ebd75-2443-4eb3-8f9c-1864e0a5a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:57.813997 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ebd75-2443-4eb3-8f9c-1864e0a5a644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:57.820752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ebd75-2443-4eb3-8f9c-1864e0a5a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:57.820752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ebd75-2443-4eb3-8f9c-1864e0a5a644 admin admin] PATH_INFO: `/v3/projects/ecd5366aa83c4cb39ab096d9518552aa/users/c2c041e83c5d4c159efb8bbcb822eee8/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:57.831688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ebd75-2443-4eb3-8f9c-1864e0a5a644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd5366aa83c4cb39ab096d9518552aa, user_id=c2c041e83c5d4c159efb8bbcb822eee8, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:57.834725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ebd75-2443-4eb3-8f9c-1864e0a5a644 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:58.007043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1078/2123] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:57 2022] PUT /identity/v3/projects/ecd5366aa83c4cb39ab096d9518552aa/users/c2c041e83c5d4c159efb8bbcb822eee8/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:58.018416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed55abe-fff1-4bc2-b4e3-2f86870b6f70 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:58.018705 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed55abe-fff1-4bc2-b4e3-2f86870b6f70 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:58.018967 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed55abe-fff1-4bc2-b4e3-2f86870b6f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:58.041438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c688fae5-96bd-4645-8d0d-7f3b863b01c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71cbb78bdadd482dab0e3ecd0d508200'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:58.051904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-8ed55abe-fff1-4bc2-b4e3-2f86870b6f70 None None] MFA Rules not processed for user `c2c041e83c5d4c159efb8bbcb822eee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:58.052407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c688fae5-96bd-4645-8d0d-7f3b863b01c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71cbb78bdadd482dab0e3ecd0d508200'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:58.053329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8ed55abe-fff1-4bc2-b4e3-2f86870b6f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:58.053988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c688fae5-96bd-4645-8d0d-7f3b863b01c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71cbb78bdadd482dab0e3ecd0d508200'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:58.136308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:58.141936 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1079/2124] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:58.146591 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed55abe-fff1-4bc2-b4e3-2f86870b6f70 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:58.147980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8ed55abe-fff1-4bc2-b4e3-2f86870b6f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:58.198648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c688fae5-96bd-4645-8d0d-7f3b863b01c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71cbb78bdadd482dab0e3ecd0d508200'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:58.213510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c688fae5-96bd-4645-8d0d-7f3b863b01c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71cbb78bdadd482dab0e3ecd0d508200'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:58.220923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1046/2125] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:57 2022] DELETE /identity/v3/users/71cbb78bdadd482dab0e3ecd0d508200 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:58.227294 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e64d3-9b68-43fc-9c9b-9de28e04d02f None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:58.228566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e64d3-9b68-43fc-9c9b-9de28e04d02f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:58.229001 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e64d3-9b68-43fc-9c9b-9de28e04d02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:58.250702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e60e64d3-9b68-43fc-9c9b-9de28e04d02f None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:58.251040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed55abe-fff1-4bc2-b4e3-2f86870b6f70 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:58.252272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e60e64d3-9b68-43fc-9c9b-9de28e04d02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:58.329155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5b5e4-986b-4f2a-b789-28343fe9df86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:58.330154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5b5e4-986b-4f2a-b789-28343fe9df86 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:58.330431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5b5e4-986b-4f2a-b789-28343fe9df86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:58.331091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5b5e4-986b-4f2a-b789-28343fe9df86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:58.331941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5b5e4-986b-4f2a-b789-28343fe9df86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:58.334025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5b5e4-986b-4f2a-b789-28343fe9df86 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:58.341551 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1047/2126] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:58.359912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e64d3-9b68-43fc-9c9b-9de28e04d02f None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:58.361828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e60e64d3-9b68-43fc-9c9b-9de28e04d02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:58.453995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e64d3-9b68-43fc-9c9b-9de28e04d02f None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:58.459124 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68250972-ed7b-4226-aeb0-36ed82d10cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:58.460053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68250972-ed7b-4226-aeb0-36ed82d10cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:58.460340 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68250972-ed7b-4226-aeb0-36ed82d10cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:58.463926 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68250972-ed7b-4226-aeb0-36ed82d10cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:58.464051 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1080/2127] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:58 2022] POST /identity/v3/projects => generated 387 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:58.465039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5b5e4-986b-4f2a-b789-28343fe9df86 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:58.475788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68250972-ed7b-4226-aeb0-36ed82d10cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:58.485231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68250972-ed7b-4226-aeb0-36ed82d10cc5 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:58.513794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1048/2128] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:58.539675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5b5e4-986b-4f2a-b789-28343fe9df86 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:58.545404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8f363-774c-44c4-820f-5c504aadac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:58.546038 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8f363-774c-44c4-820f-5c504aadac8f admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:58.546383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8f363-774c-44c4-820f-5c504aadac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:58.546664 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8f363-774c-44c4-820f-5c504aadac8f admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:58.547313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8f363-774c-44c4-820f-5c504aadac8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:58.549394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8f363-774c-44c4-820f-5c504aadac8f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:58.708888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1081/2129] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:58 2022] POST /identity/v3/users => generated 300 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:58.712925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68250972-ed7b-4226-aeb0-36ed82d10cc5 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:58.723474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68250972-ed7b-4226-aeb0-36ed82d10cc5 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:58.729859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688ceb-e9a3-4eec-947a-61bcb67cbfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:58.731402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688ceb-e9a3-4eec-947a-61bcb67cbfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:58.731838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688ceb-e9a3-4eec-947a-61bcb67cbfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:58.732126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688ceb-e9a3-4eec-947a-61bcb67cbfe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:58.732788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688ceb-e9a3-4eec-947a-61bcb67cbfe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:58.734672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688ceb-e9a3-4eec-947a-61bcb67cbfe0 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:58.750673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1049/2130] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:58.752378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8f363-774c-44c4-820f-5c504aadac8f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:58.766920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8f363-774c-44c4-820f-5c504aadac8f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:58.772158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d069a4e-9ca7-49f7-bba9-0aae985a0d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:58.772832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d069a4e-9ca7-49f7-bba9-0aae985a0d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:58.773110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d069a4e-9ca7-49f7-bba9-0aae985a0d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:58.773391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d069a4e-9ca7-49f7-bba9-0aae985a0d00 admin admin] PATH_INFO: `/v3/projects/22ff345fdbca4fd9a15ac8351909c43f/users/1c97ac8b402a473e8d952c654935a101/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:58.791622 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d069a4e-9ca7-49f7-bba9-0aae985a0d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ff345fdbca4fd9a15ac8351909c43f, user_id=1c97ac8b402a473e8d952c654935a101, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:58.794359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d069a4e-9ca7-49f7-bba9-0aae985a0d00 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:58.897153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1082/2131] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:58 2022] PUT /identity/v3/projects/22ff345fdbca4fd9a15ac8351909c43f/users/1c97ac8b402a473e8d952c654935a101/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:58.902036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688ceb-e9a3-4eec-947a-61bcb67cbfe0 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:58.914727 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688ceb-e9a3-4eec-947a-61bcb67cbfe0 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:58.983286 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5db86-f263-4eb5-b789-03bb2044fd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:58.983907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5db86-f263-4eb5-b789-03bb2044fd0a admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:58.984182 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5db86-f263-4eb5-b789-03bb2044fd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:58.984454 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5db86-f263-4eb5-b789-03bb2044fd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:58.985103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5db86-f263-4eb5-b789-03bb2044fd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:58.987886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5db86-f263-4eb5-b789-03bb2044fd0a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:58.999754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1050/2132] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:59.004641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d069a4e-9ca7-49f7-bba9-0aae985a0d00 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:59.016164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d069a4e-9ca7-49f7-bba9-0aae985a0d00 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:59.021878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8d6b8-0f5c-4db5-96ac-7d304d026dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:59.022601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8d6b8-0f5c-4db5-96ac-7d304d026dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:59.022883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8d6b8-0f5c-4db5-96ac-7d304d026dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:59.023159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8d6b8-0f5c-4db5-96ac-7d304d026dc5 admin admin] PATH_INFO: `/v3/projects/22ff345fdbca4fd9a15ac8351909c43f/users/1c97ac8b402a473e8d952c654935a101/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:59.025342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8d6b8-0f5c-4db5-96ac-7d304d026dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ff345fdbca4fd9a15ac8351909c43f, user_id=1c97ac8b402a473e8d952c654935a101, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:59.028149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8d6b8-0f5c-4db5-96ac-7d304d026dc5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:59.039334 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1083/2133] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:59 2022] PUT /identity/v3/projects/22ff345fdbca4fd9a15ac8351909c43f/users/1c97ac8b402a473e8d952c654935a101/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:59.051041 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672baf9b-23c3-48ab-973b-c6c6f376a132 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:59.051340 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672baf9b-23c3-48ab-973b-c6c6f376a132 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:59.053767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672baf9b-23c3-48ab-973b-c6c6f376a132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:59.089979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-672baf9b-23c3-48ab-973b-c6c6f376a132 None None] MFA Rules not processed for user `1c97ac8b402a473e8d952c654935a101`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:59.091261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-672baf9b-23c3-48ab-973b-c6c6f376a132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:59.096337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8d6b8-0f5c-4db5-96ac-7d304d026dc5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:59.098441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-19e8d6b8-0f5c-4db5-96ac-7d304d026dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:59.189371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1051/2134] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:59.197978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8d6b8-0f5c-4db5-96ac-7d304d026dc5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:59.203341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672baf9b-23c3-48ab-973b-c6c6f376a132 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:59.204125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:59.204929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-672baf9b-23c3-48ab-973b-c6c6f376a132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:59.205040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:59.205249 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:59.205520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] PATH_INFO: `/v3/projects/cfdb8ef4ec664765a29d5b42a6b0b4f9` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:59.206847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfdb8ef4ec664765a29d5b42a6b0b4f9)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:59.208917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:59.279689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672baf9b-23c3-48ab-973b-c6c6f376a132 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:59.283457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5332b-6762-442d-94ba-8af23611eeac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:59.284097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5332b-6762-442d-94ba-8af23611eeac service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:59.288496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5332b-6762-442d-94ba-8af23611eeac service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:59.288496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5332b-6762-442d-94ba-8af23611eeac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:59.295980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5332b-6762-442d-94ba-8af23611eeac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:59.297641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5332b-6762-442d-94ba-8af23611eeac service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:59.307367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1052/2135] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:59.336074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5332b-6762-442d-94ba-8af23611eeac service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:59.353197 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5332b-6762-442d-94ba-8af23611eeac service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:59.358712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bec8b-0dbf-4e96-aed3-7b7cb0834899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:59.359359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bec8b-0dbf-4e96-aed3-7b7cb0834899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:59.359641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bec8b-0dbf-4e96-aed3-7b7cb0834899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:59.359919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bec8b-0dbf-4e96-aed3-7b7cb0834899 admin admin] PATH_INFO: `/v3/users/c2c041e83c5d4c159efb8bbcb822eee8` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:59.361185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bec8b-0dbf-4e96-aed3-7b7cb0834899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c041e83c5d4c159efb8bbcb822eee8)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:59.363126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bec8b-0dbf-4e96-aed3-7b7cb0834899 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:59.405647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfdb8ef4ec664765a29d5b42a6b0b4f9', 'request_id': 'req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.412851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfdb8ef4ec664765a29d5b42a6b0b4f9', 'request_id': 'req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.577336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfdb8ef4ec664765a29d5b42a6b0b4f9', 'request_id': 'req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.597369 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] The token cache is being invalidate because project cfdb8ef4ec664765a29d5b42a6b0b4f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:59.597811 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.598786 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.603490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1084/2136] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:59 2022] DELETE /identity/v3/projects/cfdb8ef4ec664765a29d5b42a6b0b4f9 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:59.605014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:59.606742 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:59.706038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-716bec8b-0dbf-4e96-aed3-7b7cb0834899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c041e83c5d4c159efb8bbcb822eee8'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.737201 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d18549-09dc-48c9-9fe8-31e11d1bd3d0 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:59.737404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-716bec8b-0dbf-4e96-aed3-7b7cb0834899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c041e83c5d4c159efb8bbcb822eee8'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.738388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-716bec8b-0dbf-4e96-aed3-7b7cb0834899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c041e83c5d4c159efb8bbcb822eee8'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.754999 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:59.755731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:59.756162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:59.756926 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] PATH_INFO: `/v3/users/5f242671a3294bb9998b1607ecd072af` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:59.760324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f242671a3294bb9998b1607ecd072af)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:59.763357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:59.888340 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-716bec8b-0dbf-4e96-aed3-7b7cb0834899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c041e83c5d4c159efb8bbcb822eee8'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.905469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-716bec8b-0dbf-4e96-aed3-7b7cb0834899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c041e83c5d4c159efb8bbcb822eee8'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.912979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1053/2137] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:59 2022] DELETE /identity/v3/users/c2c041e83c5d4c159efb8bbcb822eee8 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:59.919847 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a84e20-2d93-4827-b822-f98111c0080f None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:59.920204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a84e20-2d93-4827-b822-f98111c0080f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:59.920555 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a84e20-2d93-4827-b822-f98111c0080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:59.940845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d9a84e20-2d93-4827-b822-f98111c0080f None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:59.942162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d9a84e20-2d93-4827-b822-f98111c0080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:00.001725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f242671a3294bb9998b1607ecd072af'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:00.015390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f242671a3294bb9998b1607ecd072af'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:00.016085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f242671a3294bb9998b1607ecd072af'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:00.016769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f242671a3294bb9998b1607ecd072af'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:00.020317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1054/2138] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:33:00.025186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f242671a3294bb9998b1607ecd072af'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:00.036407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a84e20-2d93-4827-b822-f98111c0080f None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:00.036407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d9a84e20-2d93-4827-b822-f98111c0080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:00.111179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a84e20-2d93-4827-b822-f98111c0080f None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:00.116279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb2cc4-8948-4425-afb3-f69ba5e6faba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:00.116989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb2cc4-8948-4425-afb3-f69ba5e6faba service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:00.117215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb2cc4-8948-4425-afb3-f69ba5e6faba service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:00.117476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb2cc4-8948-4425-afb3-f69ba5e6faba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:00.122791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-dceb2cc4-8948-4425-afb3-f69ba5e6faba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:00.137404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb2cc4-8948-4425-afb3-f69ba5e6faba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:00.139192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb2cc4-8948-4425-afb3-f69ba5e6faba service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:00.150520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1055/2139] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:00.204609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1085/2140] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:59 2022] DELETE /identity/v3/users/5f242671a3294bb9998b1607ecd072af => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:00.551760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb2cc4-8948-4425-afb3-f69ba5e6faba service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:00.553247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-dceb2cc4-8948-4425-afb3-f69ba5e6faba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:00.566553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb2cc4-8948-4425-afb3-f69ba5e6faba service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:00.638181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:00.639280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:00.639948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:00.640526 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] PATH_INFO: `/v3/users/e87702bf4b7d412da8a7cfcd024ec8de` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:00.642520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87702bf4b7d412da8a7cfcd024ec8de)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:00.644992 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:00.697773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:00.858618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:00.861009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:00.887113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41156f-2a31-4002-8a35-92aeea6f7b3b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:00.910859 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f630d-321f-4774-9c1a-b582d181df7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:00.911664 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f630d-321f-4774-9c1a-b582d181df7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:00.911951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f630d-321f-4774-9c1a-b582d181df7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:00.912227 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f630d-321f-4774-9c1a-b582d181df7d admin admin] PATH_INFO: `/v3/projects/ecd5366aa83c4cb39ab096d9518552aa` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:00.913411 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f630d-321f-4774-9c1a-b582d181df7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd5366aa83c4cb39ab096d9518552aa)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:00.916324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f630d-321f-4774-9c1a-b582d181df7d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:00.971007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87702bf4b7d412da8a7cfcd024ec8de'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:00.978766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87702bf4b7d412da8a7cfcd024ec8de'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:00.982446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87702bf4b7d412da8a7cfcd024ec8de'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.080030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5e4f630d-321f-4774-9c1a-b582d181df7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd5366aa83c4cb39ab096d9518552aa', 'request_id': 'req-5e4f630d-321f-4774-9c1a-b582d181df7d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.086671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5e4f630d-321f-4774-9c1a-b582d181df7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd5366aa83c4cb39ab096d9518552aa', 'request_id': 'req-5e4f630d-321f-4774-9c1a-b582d181df7d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.243641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87702bf4b7d412da8a7cfcd024ec8de'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.258181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87702bf4b7d412da8a7cfcd024ec8de'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.267345 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1056/2141] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:00 2022] DELETE /identity/v3/users/e87702bf4b7d412da8a7cfcd024ec8de => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:01.268967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:01.270676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:01.347672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829c560-4d0b-4179-bdb4-d2c05ba478a2 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:01.360238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:01.360238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:01.360238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:01.360238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] PATH_INFO: `/v3/projects/1f8a66e260f641a9a770d196dcc4bc52` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:01.361846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8a66e260f641a9a770d196dcc4bc52)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:01.364045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:01.428802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5e4f630d-321f-4774-9c1a-b582d181df7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd5366aa83c4cb39ab096d9518552aa', 'request_id': 'req-5e4f630d-321f-4774-9c1a-b582d181df7d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.442194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5e4f630d-321f-4774-9c1a-b582d181df7d admin admin] The token cache is being invalidate because project ecd5366aa83c4cb39ab096d9518552aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:01.442600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5e4f630d-321f-4774-9c1a-b582d181df7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.443339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5e4f630d-321f-4774-9c1a-b582d181df7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.444822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1086/2142] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:00 2022] DELETE /identity/v3/projects/ecd5366aa83c4cb39ab096d9518552aa => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:01.446272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33237b2a-1442-402a-a03a-da7f1fac0235 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:01.446527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33237b2a-1442-402a-a03a-da7f1fac0235 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:01.446962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33237b2a-1442-402a-a03a-da7f1fac0235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:01.478510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-33237b2a-1442-402a-a03a-da7f1fac0235 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:01.478510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-33237b2a-1442-402a-a03a-da7f1fac0235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:01.486854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1087/2143] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:01.487700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33237b2a-1442-402a-a03a-da7f1fac0235 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:01.489068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-33237b2a-1442-402a-a03a-da7f1fac0235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:01.502651 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33237b2a-1442-402a-a03a-da7f1fac0235 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:01.509859 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:01.512435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:01.512435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:01.512435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] PATH_INFO: `/v3/users/1c97ac8b402a473e8d952c654935a101` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:01.512749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c97ac8b402a473e8d952c654935a101)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:01.514428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:01.524793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8a66e260f641a9a770d196dcc4bc52', 'request_id': 'req-94f35608-ba11-4e34-8199-c00ee3106e2a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.531476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8a66e260f641a9a770d196dcc4bc52', 'request_id': 'req-94f35608-ba11-4e34-8199-c00ee3106e2a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.537724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8a66e260f641a9a770d196dcc4bc52', 'request_id': 'req-94f35608-ba11-4e34-8199-c00ee3106e2a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.783514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] The token cache is being invalidate because project 1f8a66e260f641a9a770d196dcc4bc52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:01.784659 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.785367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.787979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1057/2144] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:01 2022] DELETE /identity/v3/projects/1f8a66e260f641a9a770d196dcc4bc52 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:01.789467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:01.792988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:01.883901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f35608-ba11-4e34-8199-c00ee3106e2a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:01.888063 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55db60d-08bd-4ccb-a130-b4bf3f3bc5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:01.888687 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55db60d-08bd-4ccb-a130-b4bf3f3bc5bc service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:01.888969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55db60d-08bd-4ccb-a130-b4bf3f3bc5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:01.889251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55db60d-08bd-4ccb-a130-b4bf3f3bc5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:01.891656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f55db60d-08bd-4ccb-a130-b4bf3f3bc5bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:01.959630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55db60d-08bd-4ccb-a130-b4bf3f3bc5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:01.961342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55db60d-08bd-4ccb-a130-b4bf3f3bc5bc service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:01.974105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1058/2145] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:01.974828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55db60d-08bd-4ccb-a130-b4bf3f3bc5bc service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:01.976242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f55db60d-08bd-4ccb-a130-b4bf3f3bc5bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:01.990634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55db60d-08bd-4ccb-a130-b4bf3f3bc5bc service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:01.996093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:01.996932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:01.997218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:01.997517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] PATH_INFO: `/v3/users/5a915d8edae548548c16b8b3681c74fb` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:01.998750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a915d8edae548548c16b8b3681c74fb)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:02.023861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:02.110154 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c97ac8b402a473e8d952c654935a101'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:02.124437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c97ac8b402a473e8d952c654935a101'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:02.125181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c97ac8b402a473e8d952c654935a101'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:02.125790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c97ac8b402a473e8d952c654935a101'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:02.132942 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c97ac8b402a473e8d952c654935a101'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:02.199098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:02.319599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1088/2146] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:01 2022] DELETE /identity/v3/users/1c97ac8b402a473e8d952c654935a101 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:02.382612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a915d8edae548548c16b8b3681c74fb'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:02.394803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a915d8edae548548c16b8b3681c74fb'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:02.395627 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a915d8edae548548c16b8b3681c74fb'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:02.581017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a915d8edae548548c16b8b3681c74fb'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:02.598587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a915d8edae548548c16b8b3681c74fb'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:02.605062 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1059/2147] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:01 2022] DELETE /identity/v3/users/5a915d8edae548548c16b8b3681c74fb => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:02.693542 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:02.698736 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:02.800550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647505c-e4bd-4e0d-b3a9-ea4654a1a16f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:02.870758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:02.874591 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:02.874780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:02.875048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] PATH_INFO: `/v3/projects/808e1d597f484f109cf155ab881cb73b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:02.877597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808e1d597f484f109cf155ab881cb73b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:02.878588 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:02.973329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:02.980127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:02.996624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4ef9a-de1c-477b-80fd-ab1a649ef664 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:03.003136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:03.003932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:03.004342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:03.004795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] PATH_INFO: `/v3/projects/22ff345fdbca4fd9a15ac8351909c43f` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:03.006567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ff345fdbca4fd9a15ac8351909c43f)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:03.011056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:03.075481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808e1d597f484f109cf155ab881cb73b', 'request_id': 'req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.082237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808e1d597f484f109cf155ab881cb73b', 'request_id': 'req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.146967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ff345fdbca4fd9a15ac8351909c43f', 'request_id': 'req-3167de62-b922-49f8-a82e-5014c0aadf8a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.155275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ff345fdbca4fd9a15ac8351909c43f', 'request_id': 'req-3167de62-b922-49f8-a82e-5014c0aadf8a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.158946 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808e1d597f484f109cf155ab881cb73b', 'request_id': 'req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.164429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ff345fdbca4fd9a15ac8351909c43f', 'request_id': 'req-3167de62-b922-49f8-a82e-5014c0aadf8a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.172985 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] The token cache is being invalidate because project 808e1d597f484f109cf155ab881cb73b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:03.174451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.175200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.178176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1089/2148] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:02 2022] DELETE /identity/v3/projects/808e1d597f484f109cf155ab881cb73b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:03.183331 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:03.184654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:03.252123 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7abba1-a2e2-4c40-82c6-d66ca302bad9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:03.296586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] The token cache is being invalidate because project 22ff345fdbca4fd9a15ac8351909c43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:03.297162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.298084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.301629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1060/2149] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:02 2022] DELETE /identity/v3/projects/22ff345fdbca4fd9a15ac8351909c43f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:03.302885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:03.310894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:03.321815 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf3af5-2594-4894-aa0e-f4ed3f059383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:03.322580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3af5-2594-4894-aa0e-f4ed3f059383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:03.322923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3af5-2594-4894-aa0e-f4ed3f059383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:03.323134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3af5-2594-4894-aa0e-f4ed3f059383 admin admin] PATH_INFO: `/v3/users/2eb8c874ee3e44ed81c4a275fd4bfa63` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:03.324403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf3af5-2594-4894-aa0e-f4ed3f059383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb8c874ee3e44ed81c4a275fd4bfa63)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:03.326933 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf3af5-2594-4894-aa0e-f4ed3f059383 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:03.405421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167de62-b922-49f8-a82e-5014c0aadf8a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:03.411279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd54dd-e946-4e06-83f4-d5646f30cca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:03.411968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd54dd-e946-4e06-83f4-d5646f30cca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:03.412271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd54dd-e946-4e06-83f4-d5646f30cca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:03.412709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd54dd-e946-4e06-83f4-d5646f30cca4 admin admin] PATH_INFO: `/v3/projects/b564b708bd9d463ea55a36999f5bd9ed` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:03.414162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd54dd-e946-4e06-83f4-d5646f30cca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b564b708bd9d463ea55a36999f5bd9ed)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:03.417028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd54dd-e946-4e06-83f4-d5646f30cca4 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:03.624601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f1bd54dd-e946-4e06-83f4-d5646f30cca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b564b708bd9d463ea55a36999f5bd9ed', 'request_id': 'req-f1bd54dd-e946-4e06-83f4-d5646f30cca4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.624866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cdbf3af5-2594-4894-aa0e-f4ed3f059383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb8c874ee3e44ed81c4a275fd4bfa63'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.631546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f1bd54dd-e946-4e06-83f4-d5646f30cca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b564b708bd9d463ea55a36999f5bd9ed', 'request_id': 'req-f1bd54dd-e946-4e06-83f4-d5646f30cca4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.638652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f1bd54dd-e946-4e06-83f4-d5646f30cca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b564b708bd9d463ea55a36999f5bd9ed', 'request_id': 'req-f1bd54dd-e946-4e06-83f4-d5646f30cca4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.639098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cdbf3af5-2594-4894-aa0e-f4ed3f059383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb8c874ee3e44ed81c4a275fd4bfa63'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.640232 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cdbf3af5-2594-4894-aa0e-f4ed3f059383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb8c874ee3e44ed81c4a275fd4bfa63'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.640946 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cdbf3af5-2594-4894-aa0e-f4ed3f059383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb8c874ee3e44ed81c4a275fd4bfa63'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.648953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cdbf3af5-2594-4894-aa0e-f4ed3f059383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb8c874ee3e44ed81c4a275fd4bfa63'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.760230 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f1bd54dd-e946-4e06-83f4-d5646f30cca4 admin admin] The token cache is being invalidate because project b564b708bd9d463ea55a36999f5bd9ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:03.760622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f1bd54dd-e946-4e06-83f4-d5646f30cca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.761359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f1bd54dd-e946-4e06-83f4-d5646f30cca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.762983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1061/2150] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:03 2022] DELETE /identity/v3/projects/b564b708bd9d463ea55a36999f5bd9ed => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:03.768419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4a3de-bcc0-4621-a895-7f70bc37e4d7 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:03.768419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4a3de-bcc0-4621-a895-7f70bc37e4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:03.768419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4a3de-bcc0-4621-a895-7f70bc37e4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:03.786149 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-faf4a3de-bcc0-4621-a895-7f70bc37e4d7 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:03.787419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-faf4a3de-bcc0-4621-a895-7f70bc37e4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:03.838908 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1090/2151] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:03 2022] DELETE /identity/v3/users/2eb8c874ee3e44ed81c4a275fd4bfa63 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:03.842069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f715a0b-4bc8-4866-9c4b-c5365694b721 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:03.843505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f715a0b-4bc8-4866-9c4b-c5365694b721 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:03.843947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f715a0b-4bc8-4866-9c4b-c5365694b721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:03.872080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1062/2152] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:03.876446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5f715a0b-4bc8-4866-9c4b-c5365694b721 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:03.876446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5f715a0b-4bc8-4866-9c4b-c5365694b721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:03.876704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432e9dd-e1fc-409b-bdda-be801abeaf9d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:03.876704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432e9dd-e1fc-409b-bdda-be801abeaf9d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:03.876704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432e9dd-e1fc-409b-bdda-be801abeaf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:03.905071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d432e9dd-e1fc-409b-bdda-be801abeaf9d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:03.906428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d432e9dd-e1fc-409b-bdda-be801abeaf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:03.981985 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1091/2153] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:04.000666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132d9f0-751e-4d6a-a692-ce871eef7c18 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.000666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132d9f0-751e-4d6a-a692-ce871eef7c18 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.000666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132d9f0-751e-4d6a-a692-ce871eef7c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.006874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1063/2154] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:04.014407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432e9dd-e1fc-409b-bdda-be801abeaf9d None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.023066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e132d9f0-751e-4d6a-a692-ce871eef7c18 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:04.025049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432e9dd-e1fc-409b-bdda-be801abeaf9d None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.027782 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e132d9f0-751e-4d6a-a692-ce871eef7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:04.030824 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09155591-93f5-42ea-b97c-e2796eab119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.031726 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09155591-93f5-42ea-b97c-e2796eab119b admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.032010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09155591-93f5-42ea-b97c-e2796eab119b admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.032279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09155591-93f5-42ea-b97c-e2796eab119b admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.034072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09155591-93f5-42ea-b97c-e2796eab119b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:04.034072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09155591-93f5-42ea-b97c-e2796eab119b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.035065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09155591-93f5-42ea-b97c-e2796eab119b admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.040733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1092/2155] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:04.047452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132d9f0-751e-4d6a-a692-ce871eef7c18 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.058551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132d9f0-751e-4d6a-a692-ce871eef7c18 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.064329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1d75a-2e55-49bc-b980-2bc03aeed0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.064955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1d75a-2e55-49bc-b980-2bc03aeed0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.065238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1d75a-2e55-49bc-b980-2bc03aeed0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.065506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1d75a-2e55-49bc-b980-2bc03aeed0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.066163 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1d75a-2e55-49bc-b980-2bc03aeed0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:04.066500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1d75a-2e55-49bc-b980-2bc03aeed0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.068772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1d75a-2e55-49bc-b980-2bc03aeed0b4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.070141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1064/2156] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:33:04.082921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09155591-93f5-42ea-b97c-e2796eab119b admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.084126 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1093/2157] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:33:04.090436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1d75a-2e55-49bc-b980-2bc03aeed0b4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.104468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1d75a-2e55-49bc-b980-2bc03aeed0b4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.112051 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a719ec-a5e2-454f-868e-12fbf5adff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.120193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a719ec-a5e2-454f-868e-12fbf5adff1a admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.120193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a719ec-a5e2-454f-868e-12fbf5adff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.120193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a719ec-a5e2-454f-868e-12fbf5adff1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.120193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a719ec-a5e2-454f-868e-12fbf5adff1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.120193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a719ec-a5e2-454f-868e-12fbf5adff1a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.127122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09155591-93f5-42ea-b97c-e2796eab119b admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.133005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0305316-4ead-4eae-a45b-3966cd6366f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.134665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0305316-4ead-4eae-a45b-3966cd6366f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.134958 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0305316-4ead-4eae-a45b-3966cd6366f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.135506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0305316-4ead-4eae-a45b-3966cd6366f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.136141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0305316-4ead-4eae-a45b-3966cd6366f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.138176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0305316-4ead-4eae-a45b-3966cd6366f6 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.228193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:04.267830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1065/2158] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:04 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:04.268058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1094/2159] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:04 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:33:04.270365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a719ec-a5e2-454f-868e-12fbf5adff1a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.270520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0305316-4ead-4eae-a45b-3966cd6366f6 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.335657 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a719ec-a5e2-454f-868e-12fbf5adff1a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.339448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0305316-4ead-4eae-a45b-3966cd6366f6 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.341125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8be074-0660-470a-91bc-ffeb57b1b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.341734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8be074-0660-470a-91bc-ffeb57b1b65a admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.342037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8be074-0660-470a-91bc-ffeb57b1b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.342345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8be074-0660-470a-91bc-ffeb57b1b65a admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.342985 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8be074-0660-470a-91bc-ffeb57b1b65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.344475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4f05d-48f4-477e-abd9-c09c4fa3b546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.345084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4f05d-48f4-477e-abd9-c09c4fa3b546 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.345455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8be074-0660-470a-91bc-ffeb57b1b65a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.345575 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4f05d-48f4-477e-abd9-c09c4fa3b546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.345661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4f05d-48f4-477e-abd9-c09c4fa3b546 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.346353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4f05d-48f4-477e-abd9-c09c4fa3b546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.348388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4f05d-48f4-477e-abd9-c09c4fa3b546 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.514656 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1095/2160] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:04 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:04.515823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8be074-0660-470a-91bc-ffeb57b1b65a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.518567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dc8be074-0660-470a-91bc-ffeb57b1b65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:04.530968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8be074-0660-470a-91bc-ffeb57b1b65a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.539697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1066/2161] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:04 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:33:04.539877 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.540003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4f05d-48f4-477e-abd9-c09c4fa3b546 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.540179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.540179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.540179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] PATH_INFO: `/v3/projects/1c266bc437c04a2eb05a37f1828d9ade` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.541275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c266bc437c04a2eb05a37f1828d9ade)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.543301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.550734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4f05d-48f4-477e-abd9-c09c4fa3b546 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.559443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547a108-8713-4c25-9a81-e48036d9e647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.560904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547a108-8713-4c25-9a81-e48036d9e647 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.560904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547a108-8713-4c25-9a81-e48036d9e647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.560904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547a108-8713-4c25-9a81-e48036d9e647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.561643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547a108-8713-4c25-9a81-e48036d9e647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.563369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547a108-8713-4c25-9a81-e48036d9e647 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.577806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1067/2162] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:04.577806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547a108-8713-4c25-9a81-e48036d9e647 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.588111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547a108-8713-4c25-9a81-e48036d9e647 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.594195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64f2af-2694-4198-8513-3afe8264f0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.594861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64f2af-2694-4198-8513-3afe8264f0af admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.595141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64f2af-2694-4198-8513-3afe8264f0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.596108 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64f2af-2694-4198-8513-3afe8264f0af admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.596108 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64f2af-2694-4198-8513-3afe8264f0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.597795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64f2af-2694-4198-8513-3afe8264f0af admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.611011 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1068/2163] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:04.612208 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64f2af-2694-4198-8513-3afe8264f0af admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.627631 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64f2af-2694-4198-8513-3afe8264f0af admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.635387 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4f4de-1147-49d5-9a1c-1c073fd43b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.636423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4f4de-1147-49d5-9a1c-1c073fd43b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.637190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4f4de-1147-49d5-9a1c-1c073fd43b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.637828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4f4de-1147-49d5-9a1c-1c073fd43b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.642874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4f4de-1147-49d5-9a1c-1c073fd43b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.644656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4f4de-1147-49d5-9a1c-1c073fd43b1b admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.661530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1069/2164] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:04.663116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4f4de-1147-49d5-9a1c-1c073fd43b1b admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.682430 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4f4de-1147-49d5-9a1c-1c073fd43b1b admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.690703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c266bc437c04a2eb05a37f1828d9ade', 'request_id': 'req-6e8ed748-29de-40df-b934-2eaa92e98a63'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:04.702793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c266bc437c04a2eb05a37f1828d9ade', 'request_id': 'req-6e8ed748-29de-40df-b934-2eaa92e98a63'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:04.781975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11d357-8a09-4878-9f3a-08591f862bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.783645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11d357-8a09-4878-9f3a-08591f862bef admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.783904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11d357-8a09-4878-9f3a-08591f862bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.784344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11d357-8a09-4878-9f3a-08591f862bef admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.785590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11d357-8a09-4878-9f3a-08591f862bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.788716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11d357-8a09-4878-9f3a-08591f862bef admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.808883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c266bc437c04a2eb05a37f1828d9ade', 'request_id': 'req-6e8ed748-29de-40df-b934-2eaa92e98a63'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:04.813280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1070/2165] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:04.813280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11d357-8a09-4878-9f3a-08591f862bef admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.821288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] The token cache is being invalidate because project 1c266bc437c04a2eb05a37f1828d9ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:04.821786 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:04.822602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:04.828715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1096/2166] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:04 2022] DELETE /identity/v3/projects/1c266bc437c04a2eb05a37f1828d9ade => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:04.828715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.829995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:04.830669 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11d357-8a09-4878-9f3a-08591f862bef admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.841184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad9d62-4872-415d-a3d7-36740f5c785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.842411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9d62-4872-415d-a3d7-36740f5c785a admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.846812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9d62-4872-415d-a3d7-36740f5c785a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.846812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9d62-4872-415d-a3d7-36740f5c785a admin admin] PATH_INFO: `/v3/projects/86a9164c63714396a9789300f372ac1c/users/5078e970ba1b4f339c5be54276edb92f/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.848534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ed748-29de-40df-b934-2eaa92e98a63 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.855946 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6621f-b761-4fbb-8a1d-04c197946c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.856632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6621f-b761-4fbb-8a1d-04c197946c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.856925 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6621f-b761-4fbb-8a1d-04c197946c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.857194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6621f-b761-4fbb-8a1d-04c197946c63 admin admin] PATH_INFO: `/v3/projects/c33c527ad5514026ae8eefc592f6a073/users/66ebc439e2124dea86eae89116836bf4/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.865601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad9d62-4872-415d-a3d7-36740f5c785a admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a9164c63714396a9789300f372ac1c, user_id=5078e970ba1b4f339c5be54276edb92f, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.869069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad9d62-4872-415d-a3d7-36740f5c785a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.894718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6621f-b761-4fbb-8a1d-04c197946c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33c527ad5514026ae8eefc592f6a073, user_id=66ebc439e2124dea86eae89116836bf4, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.900410 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6621f-b761-4fbb-8a1d-04c197946c63 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.903240 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:04.988625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1071/2167] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:04 2022] PUT /identity/v3/projects/86a9164c63714396a9789300f372ac1c/users/5078e970ba1b4f339c5be54276edb92f/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:04.992509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28b3ed-0cd0-45c5-9ba2-19adcd384adc None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.992509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28b3ed-0cd0-45c5-9ba2-19adcd384adc None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.992509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28b3ed-0cd0-45c5-9ba2-19adcd384adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.011467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ee28b3ed-0cd0-45c5-9ba2-19adcd384adc None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:05.012823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ee28b3ed-0cd0-45c5-9ba2-19adcd384adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:05.037197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1097/2168] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:04 2022] PUT /identity/v3/projects/c33c527ad5514026ae8eefc592f6a073/users/66ebc439e2124dea86eae89116836bf4/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:05.039402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893124e8-16c3-499e-90c6-863c82f9d0cd None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.062257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893124e8-16c3-499e-90c6-863c82f9d0cd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.062624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893124e8-16c3-499e-90c6-863c82f9d0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.102053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-893124e8-16c3-499e-90c6-863c82f9d0cd None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:05.104458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-893124e8-16c3-499e-90c6-863c82f9d0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:05.116302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1072/2169] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:05.118536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339da50d-6e89-490f-8398-a51ab05e602b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.119163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339da50d-6e89-490f-8398-a51ab05e602b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.119457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339da50d-6e89-490f-8398-a51ab05e602b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.160082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-339da50d-6e89-490f-8398-a51ab05e602b None None] MFA Rules not processed for user `66ebc439e2124dea86eae89116836bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:05.161413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-339da50d-6e89-490f-8398-a51ab05e602b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:05.194708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1098/2170] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:05.197067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9aaa7-e928-413b-b44c-81dd2d93bc07 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.197604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9aaa7-e928-413b-b44c-81dd2d93bc07 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.197955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9aaa7-e928-413b-b44c-81dd2d93bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.224930 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a3f9aaa7-e928-413b-b44c-81dd2d93bc07 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:05.224930 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a3f9aaa7-e928-413b-b44c-81dd2d93bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:05.233064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1099/2171] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:05.233668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9aaa7-e928-413b-b44c-81dd2d93bc07 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:05.236811 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a3f9aaa7-e928-413b-b44c-81dd2d93bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:05.259284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1073/2172] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:05.259284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339da50d-6e89-490f-8398-a51ab05e602b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:05.273710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339da50d-6e89-490f-8398-a51ab05e602b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:05.299008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b6a98-acdc-433a-8da9-23265524eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:05.299748 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b6a98-acdc-433a-8da9-23265524eb60 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.300113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b6a98-acdc-433a-8da9-23265524eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.300393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b6a98-acdc-433a-8da9-23265524eb60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.301078 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b6a98-acdc-433a-8da9-23265524eb60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:05.301368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b6a98-acdc-433a-8da9-23265524eb60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:05.303536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b6a98-acdc-433a-8da9-23265524eb60 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:05.322368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1074/2173] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:33:05.323997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b6a98-acdc-433a-8da9-23265524eb60 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:05.327125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9aaa7-e928-413b-b44c-81dd2d93bc07 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:05.333363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322673eb-1eab-4e11-9701-96c698a6e77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:05.334746 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322673eb-1eab-4e11-9701-96c698a6e77d service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.335020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b6a98-acdc-433a-8da9-23265524eb60 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:05.335481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322673eb-1eab-4e11-9701-96c698a6e77d service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.335928 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322673eb-1eab-4e11-9701-96c698a6e77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.341758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bfe3f-f19f-4853-965b-04ca097acb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:05.342848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bfe3f-f19f-4853-965b-04ca097acb3c admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.343117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bfe3f-f19f-4853-965b-04ca097acb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.343524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bfe3f-f19f-4853-965b-04ca097acb3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.344511 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bfe3f-f19f-4853-965b-04ca097acb3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:05.352966 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bfe3f-f19f-4853-965b-04ca097acb3c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:05.354103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322673eb-1eab-4e11-9701-96c698a6e77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:05.370370 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322673eb-1eab-4e11-9701-96c698a6e77d service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:05.373430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1100/2174] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:05.374762 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322673eb-1eab-4e11-9701-96c698a6e77d service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:05.389405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322673eb-1eab-4e11-9701-96c698a6e77d service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:05.396056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad73bf2-869b-4ebe-a494-87f75bf94e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:05.396750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad73bf2-869b-4ebe-a494-87f75bf94e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.397031 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad73bf2-869b-4ebe-a494-87f75bf94e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.397682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad73bf2-869b-4ebe-a494-87f75bf94e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.397996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad73bf2-869b-4ebe-a494-87f75bf94e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:05.400904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad73bf2-869b-4ebe-a494-87f75bf94e9f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:05.483749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1075/2175] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:05 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:05.486786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bfe3f-f19f-4853-965b-04ca097acb3c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:05.546874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1101/2176] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:05 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:05.550758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad73bf2-869b-4ebe-a494-87f75bf94e9f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:05.552489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bfe3f-f19f-4853-965b-04ca097acb3c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:05.622513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad73bf2-869b-4ebe-a494-87f75bf94e9f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:05.627643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7d9ba-d629-4ce3-800d-f28a5374cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:05.628264 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7d9ba-d629-4ce3-800d-f28a5374cf53 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.630839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7d9ba-d629-4ce3-800d-f28a5374cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.630839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7d9ba-d629-4ce3-800d-f28a5374cf53 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.630839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7d9ba-d629-4ce3-800d-f28a5374cf53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:05.631655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7d9ba-d629-4ce3-800d-f28a5374cf53 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:05.642439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eccd8-3d55-4e84-b501-838ae6b4741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:05.643162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eccd8-3d55-4e84-b501-838ae6b4741a admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.643504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eccd8-3d55-4e84-b501-838ae6b4741a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.643863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eccd8-3d55-4e84-b501-838ae6b4741a admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.644574 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eccd8-3d55-4e84-b501-838ae6b4741a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:05.646880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eccd8-3d55-4e84-b501-838ae6b4741a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:05.749887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1102/2177] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:05 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:05.751665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7d9ba-d629-4ce3-800d-f28a5374cf53 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:05.763526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7d9ba-d629-4ce3-800d-f28a5374cf53 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:05.768512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87522ab8-77e8-4188-bcc1-4b010f43413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:05.769267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87522ab8-77e8-4188-bcc1-4b010f43413b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.769587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87522ab8-77e8-4188-bcc1-4b010f43413b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.769938 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87522ab8-77e8-4188-bcc1-4b010f43413b admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.770368 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87522ab8-77e8-4188-bcc1-4b010f43413b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:05.772003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87522ab8-77e8-4188-bcc1-4b010f43413b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:05.788158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1103/2178] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:05.793213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87522ab8-77e8-4188-bcc1-4b010f43413b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:05.795395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1076/2179] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:05 2022] POST /identity/v3/users => generated 295 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:33:05.799024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eccd8-3d55-4e84-b501-838ae6b4741a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:05.811851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87522ab8-77e8-4188-bcc1-4b010f43413b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:05.814704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eccd8-3d55-4e84-b501-838ae6b4741a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:05.817432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6db229-19de-4246-8639-b3bc5af63319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:05.818428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6db229-19de-4246-8639-b3bc5af63319 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.822923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6db229-19de-4246-8639-b3bc5af63319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.822923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6db229-19de-4246-8639-b3bc5af63319 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.822923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6db229-19de-4246-8639-b3bc5af63319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:05.823235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400c40-bdd2-45a1-b3ea-1870ccc13ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:05.823235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400c40-bdd2-45a1-b3ea-1870ccc13ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.823235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400c40-bdd2-45a1-b3ea-1870ccc13ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.823513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6db229-19de-4246-8639-b3bc5af63319 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:05.823605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400c40-bdd2-45a1-b3ea-1870ccc13ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.823605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45400c40-bdd2-45a1-b3ea-1870ccc13ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:05.825093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45400c40-bdd2-45a1-b3ea-1870ccc13ea1 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:05.839886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1104/2180] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:05.840109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1077/2181] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:05.842373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6db229-19de-4246-8639-b3bc5af63319 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:05.843616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400c40-bdd2-45a1-b3ea-1870ccc13ea1 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:05.855875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400c40-bdd2-45a1-b3ea-1870ccc13ea1 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:05.857019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6db229-19de-4246-8639-b3bc5af63319 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:05.862411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37fb16-3691-423e-a891-17eda98eadbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:05.863358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902025dc-f1ac-497f-b932-038734fff146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:05.863586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37fb16-3691-423e-a891-17eda98eadbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.864119 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37fb16-3691-423e-a891-17eda98eadbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.864408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37fb16-3691-423e-a891-17eda98eadbe admin admin] PATH_INFO: `/v3/projects/f32e9b38bbe14d26839e6dc7de362fb6/users/852819a24cba48849d4537a4c9e863db/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.864516 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902025dc-f1ac-497f-b932-038734fff146 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:05.864875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902025dc-f1ac-497f-b932-038734fff146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:05.865665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902025dc-f1ac-497f-b932-038734fff146 admin admin] PATH_INFO: `/v3/projects/1c24e1c663f94aa0a4475bb5a1d1b48f/users/7527a7135b7b4721a028309d5bedfe9d/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:05.887340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902025dc-f1ac-497f-b932-038734fff146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c24e1c663f94aa0a4475bb5a1d1b48f, user_id=7527a7135b7b4721a028309d5bedfe9d, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:05.890103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902025dc-f1ac-497f-b932-038734fff146 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:05.899721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37fb16-3691-423e-a891-17eda98eadbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32e9b38bbe14d26839e6dc7de362fb6, user_id=852819a24cba48849d4537a4c9e863db, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:05.902651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37fb16-3691-423e-a891-17eda98eadbe admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:06.045397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1078/2183] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:05 2022] PUT /identity/v3/projects/f32e9b38bbe14d26839e6dc7de362fb6/users/852819a24cba48849d4537a4c9e863db/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:06.045397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37fb16-3691-423e-a891-17eda98eadbe admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:06.046446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1105/2183] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:05 2022] PUT /identity/v3/projects/1c24e1c663f94aa0a4475bb5a1d1b48f/users/7527a7135b7b4721a028309d5bedfe9d/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:06.048256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbf2b9-4ff3-45a9-8edd-49a8dfb21cac None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:06.048913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbf2b9-4ff3-45a9-8edd-49a8dfb21cac None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:06.049339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbf2b9-4ff3-45a9-8edd-49a8dfb21cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:06.084307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-89fbf2b9-4ff3-45a9-8edd-49a8dfb21cac None None] MFA Rules not processed for user `7527a7135b7b4721a028309d5bedfe9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:06.088525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-89fbf2b9-4ff3-45a9-8edd-49a8dfb21cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:06.147979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37fb16-3691-423e-a891-17eda98eadbe admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:06.187084 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1106/2184] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:06.191746 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbf2b9-4ff3-45a9-8edd-49a8dfb21cac None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:06.241584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e4f88-7e00-4225-bc06-dcd251e4f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:06.242206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e4f88-7e00-4225-bc06-dcd251e4f5fb admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:06.242533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e4f88-7e00-4225-bc06-dcd251e4f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:06.242802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e4f88-7e00-4225-bc06-dcd251e4f5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:06.244095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e4f88-7e00-4225-bc06-dcd251e4f5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:06.245745 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e4f88-7e00-4225-bc06-dcd251e4f5fb admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:06.259603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1079/2185] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:06.264698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e4f88-7e00-4225-bc06-dcd251e4f5fb admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:06.277457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e4f88-7e00-4225-bc06-dcd251e4f5fb admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:06.285646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbf2b9-4ff3-45a9-8edd-49a8dfb21cac None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:06.285823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8ac85-d94d-4b47-8d68-b465cced0388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:06.285823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8ac85-d94d-4b47-8d68-b465cced0388 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:06.285823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8ac85-d94d-4b47-8d68-b465cced0388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:06.285823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8ac85-d94d-4b47-8d68-b465cced0388 admin admin] PATH_INFO: `/v3/projects/f32e9b38bbe14d26839e6dc7de362fb6/users/852819a24cba48849d4537a4c9e863db/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:06.286304 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0f79c-5bac-4fa5-8b1c-e0e5858b4e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:06.286955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0f79c-5bac-4fa5-8b1c-e0e5858b4e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:06.287234 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0f79c-5bac-4fa5-8b1c-e0e5858b4e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:06.287344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8ac85-d94d-4b47-8d68-b465cced0388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32e9b38bbe14d26839e6dc7de362fb6, user_id=852819a24cba48849d4537a4c9e863db, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:06.287503 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0f79c-5bac-4fa5-8b1c-e0e5858b4e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:06.288146 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0f79c-5bac-4fa5-8b1c-e0e5858b4e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:06.290034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8ac85-d94d-4b47-8d68-b465cced0388 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:06.290342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0f79c-5bac-4fa5-8b1c-e0e5858b4e0d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:06.303431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1080/2186] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:06 2022] PUT /identity/v3/projects/f32e9b38bbe14d26839e6dc7de362fb6/users/852819a24cba48849d4537a4c9e863db/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:06.315650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f63b0-9e2a-4f20-8d1c-5d195131025b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:06.315932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f63b0-9e2a-4f20-8d1c-5d195131025b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:06.316254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f63b0-9e2a-4f20-8d1c-5d195131025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:06.347909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d36f63b0-9e2a-4f20-8d1c-5d195131025b None None] MFA Rules not processed for user `852819a24cba48849d4537a4c9e863db`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:06.349156 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d36f63b0-9e2a-4f20-8d1c-5d195131025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:06.433720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1081/2187] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:33:06.448040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f63b0-9e2a-4f20-8d1c-5d195131025b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:06.450047 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d36f63b0-9e2a-4f20-8d1c-5d195131025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:06.486797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1107/2188] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:06 2022] POST /identity/v3/projects => generated 375 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:33:06.492012 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0f79c-5bac-4fa5-8b1c-e0e5858b4e0d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:06.539388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f63b0-9e2a-4f20-8d1c-5d195131025b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:06.589363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0f79c-5bac-4fa5-8b1c-e0e5858b4e0d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:06.598241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087ce55-4d2c-4963-8dee-054957e9318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:06.598875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ce55-4d2c-4963-8dee-054957e9318f admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:06.599152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ce55-4d2c-4963-8dee-054957e9318f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:06.599432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ce55-4d2c-4963-8dee-054957e9318f admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:06.600085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087ce55-4d2c-4963-8dee-054957e9318f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:06.602054 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087ce55-4d2c-4963-8dee-054957e9318f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:06.621074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219979-d893-4181-b691-978b82be2c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:06.621697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219979-d893-4181-b691-978b82be2c73 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:06.621975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219979-d893-4181-b691-978b82be2c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:06.622275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219979-d893-4181-b691-978b82be2c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:06.697037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61219979-d893-4181-b691-978b82be2c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:06.697037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61219979-d893-4181-b691-978b82be2c73 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:06.704677 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1082/2189] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:33:06.724997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:06.739818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1108/2190] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:06 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:33:06.741447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219979-d893-4181-b691-978b82be2c73 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:06.756451 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219979-d893-4181-b691-978b82be2c73 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:06.762022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc093de3-a34e-4976-b10d-06b70e30b914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:06.762696 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc093de3-a34e-4976-b10d-06b70e30b914 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:06.762977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc093de3-a34e-4976-b10d-06b70e30b914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:06.763252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc093de3-a34e-4976-b10d-06b70e30b914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:06.763908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc093de3-a34e-4976-b10d-06b70e30b914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:06.765535 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc093de3-a34e-4976-b10d-06b70e30b914 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:06.776455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1083/2191] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:33:06.780907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087ce55-4d2c-4963-8dee-054957e9318f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:06.794681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087ce55-4d2c-4963-8dee-054957e9318f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:06.797214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bb633-93df-43fd-9d96-94093d63fabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:06.797880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bb633-93df-43fd-9d96-94093d63fabd admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:06.798162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bb633-93df-43fd-9d96-94093d63fabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:06.798470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bb633-93df-43fd-9d96-94093d63fabd admin admin] PATH_INFO: `/v3/projects/be610ea7f4524b89b8c4b8db2b09a44c/users/e26be87215a64064afe0b2a3a4910e2e/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:06.818542 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bb633-93df-43fd-9d96-94093d63fabd admin admin] RBAC: Authorizing `identity:create_grant(project_id=be610ea7f4524b89b8c4b8db2b09a44c, user_id=e26be87215a64064afe0b2a3a4910e2e, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:06.822584 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bb633-93df-43fd-9d96-94093d63fabd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:06.864504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:07.000786 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1109/2192] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:06 2022] PUT /identity/v3/projects/be610ea7f4524b89b8c4b8db2b09a44c/users/e26be87215a64064afe0b2a3a4910e2e/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:07.004927 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc093de3-a34e-4976-b10d-06b70e30b914 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:07.017048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc093de3-a34e-4976-b10d-06b70e30b914 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:07.085373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9b2f2-7209-4a86-a279-6187d9f781d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:07.086037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b2f2-7209-4a86-a279-6187d9f781d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:07.086172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b2f2-7209-4a86-a279-6187d9f781d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:07.086483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b2f2-7209-4a86-a279-6187d9f781d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:07.087992 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9b2f2-7209-4a86-a279-6187d9f781d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:07.089576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9b2f2-7209-4a86-a279-6187d9f781d9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:07.100086 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1084/2193] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:07.104616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bb633-93df-43fd-9d96-94093d63fabd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:07.120981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bb633-93df-43fd-9d96-94093d63fabd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:07.127767 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaf0a0-d756-40c6-b527-2df9e4cd497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:07.128758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaf0a0-d756-40c6-b527-2df9e4cd497c admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:07.129168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaf0a0-d756-40c6-b527-2df9e4cd497c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:07.129566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaf0a0-d756-40c6-b527-2df9e4cd497c admin admin] PATH_INFO: `/v3/projects/be610ea7f4524b89b8c4b8db2b09a44c/users/e26be87215a64064afe0b2a3a4910e2e/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:07.132435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaf0a0-d756-40c6-b527-2df9e4cd497c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be610ea7f4524b89b8c4b8db2b09a44c, user_id=e26be87215a64064afe0b2a3a4910e2e, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:07.137657 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaf0a0-d756-40c6-b527-2df9e4cd497c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:07.149188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1110/2194] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:07 2022] PUT /identity/v3/projects/be610ea7f4524b89b8c4b8db2b09a44c/users/e26be87215a64064afe0b2a3a4910e2e/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:07.165028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8401f-7384-4864-9488-3f799aa71c2b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:07.173038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8401f-7384-4864-9488-3f799aa71c2b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:07.173038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8401f-7384-4864-9488-3f799aa71c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:07.198236 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-45b8401f-7384-4864-9488-3f799aa71c2b None None] MFA Rules not processed for user `e26be87215a64064afe0b2a3a4910e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:07.199485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-45b8401f-7384-4864-9488-3f799aa71c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:07.316623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1085/2195] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:07.372469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f8727-ae81-45bc-a7d7-020eee016d25 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:07.372843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f8727-ae81-45bc-a7d7-020eee016d25 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:07.373824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f8727-ae81-45bc-a7d7-020eee016d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:07.412310 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8401f-7384-4864-9488-3f799aa71c2b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:07.413977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-45b8401f-7384-4864-9488-3f799aa71c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:07.459937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f36f8727-ae81-45bc-a7d7-020eee016d25 None None] MFA Rules not processed for user `5078e970ba1b4f339c5be54276edb92f`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:07.461472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f36f8727-ae81-45bc-a7d7-020eee016d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:07.553320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8401f-7384-4864-9488-3f799aa71c2b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:07.560004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0ec95-7bc0-4d52-a931-547c9eca1807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:07.561770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0ec95-7bc0-4d52-a931-547c9eca1807 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:07.563078 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0ec95-7bc0-4d52-a931-547c9eca1807 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:07.563483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0ec95-7bc0-4d52-a931-547c9eca1807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:07.576485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1111/2196] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:07.648625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0ec95-7bc0-4d52-a931-547c9eca1807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:07.650606 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0ec95-7bc0-4d52-a931-547c9eca1807 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:07.663364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1086/2197] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:33:07.701400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f8727-ae81-45bc-a7d7-020eee016d25 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:07.724309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f8727-ae81-45bc-a7d7-020eee016d25 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:07.730754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef1e67-08a3-4f17-be0c-dd74bcdb75ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:07.731743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1e67-08a3-4f17-be0c-dd74bcdb75ed service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:07.732205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1e67-08a3-4f17-be0c-dd74bcdb75ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:07.732652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1e67-08a3-4f17-be0c-dd74bcdb75ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:07.748159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef1e67-08a3-4f17-be0c-dd74bcdb75ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:07.750111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef1e67-08a3-4f17-be0c-dd74bcdb75ed service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:07.765551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1112/2198] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:09.641883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0ec95-7bc0-4d52-a931-547c9eca1807 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:09.650098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:09.657635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0ec95-7bc0-4d52-a931-547c9eca1807 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:09.659286 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69621c1e-77e9-480d-801d-603afbeb7aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:09.659942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69621c1e-77e9-480d-801d-603afbeb7aca service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:09.660222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69621c1e-77e9-480d-801d-603afbeb7aca service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:09.660491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69621c1e-77e9-480d-801d-603afbeb7aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:09.747434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69621c1e-77e9-480d-801d-603afbeb7aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:09.751452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69621c1e-77e9-480d-801d-603afbeb7aca service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:09.763746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1087/2199] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:09.829737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:12.463702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253ec27-4545-49de-9a57-c2dd271fa083 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:12.464333 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253ec27-4545-49de-9a57-c2dd271fa083 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:12.464333 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253ec27-4545-49de-9a57-c2dd271fa083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:12.485999 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7253ec27-4545-49de-9a57-c2dd271fa083 None None] MFA Rules not processed for user `5078e970ba1b4f339c5be54276edb92f`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:12.487285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7253ec27-4545-49de-9a57-c2dd271fa083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:12.495166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69621c1e-77e9-480d-801d-603afbeb7aca service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:12.497037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1113/2200] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:33:12.580107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69621c1e-77e9-480d-801d-603afbeb7aca service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:12.584965 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:12.585670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:12.586005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:12.586309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] PATH_INFO: `/v3/users/7527a7135b7b4721a028309d5bedfe9d` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:12.589004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7527a7135b7b4721a028309d5bedfe9d)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:12.591141 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:12.942312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7527a7135b7b4721a028309d5bedfe9d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:12.952815 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7527a7135b7b4721a028309d5bedfe9d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:12.953627 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7527a7135b7b4721a028309d5bedfe9d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:13.044306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7527a7135b7b4721a028309d5bedfe9d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:13.058966 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7527a7135b7b4721a028309d5bedfe9d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:13.065228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1088/2201] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:12 2022] DELETE /identity/v3/users/7527a7135b7b4721a028309d5bedfe9d => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:13.069823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995bd3-3825-4d4a-8ff2-aa57d0ddb46b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:13.070108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995bd3-3825-4d4a-8ff2-aa57d0ddb46b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:13.070414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995bd3-3825-4d4a-8ff2-aa57d0ddb46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:13.092807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4c995bd3-3825-4d4a-8ff2-aa57d0ddb46b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:13.094276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4c995bd3-3825-4d4a-8ff2-aa57d0ddb46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:13.153515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:13.178578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1114/2202] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:13.185991 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:13.187699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:13.273276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:13.276678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03a1e9-1b09-4f0b-a8a7-77e07119cc34 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:13.280479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194c2b-f031-455a-b9db-c8e51e95c964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:13.285699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194c2b-f031-455a-b9db-c8e51e95c964 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:13.285699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194c2b-f031-455a-b9db-c8e51e95c964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:13.285699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194c2b-f031-455a-b9db-c8e51e95c964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:13.293808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd194c2b-f031-455a-b9db-c8e51e95c964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:13.295466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd194c2b-f031-455a-b9db-c8e51e95c964 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:13.306884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1089/2203] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:13.932638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995bd3-3825-4d4a-8ff2-aa57d0ddb46b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:13.934312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4c995bd3-3825-4d4a-8ff2-aa57d0ddb46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:13.949218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995bd3-3825-4d4a-8ff2-aa57d0ddb46b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:13.955330 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:13.955978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:13.956259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:13.956538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] PATH_INFO: `/v3/projects/1c24e1c663f94aa0a4475bb5a1d1b48f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:13.957701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c24e1c663f94aa0a4475bb5a1d1b48f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:13.960520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:14.273647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c24e1c663f94aa0a4475bb5a1d1b48f', 'request_id': 'req-8be54d89-7049-428b-9fd0-ee94fdcfa798'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:14.284514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c24e1c663f94aa0a4475bb5a1d1b48f', 'request_id': 'req-8be54d89-7049-428b-9fd0-ee94fdcfa798'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:14.392058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c24e1c663f94aa0a4475bb5a1d1b48f', 'request_id': 'req-8be54d89-7049-428b-9fd0-ee94fdcfa798'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:14.400130 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] The token cache is being invalidate because project 1c24e1c663f94aa0a4475bb5a1d1b48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:14.400774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:14.401714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:14.404514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1115/2204] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:13 2022] DELETE /identity/v3/projects/1c24e1c663f94aa0a4475bb5a1d1b48f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:14.409251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194c2b-f031-455a-b9db-c8e51e95c964 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:14.421633 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194c2b-f031-455a-b9db-c8e51e95c964 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:14.488977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacbfb4-eefd-493f-a336-3528fa8a8906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:14.488977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacbfb4-eefd-493f-a336-3528fa8a8906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:14.488977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacbfb4-eefd-493f-a336-3528fa8a8906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:14.488977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacbfb4-eefd-493f-a336-3528fa8a8906 admin admin] PATH_INFO: `/v3/users/e26be87215a64064afe0b2a3a4910e2e` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:14.489318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacbfb4-eefd-493f-a336-3528fa8a8906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e26be87215a64064afe0b2a3a4910e2e)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:14.490214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacbfb4-eefd-493f-a336-3528fa8a8906 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:14.836214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-deacbfb4-eefd-493f-a336-3528fa8a8906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e26be87215a64064afe0b2a3a4910e2e'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:14.844753 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-deacbfb4-eefd-493f-a336-3528fa8a8906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e26be87215a64064afe0b2a3a4910e2e'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:14.845505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-deacbfb4-eefd-493f-a336-3528fa8a8906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e26be87215a64064afe0b2a3a4910e2e'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:14.999108 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-deacbfb4-eefd-493f-a336-3528fa8a8906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e26be87215a64064afe0b2a3a4910e2e'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:15.015373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-deacbfb4-eefd-493f-a336-3528fa8a8906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e26be87215a64064afe0b2a3a4910e2e'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:15.030202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1090/2205] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:14 2022] DELETE /identity/v3/users/e26be87215a64064afe0b2a3a4910e2e => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:15.079531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:15.656935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:15.658770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:15.675412 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be54d89-7049-428b-9fd0-ee94fdcfa798 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:15.758964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:15.759713 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:15.759990 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:15.760290 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] PATH_INFO: `/v3/projects/be610ea7f4524b89b8c4b8db2b09a44c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:15.761707 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be610ea7f4524b89b8c4b8db2b09a44c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:15.765138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:15.999994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be610ea7f4524b89b8c4b8db2b09a44c', 'request_id': 'req-db799a23-8370-40ff-86da-63f762d16aa3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:16.007509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be610ea7f4524b89b8c4b8db2b09a44c', 'request_id': 'req-db799a23-8370-40ff-86da-63f762d16aa3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:16.169314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be610ea7f4524b89b8c4b8db2b09a44c', 'request_id': 'req-db799a23-8370-40ff-86da-63f762d16aa3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:16.186790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] The token cache is being invalidate because project be610ea7f4524b89b8c4b8db2b09a44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:16.186790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:16.186790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:16.186790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1116/2206] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:15 2022] DELETE /identity/v3/projects/be610ea7f4524b89b8c4b8db2b09a44c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:16.192030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a7f02-d925-401a-98e7-b78b023f05c8 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:16.193286 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a7f02-d925-401a-98e7-b78b023f05c8 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:16.193561 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a7f02-d925-401a-98e7-b78b023f05c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:16.211072 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:16.219000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e79a7f02-d925-401a-98e7-b78b023f05c8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:16.220291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e79a7f02-d925-401a-98e7-b78b023f05c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:16.227086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:16.230293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:16.289754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1091/2207] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:16.298389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50394e17-e2e8-48ea-b3fc-1aa8873b94ae None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:16.298682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50394e17-e2e8-48ea-b3fc-1aa8873b94ae None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:16.298958 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50394e17-e2e8-48ea-b3fc-1aa8873b94ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:16.312365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799a23-8370-40ff-86da-63f762d16aa3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:16.318482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add0118-6ddb-4817-8a82-cab158efa7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:16.319647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add0118-6ddb-4817-8a82-cab158efa7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:16.319852 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-50394e17-e2e8-48ea-b3fc-1aa8873b94ae None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:16.319957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add0118-6ddb-4817-8a82-cab158efa7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:16.320189 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add0118-6ddb-4817-8a82-cab158efa7e7 admin admin] PATH_INFO: `/v3/users/66ebc439e2124dea86eae89116836bf4` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:16.321121 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-50394e17-e2e8-48ea-b3fc-1aa8873b94ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:16.321543 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add0118-6ddb-4817-8a82-cab158efa7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ebc439e2124dea86eae89116836bf4)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:16.323588 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add0118-6ddb-4817-8a82-cab158efa7e7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:16.333932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1092/2208] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:33:16.335008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50394e17-e2e8-48ea-b3fc-1aa8873b94ae None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:16.347049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50394e17-e2e8-48ea-b3fc-1aa8873b94ae None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:16.359243 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d778f11-3b04-47b7-859c-7e2159493ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:16.360252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d778f11-3b04-47b7-859c-7e2159493ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:16.360802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d778f11-3b04-47b7-859c-7e2159493ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:16.361284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d778f11-3b04-47b7-859c-7e2159493ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:16.362135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d778f11-3b04-47b7-859c-7e2159493ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:16.362662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d778f11-3b04-47b7-859c-7e2159493ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:16.366416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d778f11-3b04-47b7-859c-7e2159493ee4 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:16.382331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1093/2209] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:33:16.388993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d778f11-3b04-47b7-859c-7e2159493ee4 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:16.395199 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d778f11-3b04-47b7-859c-7e2159493ee4 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:16.400827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14833ea3-94c9-48d7-8b20-546c5c6ddbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:16.401437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14833ea3-94c9-48d7-8b20-546c5c6ddbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:16.401731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14833ea3-94c9-48d7-8b20-546c5c6ddbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:16.401987 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14833ea3-94c9-48d7-8b20-546c5c6ddbc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:16.402747 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14833ea3-94c9-48d7-8b20-546c5c6ddbc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:16.404933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14833ea3-94c9-48d7-8b20-546c5c6ddbc2 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:16.556777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1094/2210] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:16 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:33:16.558255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14833ea3-94c9-48d7-8b20-546c5c6ddbc2 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:16.633234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14833ea3-94c9-48d7-8b20-546c5c6ddbc2 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:16.640203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3478d-55ae-42f9-85da-3d0e30f9b43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:16.640896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3478d-55ae-42f9-85da-3d0e30f9b43d admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:16.641252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3478d-55ae-42f9-85da-3d0e30f9b43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:16.641743 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3478d-55ae-42f9-85da-3d0e30f9b43d admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:16.642353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3478d-55ae-42f9-85da-3d0e30f9b43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:16.644904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3478d-55ae-42f9-85da-3d0e30f9b43d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:16.676167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8add0118-6ddb-4817-8a82-cab158efa7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ebc439e2124dea86eae89116836bf4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:16.691095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8add0118-6ddb-4817-8a82-cab158efa7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ebc439e2124dea86eae89116836bf4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:16.691945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8add0118-6ddb-4817-8a82-cab158efa7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ebc439e2124dea86eae89116836bf4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:16.692626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8add0118-6ddb-4817-8a82-cab158efa7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ebc439e2124dea86eae89116836bf4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:16.701824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8add0118-6ddb-4817-8a82-cab158efa7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ebc439e2124dea86eae89116836bf4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:16.805322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1095/2211] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:16 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:33:16.811414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3478d-55ae-42f9-85da-3d0e30f9b43d admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:16.830258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-92a3478d-55ae-42f9-85da-3d0e30f9b43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:16.839903 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1117/2212] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:16 2022] DELETE /identity/v3/users/66ebc439e2124dea86eae89116836bf4 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:16.844959 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e57ff-a25d-4df4-bc73-7e4bd41069e5 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:16.845349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e57ff-a25d-4df4-bc73-7e4bd41069e5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:16.845730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e57ff-a25d-4df4-bc73-7e4bd41069e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:16.882805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3478d-55ae-42f9-85da-3d0e30f9b43d admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:16.887772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e96e57ff-a25d-4df4-bc73-7e4bd41069e5 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:16.887772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e96e57ff-a25d-4df4-bc73-7e4bd41069e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:16.973420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59e116-5500-4eb6-a0c4-11d84977c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:16.974198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59e116-5500-4eb6-a0c4-11d84977c21c admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:16.974501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59e116-5500-4eb6-a0c4-11d84977c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:16.974772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59e116-5500-4eb6-a0c4-11d84977c21c admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:16.975556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59e116-5500-4eb6-a0c4-11d84977c21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:16.977059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59e116-5500-4eb6-a0c4-11d84977c21c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:16.978965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1118/2213] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:16.987346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e57ff-a25d-4df4-bc73-7e4bd41069e5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:16.988849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e96e57ff-a25d-4df4-bc73-7e4bd41069e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:16.993531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1096/2214] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:16.995869 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59e116-5500-4eb6-a0c4-11d84977c21c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:17.005961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59e116-5500-4eb6-a0c4-11d84977c21c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:17.014873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38924501-b294-45e7-b861-a63d26e8a759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:17.018653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38924501-b294-45e7-b861-a63d26e8a759 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:17.018653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38924501-b294-45e7-b861-a63d26e8a759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:17.018653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38924501-b294-45e7-b861-a63d26e8a759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:17.018653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38924501-b294-45e7-b861-a63d26e8a759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:17.019015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38924501-b294-45e7-b861-a63d26e8a759 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:17.032983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1097/2215] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:17.038670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38924501-b294-45e7-b861-a63d26e8a759 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:17.051967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38924501-b294-45e7-b861-a63d26e8a759 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:17.056950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353ff8e-c663-4913-ac26-5874981b404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:17.057608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353ff8e-c663-4913-ac26-5874981b404f admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:17.057895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353ff8e-c663-4913-ac26-5874981b404f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:17.058171 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353ff8e-c663-4913-ac26-5874981b404f admin admin] PATH_INFO: `/v3/projects/f090708c1b134e4c81204ac37a6a7831/users/8eefc01512584269809c092a44f2912b/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:17.064994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e57ff-a25d-4df4-bc73-7e4bd41069e5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:17.069335 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a70b0-ef7e-4316-8764-6e6ab7eca427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:17.069953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a70b0-ef7e-4316-8764-6e6ab7eca427 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:17.070242 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a70b0-ef7e-4316-8764-6e6ab7eca427 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:17.070531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a70b0-ef7e-4316-8764-6e6ab7eca427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:17.075615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353ff8e-c663-4913-ac26-5874981b404f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f090708c1b134e4c81204ac37a6a7831, user_id=8eefc01512584269809c092a44f2912b, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:17.080328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353ff8e-c663-4913-ac26-5874981b404f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:17.080740 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a70b0-ef7e-4316-8764-6e6ab7eca427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:17.082190 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a70b0-ef7e-4316-8764-6e6ab7eca427 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:17.095145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1119/2216] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:33:17.274832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1098/2217] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:17 2022] PUT /identity/v3/projects/f090708c1b134e4c81204ac37a6a7831/users/8eefc01512584269809c092a44f2912b/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:17.287223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4324b-4547-4140-a724-e6547b685ece None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:17.287516 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4324b-4547-4140-a724-e6547b685ece None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:17.287779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4324b-4547-4140-a724-e6547b685ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:17.314479 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:17.325179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-cac4324b-4547-4140-a724-e6547b685ece None None] MFA Rules not processed for user `8eefc01512584269809c092a44f2912b`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:17.327010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cac4324b-4547-4140-a724-e6547b685ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:17.418050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1120/2218] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:17.427656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353ff8e-c663-4913-ac26-5874981b404f admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:17.429505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5353ff8e-c663-4913-ac26-5874981b404f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:17.527011 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353ff8e-c663-4913-ac26-5874981b404f admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:17.533186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f74bd-299f-47a4-af58-c18c6c52efa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:17.534293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f74bd-299f-47a4-af58-c18c6c52efa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:17.534790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f74bd-299f-47a4-af58-c18c6c52efa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:17.537593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f74bd-299f-47a4-af58-c18c6c52efa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:17.547770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f74bd-299f-47a4-af58-c18c6c52efa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:17.549252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f74bd-299f-47a4-af58-c18c6c52efa2 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:17.560358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1099/2219] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:17.757505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4324b-4547-4140-a724-e6547b685ece None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:17.760020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cac4324b-4547-4140-a724-e6547b685ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:17.857517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4324b-4547-4140-a724-e6547b685ece None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:17.867457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:17.869360 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:17.869711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:17.870053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] PATH_INFO: `/v3/projects/c33c527ad5514026ae8eefc592f6a073` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:17.872682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33c527ad5514026ae8eefc592f6a073)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:17.877794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:18.041761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:18.067676 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33c527ad5514026ae8eefc592f6a073', 'request_id': 'req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.075732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33c527ad5514026ae8eefc592f6a073', 'request_id': 'req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.198796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33c527ad5514026ae8eefc592f6a073', 'request_id': 'req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.212896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] The token cache is being invalidate because project c33c527ad5514026ae8eefc592f6a073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:18.213320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.214362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.216249 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1121/2220] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:17 2022] DELETE /identity/v3/projects/c33c527ad5514026ae8eefc592f6a073 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:18.227156 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f74bd-299f-47a4-af58-c18c6c52efa2 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:18.231540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f74bd-299f-47a4-af58-c18c6c52efa2 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:18.297159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c81ed-df86-471a-927e-453492db4458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:18.297851 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c81ed-df86-471a-927e-453492db4458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:18.298062 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c81ed-df86-471a-927e-453492db4458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:18.298425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c81ed-df86-471a-927e-453492db4458 admin admin] PATH_INFO: `/v3/users/852819a24cba48849d4537a4c9e863db` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:18.299552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c81ed-df86-471a-927e-453492db4458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852819a24cba48849d4537a4c9e863db)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:18.301463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c81ed-df86-471a-927e-453492db4458 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:18.422139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:18.591410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b86c81ed-df86-471a-927e-453492db4458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852819a24cba48849d4537a4c9e863db'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.598617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b86c81ed-df86-471a-927e-453492db4458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852819a24cba48849d4537a4c9e863db'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.599303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b86c81ed-df86-471a-927e-453492db4458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852819a24cba48849d4537a4c9e863db'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.684365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b86c81ed-df86-471a-927e-453492db4458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852819a24cba48849d4537a4c9e863db'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.699281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b86c81ed-df86-471a-927e-453492db4458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852819a24cba48849d4537a4c9e863db'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.706922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1100/2221] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:18 2022] DELETE /identity/v3/users/852819a24cba48849d4537a4c9e863db => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:19.424149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:19.428417 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:19.444841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc462f-3af2-4cd3-b81f-d2f8c1e2bde6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:19.512254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb1f75-75bd-4b95-9381-4f0a9cc55096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:19.513178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb1f75-75bd-4b95-9381-4f0a9cc55096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:19.513636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb1f75-75bd-4b95-9381-4f0a9cc55096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:19.514305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb1f75-75bd-4b95-9381-4f0a9cc55096 admin admin] PATH_INFO: `/v3/projects/f32e9b38bbe14d26839e6dc7de362fb6` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:19.515915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb1f75-75bd-4b95-9381-4f0a9cc55096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32e9b38bbe14d26839e6dc7de362fb6)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:19.518130 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb1f75-75bd-4b95-9381-4f0a9cc55096 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:19.729996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-94fb1f75-75bd-4b95-9381-4f0a9cc55096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32e9b38bbe14d26839e6dc7de362fb6', 'request_id': 'req-94fb1f75-75bd-4b95-9381-4f0a9cc55096'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:19.736497 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-94fb1f75-75bd-4b95-9381-4f0a9cc55096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32e9b38bbe14d26839e6dc7de362fb6', 'request_id': 'req-94fb1f75-75bd-4b95-9381-4f0a9cc55096'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:19.759079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:19.908009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-94fb1f75-75bd-4b95-9381-4f0a9cc55096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32e9b38bbe14d26839e6dc7de362fb6', 'request_id': 'req-94fb1f75-75bd-4b95-9381-4f0a9cc55096'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:19.934692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-94fb1f75-75bd-4b95-9381-4f0a9cc55096 admin admin] The token cache is being invalidate because project f32e9b38bbe14d26839e6dc7de362fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:19.934989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-94fb1f75-75bd-4b95-9381-4f0a9cc55096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:19.935667 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-94fb1f75-75bd-4b95-9381-4f0a9cc55096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:19.937199 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1122/2222] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:19 2022] DELETE /identity/v3/projects/f32e9b38bbe14d26839e6dc7de362fb6 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:19.942366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce3264-00ef-4514-a0d6-3efa13518fea None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:19.942881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce3264-00ef-4514-a0d6-3efa13518fea None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:19.943065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce3264-00ef-4514-a0d6-3efa13518fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:19.966821 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-45ce3264-00ef-4514-a0d6-3efa13518fea None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:19.968465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-45ce3264-00ef-4514-a0d6-3efa13518fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:20.040341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1101/2223] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:20.048943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bd015-644c-481e-9b95-d211d3d8c4ab None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:20.049352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bd015-644c-481e-9b95-d211d3d8c4ab None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:20.049789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bd015-644c-481e-9b95-d211d3d8c4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:20.089956 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-945bd015-644c-481e-9b95-d211d3d8c4ab None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:20.091523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-945bd015-644c-481e-9b95-d211d3d8c4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:20.107773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1123/2224] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:20.112424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce3264-00ef-4514-a0d6-3efa13518fea None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:20.127574 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce3264-00ef-4514-a0d6-3efa13518fea None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:20.132902 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726180-5b2b-4ecb-8486-76c99c4f3793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:20.134208 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726180-5b2b-4ecb-8486-76c99c4f3793 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:20.134438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726180-5b2b-4ecb-8486-76c99c4f3793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:20.134758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726180-5b2b-4ecb-8486-76c99c4f3793 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:20.135381 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726180-5b2b-4ecb-8486-76c99c4f3793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:20.135938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726180-5b2b-4ecb-8486-76c99c4f3793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:20.137652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726180-5b2b-4ecb-8486-76c99c4f3793 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:20.150679 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1102/2225] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:33:20.156083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bd015-644c-481e-9b95-d211d3d8c4ab None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:20.172274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bd015-644c-481e-9b95-d211d3d8c4ab None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:20.177209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab2ee6-a3ff-44d9-b067-1686574fce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:20.177863 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2ee6-a3ff-44d9-b067-1686574fce3d admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:20.178142 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2ee6-a3ff-44d9-b067-1686574fce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:20.178440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2ee6-a3ff-44d9-b067-1686574fce3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:20.179091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab2ee6-a3ff-44d9-b067-1686574fce3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:20.181654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab2ee6-a3ff-44d9-b067-1686574fce3d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:20.310807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1124/2226] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:20 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:20.315135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726180-5b2b-4ecb-8486-76c99c4f3793 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:20.326257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726180-5b2b-4ecb-8486-76c99c4f3793 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:20.413562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a0635-fa3a-476c-b86d-2d934b529e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:20.414380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a0635-fa3a-476c-b86d-2d934b529e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:20.415410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a0635-fa3a-476c-b86d-2d934b529e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:20.415695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a0635-fa3a-476c-b86d-2d934b529e62 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:20.417353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a0635-fa3a-476c-b86d-2d934b529e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:20.420233 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a0635-fa3a-476c-b86d-2d934b529e62 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:20.563452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1103/2227] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:20 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:20.574252 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab2ee6-a3ff-44d9-b067-1686574fce3d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:20.578646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab2ee6-a3ff-44d9-b067-1686574fce3d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:20.585182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985894c1-df63-4fc0-b1bc-13c8e2782875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:20.586110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985894c1-df63-4fc0-b1bc-13c8e2782875 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:20.586434 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985894c1-df63-4fc0-b1bc-13c8e2782875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:20.587585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985894c1-df63-4fc0-b1bc-13c8e2782875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:20.588263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985894c1-df63-4fc0-b1bc-13c8e2782875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:20.589917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985894c1-df63-4fc0-b1bc-13c8e2782875 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:20.615363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a0635-fa3a-476c-b86d-2d934b529e62 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:20.622374 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1125/2228] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:20.628906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a0635-fa3a-476c-b86d-2d934b529e62 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:20.635773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4518202-2b36-4c1c-a4ed-62e8e4b7c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:20.636407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4518202-2b36-4c1c-a4ed-62e8e4b7c62a admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:20.636687 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4518202-2b36-4c1c-a4ed-62e8e4b7c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:20.636962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4518202-2b36-4c1c-a4ed-62e8e4b7c62a admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:20.637637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4518202-2b36-4c1c-a4ed-62e8e4b7c62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:20.639338 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4518202-2b36-4c1c-a4ed-62e8e4b7c62a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:20.652427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1104/2229] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:20.656710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985894c1-df63-4fc0-b1bc-13c8e2782875 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:20.676514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985894c1-df63-4fc0-b1bc-13c8e2782875 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:20.684414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd7495-59d9-4564-9d4a-286a9ec8fd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:20.692486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd7495-59d9-4564-9d4a-286a9ec8fd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:20.692486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd7495-59d9-4564-9d4a-286a9ec8fd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:20.692486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd7495-59d9-4564-9d4a-286a9ec8fd75 admin admin] PATH_INFO: `/v3/projects/cca886dad916471c9496e725cd49dd6c/users/a17ff602c3a34f3ab6315bbdcc6d0ed4/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:20.707439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd7495-59d9-4564-9d4a-286a9ec8fd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca886dad916471c9496e725cd49dd6c, user_id=a17ff602c3a34f3ab6315bbdcc6d0ed4, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:20.710293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd7495-59d9-4564-9d4a-286a9ec8fd75 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:20.833800 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1126/2230] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:20 2022] PUT /identity/v3/projects/cca886dad916471c9496e725cd49dd6c/users/a17ff602c3a34f3ab6315bbdcc6d0ed4/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:20.846102 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faafb52-e07f-4f96-a778-96444016c066 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:20.846426 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faafb52-e07f-4f96-a778-96444016c066 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:20.846705 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faafb52-e07f-4f96-a778-96444016c066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:20.880825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-8faafb52-e07f-4f96-a778-96444016c066 None None] MFA Rules not processed for user `a17ff602c3a34f3ab6315bbdcc6d0ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:20.882398 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8faafb52-e07f-4f96-a778-96444016c066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:20.961321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1105/2231] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:20.990750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd7495-59d9-4564-9d4a-286a9ec8fd75 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:20.991104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e3bd7495-59d9-4564-9d4a-286a9ec8fd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:21.087234 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd7495-59d9-4564-9d4a-286a9ec8fd75 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:21.090979 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c7c48-1356-41c9-9473-a184f4f88946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:21.091614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c7c48-1356-41c9-9473-a184f4f88946 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:21.091917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c7c48-1356-41c9-9473-a184f4f88946 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:21.092184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c7c48-1356-41c9-9473-a184f4f88946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:21.101617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c7c48-1356-41c9-9473-a184f4f88946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:21.103853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c7c48-1356-41c9-9473-a184f4f88946 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:21.115388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1127/2232] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:21.607216 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:22.244494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faafb52-e07f-4f96-a778-96444016c066 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:22.246004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8faafb52-e07f-4f96-a778-96444016c066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:22.318963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faafb52-e07f-4f96-a778-96444016c066 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:22.331894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:22.332553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:22.332832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:22.333111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] PATH_INFO: `/v3/users/8eefc01512584269809c092a44f2912b` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:22.334325 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eefc01512584269809c092a44f2912b)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:22.336289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:22.703644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eefc01512584269809c092a44f2912b'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:22.710793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eefc01512584269809c092a44f2912b'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:22.711514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eefc01512584269809c092a44f2912b'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:22.827637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eefc01512584269809c092a44f2912b'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:22.841739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eefc01512584269809c092a44f2912b'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:22.848741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1106/2233] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:22 2022] DELETE /identity/v3/users/8eefc01512584269809c092a44f2912b => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:22.853670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f4ec-a7b7-4d6f-962a-79e249937519 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:22.854167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f4ec-a7b7-4d6f-962a-79e249937519 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:22.854317 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f4ec-a7b7-4d6f-962a-79e249937519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:22.886778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3df3f4ec-a7b7-4d6f-962a-79e249937519 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:22.888635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3df3f4ec-a7b7-4d6f-962a-79e249937519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:22.955755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1128/2234] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:33:22.966404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:22.967997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:23.031355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a242a3-ce60-4744-8a4b-ccd438baae55 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:23.035086 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475287b6-9c7c-4845-995d-8e33b1e06ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:23.035712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475287b6-9c7c-4845-995d-8e33b1e06ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:23.035992 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475287b6-9c7c-4845-995d-8e33b1e06ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:23.036268 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475287b6-9c7c-4845-995d-8e33b1e06ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:23.047328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475287b6-9c7c-4845-995d-8e33b1e06ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:23.048844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475287b6-9c7c-4845-995d-8e33b1e06ab0 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:23.059583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1107/2235] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:23.079624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:23.417166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:23.703880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3f4ec-a7b7-4d6f-962a-79e249937519 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:23.705347 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3df3f4ec-a7b7-4d6f-962a-79e249937519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:23.721198 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3f4ec-a7b7-4d6f-962a-79e249937519 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:23.724893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:23.725727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:23.726136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:23.726506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748 admin admin] PATH_INFO: `/v3/projects/f090708c1b134e4c81204ac37a6a7831` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:23.729035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f090708c1b134e4c81204ac37a6a7831)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:23.731103 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:23.891270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f090708c1b134e4c81204ac37a6a7831', 'request_id': 'req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:23.897990 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f090708c1b134e4c81204ac37a6a7831', 'request_id': 'req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:24.061495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f090708c1b134e4c81204ac37a6a7831', 'request_id': 'req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:24.073476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748 admin admin] The token cache is being invalidate because project f090708c1b134e4c81204ac37a6a7831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:24.073853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:24.074589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0e2eed03-b51e-4d17-ab39-e8c93cbb4748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:24.076180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1129/2236] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:23 2022] DELETE /identity/v3/projects/f090708c1b134e4c81204ac37a6a7831 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:24.081676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461e622-319c-4328-a98f-d5a6944420fb None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:24.082169 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461e622-319c-4328-a98f-d5a6944420fb None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:24.082659 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461e622-319c-4328-a98f-d5a6944420fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:24.103010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-5461e622-319c-4328-a98f-d5a6944420fb None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:24.104289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5461e622-319c-4328-a98f-d5a6944420fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:24.183886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1108/2237] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:24.192609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189458-bed5-4223-be16-77bebd0ba923 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:24.192842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189458-bed5-4223-be16-77bebd0ba923 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:24.194437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189458-bed5-4223-be16-77bebd0ba923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:24.219788 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-40189458-bed5-4223-be16-77bebd0ba923 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:24.221658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-40189458-bed5-4223-be16-77bebd0ba923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:24.231694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1130/2238] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:24.236151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461e622-319c-4328-a98f-d5a6944420fb None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:24.247032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461e622-319c-4328-a98f-d5a6944420fb None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:24.252517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a67e5-8e31-4ce0-8410-6f17e6d7143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:24.254964 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a67e5-8e31-4ce0-8410-6f17e6d7143e admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:24.254964 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a67e5-8e31-4ce0-8410-6f17e6d7143e admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:24.255541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a67e5-8e31-4ce0-8410-6f17e6d7143e admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:24.256576 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a67e5-8e31-4ce0-8410-6f17e6d7143e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:24.256684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a67e5-8e31-4ce0-8410-6f17e6d7143e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:24.259050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a67e5-8e31-4ce0-8410-6f17e6d7143e admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:24.278016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40189458-bed5-4223-be16-77bebd0ba923 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:24.282512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1109/2239] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:33:24.288678 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40189458-bed5-4223-be16-77bebd0ba923 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:24.296078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969d1cf-177e-4d16-b61b-c1a154bdd2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:24.297413 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d1cf-177e-4d16-b61b-c1a154bdd2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:24.298131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d1cf-177e-4d16-b61b-c1a154bdd2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:24.298666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d1cf-177e-4d16-b61b-c1a154bdd2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:24.299487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969d1cf-177e-4d16-b61b-c1a154bdd2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:24.302209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969d1cf-177e-4d16-b61b-c1a154bdd2c4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:24.435940 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1131/2240] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:24 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:24.440732 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a67e5-8e31-4ce0-8410-6f17e6d7143e admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:24.451706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a67e5-8e31-4ce0-8410-6f17e6d7143e admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:24.512446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed12556-0595-4a0b-8663-733f6efe0029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:24.513027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed12556-0595-4a0b-8663-733f6efe0029 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:24.513307 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed12556-0595-4a0b-8663-733f6efe0029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:24.513609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed12556-0595-4a0b-8663-733f6efe0029 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:24.514310 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed12556-0595-4a0b-8663-733f6efe0029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:24.516248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed12556-0595-4a0b-8663-733f6efe0029 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:24.714165 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1110/2241] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:24 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:24.718431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969d1cf-177e-4d16-b61b-c1a154bdd2c4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:24.730215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969d1cf-177e-4d16-b61b-c1a154bdd2c4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:24.735562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420c619-281b-46b1-a79d-1f2c1d2e644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:24.736181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c619-281b-46b1-a79d-1f2c1d2e644e admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:24.736482 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c619-281b-46b1-a79d-1f2c1d2e644e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:24.736751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c619-281b-46b1-a79d-1f2c1d2e644e admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:24.737406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420c619-281b-46b1-a79d-1f2c1d2e644e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:24.739178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420c619-281b-46b1-a79d-1f2c1d2e644e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:24.750852 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1132/2242] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:24.761690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed12556-0595-4a0b-8663-733f6efe0029 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:24.772756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed12556-0595-4a0b-8663-733f6efe0029 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:24.778552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01760b2-ea87-46ed-9b8e-47eefd0e1ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:24.779193 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01760b2-ea87-46ed-9b8e-47eefd0e1ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:24.779453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01760b2-ea87-46ed-9b8e-47eefd0e1ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:24.779722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01760b2-ea87-46ed-9b8e-47eefd0e1ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:24.780407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01760b2-ea87-46ed-9b8e-47eefd0e1ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:24.782079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01760b2-ea87-46ed-9b8e-47eefd0e1ec5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:24.796693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1111/2243] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:33:24.800858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420c619-281b-46b1-a79d-1f2c1d2e644e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:24.812614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420c619-281b-46b1-a79d-1f2c1d2e644e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:24.817449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24876252-d46e-43f3-a174-f7f679f80170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:24.818109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24876252-d46e-43f3-a174-f7f679f80170 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:24.818422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24876252-d46e-43f3-a174-f7f679f80170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:24.818695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24876252-d46e-43f3-a174-f7f679f80170 admin admin] PATH_INFO: `/v3/projects/7c5e2204d83b4fa6bc16381b632a4714/users/d03b0800204f4b70b33f35b4b3468d52/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:24.834878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24876252-d46e-43f3-a174-f7f679f80170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5e2204d83b4fa6bc16381b632a4714, user_id=d03b0800204f4b70b33f35b4b3468d52, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:24.838569 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24876252-d46e-43f3-a174-f7f679f80170 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:24.856194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:24.983513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1133/2244] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:24 2022] PUT /identity/v3/projects/7c5e2204d83b4fa6bc16381b632a4714/users/d03b0800204f4b70b33f35b4b3468d52/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:24.988914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a5cfd-813a-40a3-a5e5-de23b51583a6 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:24.989190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a5cfd-813a-40a3-a5e5-de23b51583a6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:24.989465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a5cfd-813a-40a3-a5e5-de23b51583a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:25.018643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e60a5cfd-813a-40a3-a5e5-de23b51583a6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:25.019941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e60a5cfd-813a-40a3-a5e5-de23b51583a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:25.087294 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1112/2245] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:25.096717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24876252-d46e-43f3-a174-f7f679f80170 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:25.098647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-24876252-d46e-43f3-a174-f7f679f80170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:25.160789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24876252-d46e-43f3-a174-f7f679f80170 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:25.165207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4d883-832e-47bf-99e3-e7566d1419e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:25.166337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d883-832e-47bf-99e3-e7566d1419e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:25.166621 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d883-832e-47bf-99e3-e7566d1419e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:25.166895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d883-832e-47bf-99e3-e7566d1419e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:25.177450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4d883-832e-47bf-99e3-e7566d1419e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:25.178920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4d883-832e-47bf-99e3-e7566d1419e2 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:25.194321 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1134/2246] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:25.433158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:27.334629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a5cfd-813a-40a3-a5e5-de23b51583a6 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:27.338343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e60a5cfd-813a-40a3-a5e5-de23b51583a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:27.358253 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a5cfd-813a-40a3-a5e5-de23b51583a6 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:27.367273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:27.368971 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:27.369308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:27.369780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] PATH_INFO: `/v3/users/a17ff602c3a34f3ab6315bbdcc6d0ed4` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:27.371348 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17ff602c3a34f3ab6315bbdcc6d0ed4)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:27.373472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:27.668115 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:27.682918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17ff602c3a34f3ab6315bbdcc6d0ed4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:27.690545 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17ff602c3a34f3ab6315bbdcc6d0ed4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:27.691415 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17ff602c3a34f3ab6315bbdcc6d0ed4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:27.772797 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17ff602c3a34f3ab6315bbdcc6d0ed4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:27.793416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17ff602c3a34f3ab6315bbdcc6d0ed4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:27.803830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1113/2247] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:27 2022] DELETE /identity/v3/users/a17ff602c3a34f3ab6315bbdcc6d0ed4 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:27.806313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f716b7f-c8ec-4bdc-8b12-33934fe21377 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:27.807118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f716b7f-c8ec-4bdc-8b12-33934fe21377 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:27.808146 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f716b7f-c8ec-4bdc-8b12-33934fe21377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:27.855432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3f716b7f-c8ec-4bdc-8b12-33934fe21377 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:27.857010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3f716b7f-c8ec-4bdc-8b12-33934fe21377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:27.986321 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1135/2248] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:27.993788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:27.995642 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:28.066595 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fbe74-00f5-4128-badc-6e9a33389df7 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:28.073295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ae217-22c2-4da7-8e18-97eb6a37458d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:28.077738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ae217-22c2-4da7-8e18-97eb6a37458d service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:28.077738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ae217-22c2-4da7-8e18-97eb6a37458d service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:28.077738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ae217-22c2-4da7-8e18-97eb6a37458d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:28.088979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ae217-22c2-4da7-8e18-97eb6a37458d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:28.090488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ae217-22c2-4da7-8e18-97eb6a37458d service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:28.123240 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1114/2249] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:28.672720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f716b7f-c8ec-4bdc-8b12-33934fe21377 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:28.674485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3f716b7f-c8ec-4bdc-8b12-33934fe21377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:28.701090 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f716b7f-c8ec-4bdc-8b12-33934fe21377 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:28.711900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a05007-62eb-44d7-85f7-610f7023887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:28.713473 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a05007-62eb-44d7-85f7-610f7023887f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:28.714509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a05007-62eb-44d7-85f7-610f7023887f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:28.722364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a05007-62eb-44d7-85f7-610f7023887f admin admin] PATH_INFO: `/v3/projects/cca886dad916471c9496e725cd49dd6c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:28.724663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a05007-62eb-44d7-85f7-610f7023887f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca886dad916471c9496e725cd49dd6c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:28.729077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a05007-62eb-44d7-85f7-610f7023887f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:29.005413 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-51a05007-62eb-44d7-85f7-610f7023887f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca886dad916471c9496e725cd49dd6c', 'request_id': 'req-51a05007-62eb-44d7-85f7-610f7023887f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:29.019806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-51a05007-62eb-44d7-85f7-610f7023887f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca886dad916471c9496e725cd49dd6c', 'request_id': 'req-51a05007-62eb-44d7-85f7-610f7023887f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:29.153063 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-51a05007-62eb-44d7-85f7-610f7023887f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca886dad916471c9496e725cd49dd6c', 'request_id': 'req-51a05007-62eb-44d7-85f7-610f7023887f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:29.169620 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-51a05007-62eb-44d7-85f7-610f7023887f admin admin] The token cache is being invalidate because project cca886dad916471c9496e725cd49dd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:29.170318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-51a05007-62eb-44d7-85f7-610f7023887f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:29.171818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-51a05007-62eb-44d7-85f7-610f7023887f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:29.174084 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1136/2250] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:28 2022] DELETE /identity/v3/projects/cca886dad916471c9496e725cd49dd6c => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:29.178812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae975976-4345-4d28-b674-8499b621a407 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:29.179335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae975976-4345-4d28-b674-8499b621a407 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:29.179335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae975976-4345-4d28-b674-8499b621a407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:29.202879 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ae975976-4345-4d28-b674-8499b621a407 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:29.204236 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ae975976-4345-4d28-b674-8499b621a407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:29.278036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1115/2251] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:29.286294 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d2460-6291-43ca-993c-89396c35169a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:29.286397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d2460-6291-43ca-993c-89396c35169a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:29.286630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d2460-6291-43ca-993c-89396c35169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:29.311137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-cc4d2460-6291-43ca-993c-89396c35169a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:29.312443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cc4d2460-6291-43ca-993c-89396c35169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:29.321318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1137/2252] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:29.326475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae975976-4345-4d28-b674-8499b621a407 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:29.340215 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae975976-4345-4d28-b674-8499b621a407 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:29.354409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8b589-f62e-4bdc-ac63-419eb75e584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:29.354409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8b589-f62e-4bdc-ac63-419eb75e584f admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:29.354409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8b589-f62e-4bdc-ac63-419eb75e584f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:29.354409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8b589-f62e-4bdc-ac63-419eb75e584f admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:29.354979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8b589-f62e-4bdc-ac63-419eb75e584f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:29.354979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8b589-f62e-4bdc-ac63-419eb75e584f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:29.354979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8b589-f62e-4bdc-ac63-419eb75e584f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:29.373823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1116/2253] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:33:29.379522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d2460-6291-43ca-993c-89396c35169a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:29.396382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d2460-6291-43ca-993c-89396c35169a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:29.403483 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca2359-419c-4cd2-928c-21769a9d28e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:29.404896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca2359-419c-4cd2-928c-21769a9d28e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:29.405299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca2359-419c-4cd2-928c-21769a9d28e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:29.405709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca2359-419c-4cd2-928c-21769a9d28e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:29.406551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca2359-419c-4cd2-928c-21769a9d28e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:29.409046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca2359-419c-4cd2-928c-21769a9d28e2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:29.579118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1138/2254] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:29 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:29.580443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8b589-f62e-4bdc-ac63-419eb75e584f admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:29.611934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8b589-f62e-4bdc-ac63-419eb75e584f admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:29.753894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a223b57-62c9-48db-a1d6-82da75bdad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:29.754645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a223b57-62c9-48db-a1d6-82da75bdad3f admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:29.755911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a223b57-62c9-48db-a1d6-82da75bdad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:29.761717 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a223b57-62c9-48db-a1d6-82da75bdad3f admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:29.761717 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a223b57-62c9-48db-a1d6-82da75bdad3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:29.763655 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a223b57-62c9-48db-a1d6-82da75bdad3f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:29.942834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1117/2255] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:29 2022] POST /identity/v3/users => generated 285 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:29.947814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca2359-419c-4cd2-928c-21769a9d28e2 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:29.959228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca2359-419c-4cd2-928c-21769a9d28e2 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:29.974739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31f70d-e491-44a2-be0b-9a616016acbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:29.975632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31f70d-e491-44a2-be0b-9a616016acbc admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:29.976307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31f70d-e491-44a2-be0b-9a616016acbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:29.976578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31f70d-e491-44a2-be0b-9a616016acbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:29.977291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31f70d-e491-44a2-be0b-9a616016acbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:29.978962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31f70d-e491-44a2-be0b-9a616016acbc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:29.993887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1139/2256] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:29.995251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a223b57-62c9-48db-a1d6-82da75bdad3f admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:30.006766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:30.016612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a223b57-62c9-48db-a1d6-82da75bdad3f admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:30.023265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a413a94-e656-4a95-934b-31dbbc1e703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:30.023912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a413a94-e656-4a95-934b-31dbbc1e703a admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:30.024759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a413a94-e656-4a95-934b-31dbbc1e703a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:30.025173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a413a94-e656-4a95-934b-31dbbc1e703a admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:30.025907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a413a94-e656-4a95-934b-31dbbc1e703a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:30.027574 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a413a94-e656-4a95-934b-31dbbc1e703a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:30.050290 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1118/2257] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:30.051982 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31f70d-e491-44a2-be0b-9a616016acbc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:30.063340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31f70d-e491-44a2-be0b-9a616016acbc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:30.068996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66370b2-68a8-46f1-9629-a5972a9fff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:30.069868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66370b2-68a8-46f1-9629-a5972a9fff50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:30.070476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66370b2-68a8-46f1-9629-a5972a9fff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:30.071429 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66370b2-68a8-46f1-9629-a5972a9fff50 admin admin] PATH_INFO: `/v3/projects/83635d022c6c466b8873e5338ad65c2e/users/be3ab140c72d4d59b1de82718c02513e/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:30.106353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66370b2-68a8-46f1-9629-a5972a9fff50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83635d022c6c466b8873e5338ad65c2e, user_id=be3ab140c72d4d59b1de82718c02513e, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:30.110188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66370b2-68a8-46f1-9629-a5972a9fff50 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:30.218474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1140/2258] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:30 2022] PUT /identity/v3/projects/83635d022c6c466b8873e5338ad65c2e/users/be3ab140c72d4d59b1de82718c02513e/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:30.226371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408628e6-4597-4ca9-b601-a6b63593e823 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:30.227818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408628e6-4597-4ca9-b601-a6b63593e823 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:30.228272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408628e6-4597-4ca9-b601-a6b63593e823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:30.279639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-408628e6-4597-4ca9-b601-a6b63593e823 None None] MFA Rules not processed for user `be3ab140c72d4d59b1de82718c02513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:30.281202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-408628e6-4597-4ca9-b601-a6b63593e823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:30.408645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1119/2259] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:30.420817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66370b2-68a8-46f1-9629-a5972a9fff50 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:30.422911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e66370b2-68a8-46f1-9629-a5972a9fff50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:30.540965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66370b2-68a8-46f1-9629-a5972a9fff50 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:30.545396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb1fc8-acdb-4961-ad38-fe2ff68c30aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c841f03880c4fb1b402bac6ecce25fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:30.546105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb1fc8-acdb-4961-ad38-fe2ff68c30aa service glance] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:30.546417 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb1fc8-acdb-4961-ad38-fe2ff68c30aa service glance] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:30.546695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb1fc8-acdb-4961-ad38-fe2ff68c30aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:30.559772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb1fc8-acdb-4961-ad38-fe2ff68c30aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:30.561399 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb1fc8-acdb-4961-ad38-fe2ff68c30aa service glance] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:30.579284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1141/2260] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:30.708523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:32.682193 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:33.171553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7fcba-6e1c-45e6-9f90-e5cff2c66efd None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:33.172921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7fcba-6e1c-45e6-9f90-e5cff2c66efd None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:33.172921 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7fcba-6e1c-45e6-9f90-e5cff2c66efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:33.212285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-2af7fcba-6e1c-45e6-9f90-e5cff2c66efd None None] MFA Rules not processed for user `d03b0800204f4b70b33f35b4b3468d52`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:33.214266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2af7fcba-6e1c-45e6-9f90-e5cff2c66efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:33.357503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1120/2261] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:33.364715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb1fc8-acdb-4961-ad38-fe2ff68c30aa service glance] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:33.366217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a8bb1fc8-acdb-4961-ad38-fe2ff68c30aa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:33.465506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb1fc8-acdb-4961-ad38-fe2ff68c30aa service glance] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:33.474863 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaaaa0e-f489-4c35-bb6d-830abd20fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:33.477756 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaaa0e-f489-4c35-bb6d-830abd20fc56 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:33.478245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaaa0e-f489-4c35-bb6d-830abd20fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:33.478671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaaa0e-f489-4c35-bb6d-830abd20fc56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:33.479723 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaaaa0e-f489-4c35-bb6d-830abd20fc56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:33.481931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaaaa0e-f489-4c35-bb6d-830abd20fc56 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:33.668695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1142/2262] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:33 2022] POST /identity/v3/projects => generated 385 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:33.673514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7fcba-6e1c-45e6-9f90-e5cff2c66efd None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:33.686544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7fcba-6e1c-45e6-9f90-e5cff2c66efd None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:33.766929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3e1a7-1047-4642-9bfa-9c7a9270b89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:33.767756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3e1a7-1047-4642-9bfa-9c7a9270b89a admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:33.768213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3e1a7-1047-4642-9bfa-9c7a9270b89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:33.768782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3e1a7-1047-4642-9bfa-9c7a9270b89a admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:33.769497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3e1a7-1047-4642-9bfa-9c7a9270b89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:33.772083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3e1a7-1047-4642-9bfa-9c7a9270b89a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:33.897554 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaaaa0e-f489-4c35-bb6d-830abd20fc56 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:33.905176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1121/2263] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:33 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:33.910115 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaaaa0e-f489-4c35-bb6d-830abd20fc56 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:33.915915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682c13d-b7d0-45a1-9e09-a3286ce36707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:33.921047 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682c13d-b7d0-45a1-9e09-a3286ce36707 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:33.921047 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682c13d-b7d0-45a1-9e09-a3286ce36707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:33.921047 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682c13d-b7d0-45a1-9e09-a3286ce36707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:33.921047 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682c13d-b7d0-45a1-9e09-a3286ce36707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:33.921047 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682c13d-b7d0-45a1-9e09-a3286ce36707 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:33.938008 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1143/2264] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:33.939800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3e1a7-1047-4642-9bfa-9c7a9270b89a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:33.951859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3e1a7-1047-4642-9bfa-9c7a9270b89a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:33.958003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732fc3b-9127-45e5-b53a-8f2deb8c2a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:33.958986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732fc3b-9127-45e5-b53a-8f2deb8c2a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:33.960975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732fc3b-9127-45e5-b53a-8f2deb8c2a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:33.960975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732fc3b-9127-45e5-b53a-8f2deb8c2a1f admin admin] PATH_INFO: `/v3/projects/560b2bda236d4c2ab112b13125216c66/users/159a9ad89fcb44858499dc7679abe481/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:33.983548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732fc3b-9127-45e5-b53a-8f2deb8c2a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=560b2bda236d4c2ab112b13125216c66, user_id=159a9ad89fcb44858499dc7679abe481, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:33.989747 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732fc3b-9127-45e5-b53a-8f2deb8c2a1f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:34.102672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1122/2265] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:33 2022] PUT /identity/v3/projects/560b2bda236d4c2ab112b13125216c66/users/159a9ad89fcb44858499dc7679abe481/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:34.107722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682c13d-b7d0-45a1-9e09-a3286ce36707 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:34.124901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682c13d-b7d0-45a1-9e09-a3286ce36707 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:34.200194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983899bb-b59f-4c13-ac97-82f334e004b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:34.201332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983899bb-b59f-4c13-ac97-82f334e004b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:34.202886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983899bb-b59f-4c13-ac97-82f334e004b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:34.203439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983899bb-b59f-4c13-ac97-82f334e004b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:34.204571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983899bb-b59f-4c13-ac97-82f334e004b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:34.207651 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983899bb-b59f-4c13-ac97-82f334e004b1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:34.232297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1144/2266] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:34.238919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732fc3b-9127-45e5-b53a-8f2deb8c2a1f admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:34.250364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732fc3b-9127-45e5-b53a-8f2deb8c2a1f admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:34.255856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea4e60-417d-40e7-96f9-542761447504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:34.256540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea4e60-417d-40e7-96f9-542761447504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:34.256813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea4e60-417d-40e7-96f9-542761447504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:34.257095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea4e60-417d-40e7-96f9-542761447504 admin admin] PATH_INFO: `/v3/projects/560b2bda236d4c2ab112b13125216c66/users/159a9ad89fcb44858499dc7679abe481/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:34.260006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea4e60-417d-40e7-96f9-542761447504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560b2bda236d4c2ab112b13125216c66, user_id=159a9ad89fcb44858499dc7679abe481, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:34.263123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea4e60-417d-40e7-96f9-542761447504 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:34.280518 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1123/2267] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:34 2022] PUT /identity/v3/projects/560b2bda236d4c2ab112b13125216c66/users/159a9ad89fcb44858499dc7679abe481/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:34.364879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:34.873393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:37.464274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983899bb-b59f-4c13-ac97-82f334e004b1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:37.467621 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-983899bb-b59f-4c13-ac97-82f334e004b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:37.498677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983899bb-b59f-4c13-ac97-82f334e004b1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:37.517349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:37.587235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:37.588000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:37.588343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:37.588690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] PATH_INFO: `/v3/users/cc568628e8e94ec3ac23b475b9b78641` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:37.589968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc568628e8e94ec3ac23b475b9b78641)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:37.592583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:38.066698 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc568628e8e94ec3ac23b475b9b78641'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.100466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc568628e8e94ec3ac23b475b9b78641'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.107038 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc568628e8e94ec3ac23b475b9b78641'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.108028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc568628e8e94ec3ac23b475b9b78641'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.132741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc568628e8e94ec3ac23b475b9b78641'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.293871 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1145/2268] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:37 2022] DELETE /identity/v3/users/cc568628e8e94ec3ac23b475b9b78641 => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:38.389248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:38.733152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea4e60-417d-40e7-96f9-542761447504 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:38.735577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a8ea4e60-417d-40e7-96f9-542761447504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:38.836087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea4e60-417d-40e7-96f9-542761447504 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:38.975759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:38.978005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:38.978636 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:38.979316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] PATH_INFO: `/v3/projects/8b54803f7a754a68877340344f21b42b` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:38.987919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b54803f7a754a68877340344f21b42b)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:38.990374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:39.124762 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b54803f7a754a68877340344f21b42b', 'request_id': 'req-ed0ab388-3a1b-4bd5-9413-fa6966919282'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.132301 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b54803f7a754a68877340344f21b42b', 'request_id': 'req-ed0ab388-3a1b-4bd5-9413-fa6966919282'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.141773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b54803f7a754a68877340344f21b42b', 'request_id': 'req-ed0ab388-3a1b-4bd5-9413-fa6966919282'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.264572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] The token cache is being invalidate because project 8b54803f7a754a68877340344f21b42b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:39.264572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.264572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.266765 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1124/2269] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:38 2022] DELETE /identity/v3/projects/8b54803f7a754a68877340344f21b42b => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:39.272210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:39.284091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae275cb-1a1c-4ca7-813f-9e1305f2f661 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:39.372276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35f6d8-776c-4587-bbf4-cccaf457921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:39.373137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35f6d8-776c-4587-bbf4-cccaf457921b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:39.373598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35f6d8-776c-4587-bbf4-cccaf457921b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:39.374022 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35f6d8-776c-4587-bbf4-cccaf457921b admin admin] PATH_INFO: `/v3/users/528e1becf5c94d2fab4a089eb619dfbf` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:39.375515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35f6d8-776c-4587-bbf4-cccaf457921b admin admin] RBAC: Authorizing `identity:delete_user(user_id=528e1becf5c94d2fab4a089eb619dfbf)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:39.377649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35f6d8-776c-4587-bbf4-cccaf457921b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:39.682734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bb35f6d8-776c-4587-bbf4-cccaf457921b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528e1becf5c94d2fab4a089eb619dfbf'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.699373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bb35f6d8-776c-4587-bbf4-cccaf457921b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528e1becf5c94d2fab4a089eb619dfbf'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.700584 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bb35f6d8-776c-4587-bbf4-cccaf457921b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528e1becf5c94d2fab4a089eb619dfbf'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.701362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bb35f6d8-776c-4587-bbf4-cccaf457921b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528e1becf5c94d2fab4a089eb619dfbf'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.712046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bb35f6d8-776c-4587-bbf4-cccaf457921b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528e1becf5c94d2fab4a089eb619dfbf'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.840914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:39.851587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1146/2270] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:39 2022] DELETE /identity/v3/users/528e1becf5c94d2fab4a089eb619dfbf => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:40.571285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:40.574267 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:40.626985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ab388-3a1b-4bd5-9413-fa6966919282 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:40.747228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0da638-ee1a-4d04-a3a0-2569349b7546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:40.749903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0da638-ee1a-4d04-a3a0-2569349b7546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:40.750634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0da638-ee1a-4d04-a3a0-2569349b7546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:40.751306 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0da638-ee1a-4d04-a3a0-2569349b7546 admin admin] PATH_INFO: `/v3/projects/4518479ed353400785e0e675fee9a4a2` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:40.753951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0da638-ee1a-4d04-a3a0-2569349b7546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4518479ed353400785e0e675fee9a4a2)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:40.756852 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0da638-ee1a-4d04-a3a0-2569349b7546 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:40.949751 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-0c0da638-ee1a-4d04-a3a0-2569349b7546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4518479ed353400785e0e675fee9a4a2', 'request_id': 'req-0c0da638-ee1a-4d04-a3a0-2569349b7546'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:40.956595 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-0c0da638-ee1a-4d04-a3a0-2569349b7546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4518479ed353400785e0e675fee9a4a2', 'request_id': 'req-0c0da638-ee1a-4d04-a3a0-2569349b7546'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:40.963226 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-0c0da638-ee1a-4d04-a3a0-2569349b7546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4518479ed353400785e0e675fee9a4a2', 'request_id': 'req-0c0da638-ee1a-4d04-a3a0-2569349b7546'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:41.103673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-0c0da638-ee1a-4d04-a3a0-2569349b7546 admin admin] The token cache is being invalidate because project 4518479ed353400785e0e675fee9a4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:41.107833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-0c0da638-ee1a-4d04-a3a0-2569349b7546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:41.107833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-0c0da638-ee1a-4d04-a3a0-2569349b7546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:41.107833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1125/2271] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:40 2022] DELETE /identity/v3/projects/4518479ed353400785e0e675fee9a4a2 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:41.112505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62867d-0ce8-4a1e-94c1-b7f00aeacc0c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:41.113025 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62867d-0ce8-4a1e-94c1-b7f00aeacc0c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:41.113701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62867d-0ce8-4a1e-94c1-b7f00aeacc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:41.150580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2c62867d-0ce8-4a1e-94c1-b7f00aeacc0c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:41.152236 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2c62867d-0ce8-4a1e-94c1-b7f00aeacc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:41.234863 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1147/2272] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:41.245624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102b89d-5776-43df-b0c5-e04c45c6e140 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:41.246188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102b89d-5776-43df-b0c5-e04c45c6e140 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:41.246777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102b89d-5776-43df-b0c5-e04c45c6e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:41.269354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a102b89d-5776-43df-b0c5-e04c45c6e140 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:41.270600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a102b89d-5776-43df-b0c5-e04c45c6e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:41.287541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1126/2273] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:41.292623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62867d-0ce8-4a1e-94c1-b7f00aeacc0c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:41.302004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62867d-0ce8-4a1e-94c1-b7f00aeacc0c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:41.321923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809d883-d43e-466a-9e8f-80ef7a1d93e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:41.322655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809d883-d43e-466a-9e8f-80ef7a1d93e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:41.323412 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809d883-d43e-466a-9e8f-80ef7a1d93e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:41.323412 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809d883-d43e-466a-9e8f-80ef7a1d93e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:41.324111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809d883-d43e-466a-9e8f-80ef7a1d93e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:41.324419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809d883-d43e-466a-9e8f-80ef7a1d93e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:41.326050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809d883-d43e-466a-9e8f-80ef7a1d93e4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:41.347303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1148/2274] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:33:41.351768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102b89d-5776-43df-b0c5-e04c45c6e140 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:41.364192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102b89d-5776-43df-b0c5-e04c45c6e140 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:41.369700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe966ffa-e0a6-4481-b1b7-1976d549d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:41.370370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe966ffa-e0a6-4481-b1b7-1976d549d2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:41.370656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe966ffa-e0a6-4481-b1b7-1976d549d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:41.371704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe966ffa-e0a6-4481-b1b7-1976d549d2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:41.372364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe966ffa-e0a6-4481-b1b7-1976d549d2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:41.379281 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe966ffa-e0a6-4481-b1b7-1976d549d2d9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:41.975433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1127/2275] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:41 2022] POST /identity/v3/projects => generated 377 bytes in 621 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:41.976533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809d883-d43e-466a-9e8f-80ef7a1d93e4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:41.987560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809d883-d43e-466a-9e8f-80ef7a1d93e4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:42.053021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c32c2d-7eae-4c92-8007-6eb3fcfe66ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:42.053632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32c2d-7eae-4c92-8007-6eb3fcfe66ef admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:42.053911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32c2d-7eae-4c92-8007-6eb3fcfe66ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:42.054250 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32c2d-7eae-4c92-8007-6eb3fcfe66ef admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:42.055186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c32c2d-7eae-4c92-8007-6eb3fcfe66ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:42.057188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c32c2d-7eae-4c92-8007-6eb3fcfe66ef admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:42.177185 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1149/2276] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:41 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:42.181708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe966ffa-e0a6-4481-b1b7-1976d549d2d9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:42.193596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe966ffa-e0a6-4481-b1b7-1976d549d2d9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:42.201459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78734242-2acc-4415-99c3-7dfe041d5edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:42.202283 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78734242-2acc-4415-99c3-7dfe041d5edb admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:42.202575 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78734242-2acc-4415-99c3-7dfe041d5edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:42.202859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78734242-2acc-4415-99c3-7dfe041d5edb admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:42.203511 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78734242-2acc-4415-99c3-7dfe041d5edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:42.205271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78734242-2acc-4415-99c3-7dfe041d5edb admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:42.221879 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1128/2277] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:33:42.227595 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:42.228687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c32c2d-7eae-4c92-8007-6eb3fcfe66ef admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:42.241780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c32c2d-7eae-4c92-8007-6eb3fcfe66ef admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:42.269437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8e9eb-ea80-4b62-8e35-5259bc61e1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:42.278337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8e9eb-ea80-4b62-8e35-5259bc61e1fb admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:42.278656 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8e9eb-ea80-4b62-8e35-5259bc61e1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:42.279241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8e9eb-ea80-4b62-8e35-5259bc61e1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:42.286613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8e9eb-ea80-4b62-8e35-5259bc61e1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:42.292488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8e9eb-ea80-4b62-8e35-5259bc61e1fb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:42.322055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1150/2278] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:33:42.322634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78734242-2acc-4415-99c3-7dfe041d5edb admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:42.332025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78734242-2acc-4415-99c3-7dfe041d5edb admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:42.338465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb452571-82bb-4927-b30c-9b5d7ec16aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:42.339609 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb452571-82bb-4927-b30c-9b5d7ec16aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:42.340115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb452571-82bb-4927-b30c-9b5d7ec16aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:42.340597 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb452571-82bb-4927-b30c-9b5d7ec16aa6 admin admin] PATH_INFO: `/v3/projects/191de4740f4e4397b00788072347ac2e/users/2808e70495d74e7db13aed3848f3e646/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:42.393519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb452571-82bb-4927-b30c-9b5d7ec16aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=191de4740f4e4397b00788072347ac2e, user_id=2808e70495d74e7db13aed3848f3e646, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:42.397431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb452571-82bb-4927-b30c-9b5d7ec16aa6 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:42.663941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1129/2279] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:42 2022] PUT /identity/v3/projects/191de4740f4e4397b00788072347ac2e/users/2808e70495d74e7db13aed3848f3e646/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:42.683403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8263-40d7-48cc-941e-99b6635131d6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:42.683403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8263-40d7-48cc-941e-99b6635131d6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:42.683403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8263-40d7-48cc-941e-99b6635131d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:42.731402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a9be8263-40d7-48cc-941e-99b6635131d6 None None] MFA Rules not processed for user `2808e70495d74e7db13aed3848f3e646`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:42.733977 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a9be8263-40d7-48cc-941e-99b6635131d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:42.857418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1151/2280] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:42.869905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb452571-82bb-4927-b30c-9b5d7ec16aa6 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:42.872068 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bb452571-82bb-4927-b30c-9b5d7ec16aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:43.007461 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76355464-9c6a-4487-a13c-1a7a0e8ef531 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:43.011017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76355464-9c6a-4487-a13c-1a7a0e8ef531 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:43.011944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76355464-9c6a-4487-a13c-1a7a0e8ef531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:43.028714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb452571-82bb-4927-b30c-9b5d7ec16aa6 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:43.033754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455026ec-3fa9-4712-bbcc-04e8b24ff2a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c841f03880c4fb1b402bac6ecce25fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:43.035316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455026ec-3fa9-4712-bbcc-04e8b24ff2a1 service glance] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:43.035473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455026ec-3fa9-4712-bbcc-04e8b24ff2a1 service glance] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:43.036616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455026ec-3fa9-4712-bbcc-04e8b24ff2a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:43.053098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-76355464-9c6a-4487-a13c-1a7a0e8ef531 None None] MFA Rules not processed for user `5078e970ba1b4f339c5be54276edb92f`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:43.053626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455026ec-3fa9-4712-bbcc-04e8b24ff2a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:43.054730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-76355464-9c6a-4487-a13c-1a7a0e8ef531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:43.055890 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455026ec-3fa9-4712-bbcc-04e8b24ff2a1 service glance] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:43.074188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1130/2281] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:43.185472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aec0b3-c4c0-460c-874a-a6840eefedb0 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:43.185472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aec0b3-c4c0-460c-874a-a6840eefedb0 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:43.185472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aec0b3-c4c0-460c-874a-a6840eefedb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:43.189706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1152/2282] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:33:43.218864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f3aec0b3-c4c0-460c-874a-a6840eefedb0 None None] MFA Rules not processed for user `159a9ad89fcb44858499dc7679abe481`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:43.221585 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f3aec0b3-c4c0-460c-874a-a6840eefedb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:43.312584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1131/2283] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:43.510928 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76355464-9c6a-4487-a13c-1a7a0e8ef531 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:43.531366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76355464-9c6a-4487-a13c-1a7a0e8ef531 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:43.537501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed9864-0782-4749-8742-29427c8fb477 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c841f03880c4fb1b402bac6ecce25fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:43.537501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9864-0782-4749-8742-29427c8fb477 service glance] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:43.537501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9864-0782-4749-8742-29427c8fb477 service glance] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:43.537501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9864-0782-4749-8742-29427c8fb477 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:43.540172 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dbed9864-0782-4749-8742-29427c8fb477 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:43.637924 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed9864-0782-4749-8742-29427c8fb477 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:43.642673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed9864-0782-4749-8742-29427c8fb477 service glance] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:43.655370 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1153/2284] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:44.090960 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:44.247477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814fb63-0358-4dc4-a3ce-2c5a93bcd89e None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:44.248138 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814fb63-0358-4dc4-a3ce-2c5a93bcd89e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:44.248661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814fb63-0358-4dc4-a3ce-2c5a93bcd89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:44.290877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-c814fb63-0358-4dc4-a3ce-2c5a93bcd89e None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:44.292234 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c814fb63-0358-4dc4-a3ce-2c5a93bcd89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:44.409389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1132/2285] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:33:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:44.484135 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed9864-0782-4749-8742-29427c8fb477 service glance] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:44.487579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dbed9864-0782-4749-8742-29427c8fb477 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:44.508070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:44.616268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed9864-0782-4749-8742-29427c8fb477 service glance] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:44.686534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb7d1b-2fa4-45bc-ab43-62835b1b92c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:44.688351 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb7d1b-2fa4-45bc-ab43-62835b1b92c7 service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:44.693230 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb7d1b-2fa4-45bc-ab43-62835b1b92c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:44.693230 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb7d1b-2fa4-45bc-ab43-62835b1b92c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:44.711001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb7d1b-2fa4-45bc-ab43-62835b1b92c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:44.716827 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb7d1b-2fa4-45bc-ab43-62835b1b92c7 service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:44.746089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1154/2286] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:33:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:33:47.782495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1874244-939c-49b4-be6f-c86287d4e683 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:47.783432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1874244-939c-49b4-be6f-c86287d4e683 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:47.787074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1874244-939c-49b4-be6f-c86287d4e683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:47.827954 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a1874244-939c-49b4-be6f-c86287d4e683 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:47.829390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a1874244-939c-49b4-be6f-c86287d4e683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:48.042838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1133/2287] 10.222.0.117 () {58 vars in 1017 bytes} [Mon Aug 29 20:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:48.116720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb7d1b-2fa4-45bc-ab43-62835b1b92c7 service swift] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:48.121177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4bcb7d1b-2fa4-45bc-ab43-62835b1b92c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:48.131094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:48.252177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb7d1b-2fa4-45bc-ab43-62835b1b92c7 service swift] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:48.262291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc7b8-4ebd-4701-9764-21d5eb524f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:48.263229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc7b8-4ebd-4701-9764-21d5eb524f34 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:48.263725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc7b8-4ebd-4701-9764-21d5eb524f34 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:48.264273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc7b8-4ebd-4701-9764-21d5eb524f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:48.280278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc7b8-4ebd-4701-9764-21d5eb524f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:48.283472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc7b8-4ebd-4701-9764-21d5eb524f34 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:48.311275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1155/2288] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:33:48.645333 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:51.382124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:51.490973 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:52.113738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:52.281151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:54.746603 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:54.833658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:56.064083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1874244-939c-49b4-be6f-c86287d4e683 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:56.065862 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a1874244-939c-49b4-be6f-c86287d4e683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:56.178213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1874244-939c-49b4-be6f-c86287d4e683 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:56.184689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef40890-62cb-4c13-a835-3992a6b0978d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:56.186096 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef40890-62cb-4c13-a835-3992a6b0978d service placement] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:56.186959 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef40890-62cb-4c13-a835-3992a6b0978d service placement] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:56.187405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef40890-62cb-4c13-a835-3992a6b0978d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:56.189997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bef40890-62cb-4c13-a835-3992a6b0978d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:56.190428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68d480-2368-4a06-a023-24d30774476c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:56.190984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68d480-2368-4a06-a023-24d30774476c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:56.190984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68d480-2368-4a06-a023-24d30774476c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:56.205783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef40890-62cb-4c13-a835-3992a6b0978d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:56.207638 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef40890-62cb-4c13-a835-3992a6b0978d service placement] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:56.224464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1134/2289] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:56.229132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3b68d480-2368-4a06-a023-24d30774476c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:56.230670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3b68d480-2368-4a06-a023-24d30774476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:56.243859 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1156/2290] 10.222.0.117 () {58 vars in 1017 bytes} [Mon Aug 29 20:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:56.343355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:56.343355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef40890-62cb-4c13-a835-3992a6b0978d service placement] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:56.343355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bef40890-62cb-4c13-a835-3992a6b0978d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:56.371957 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef40890-62cb-4c13-a835-3992a6b0978d service placement] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:56.378530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ad286-4462-4cae-a061-d93c258ac0dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:56.379381 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ad286-4462-4cae-a061-d93c258ac0dc service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:56.379752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ad286-4462-4cae-a061-d93c258ac0dc service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:56.380071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ad286-4462-4cae-a061-d93c258ac0dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:56.391144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ad286-4462-4cae-a061-d93c258ac0dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:56.393413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ad286-4462-4cae-a061-d93c258ac0dc service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:56.410427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1135/2291] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:56.697777 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:58.400825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:59.222992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:59.576230 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fa9c7-cd18-4afd-968a-d16a510c9718 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:59.576513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fa9c7-cd18-4afd-968a-d16a510c9718 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:59.576789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fa9c7-cd18-4afd-968a-d16a510c9718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:59.597616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a04fa9c7-cd18-4afd-968a-d16a510c9718 None None] MFA Rules not processed for user `d03b0800204f4b70b33f35b4b3468d52`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:59.599243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a04fa9c7-cd18-4afd-968a-d16a510c9718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:59.608448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1157/2292] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:33:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:00.066293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:00.239223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:00.822999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:00.958840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:01.073923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:01.229942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:02.560426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:02.890866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:03.645397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:04.019242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560fab8-ca18-4561-b0cf-2b892bc16720 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:04.019809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560fab8-ca18-4561-b0cf-2b892bc16720 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:04.019809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560fab8-ca18-4561-b0cf-2b892bc16720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:04.026311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:04.048600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-4560fab8-ca18-4561-b0cf-2b892bc16720 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:04.050097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4560fab8-ca18-4561-b0cf-2b892bc16720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:04.061982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1136/2293] 10.222.0.117 () {58 vars in 1017 bytes} [Mon Aug 29 20:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:34:04.091563 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fa9c7-cd18-4afd-968a-d16a510c9718 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:04.107403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fa9c7-cd18-4afd-968a-d16a510c9718 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:04.117909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b66c8-44a4-4620-8974-452951ee719e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:04.118904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b66c8-44a4-4620-8974-452951ee719e service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:04.119191 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b66c8-44a4-4620-8974-452951ee719e service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:04.119469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b66c8-44a4-4620-8974-452951ee719e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:04.129753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b66c8-44a4-4620-8974-452951ee719e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:04.131770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b66c8-44a4-4620-8974-452951ee719e service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:04.145627 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1158/2294] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:04.887819 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffef24-2952-4d56-830b-73cb43c32b07 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:04.888104 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffef24-2952-4d56-830b-73cb43c32b07 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:04.888382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffef24-2952-4d56-830b-73cb43c32b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:04.908618 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-8dffef24-2952-4d56-830b-73cb43c32b07 None None] MFA Rules not processed for user `948542e68a5c499681d5faf8507cebe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:04.909922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8dffef24-2952-4d56-830b-73cb43c32b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:04.928612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:04.993614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1137/2295] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:05.148258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:06.355270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:06.759643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:08.582645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:08.747984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:09.827968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9959-af59-4d30-90f0-7d6b2cb5df13 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:09.827968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9959-af59-4d30-90f0-7d6b2cb5df13 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:09.827968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9959-af59-4d30-90f0-7d6b2cb5df13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:09.895032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-303d9959-af59-4d30-90f0-7d6b2cb5df13 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:09.896311 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-303d9959-af59-4d30-90f0-7d6b2cb5df13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:09.918451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1159/2296] 10.222.0.117 () {58 vars in 1017 bytes} [Mon Aug 29 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:09.969369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffef24-2952-4d56-830b-73cb43c32b07 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:09.985787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffef24-2952-4d56-830b-73cb43c32b07 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:09.991956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb651d06-c7d1-4a98-adbc-6a5a7b10a18d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:09.993069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb651d06-c7d1-4a98-adbc-6a5a7b10a18d service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:09.993560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb651d06-c7d1-4a98-adbc-6a5a7b10a18d service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:09.994021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb651d06-c7d1-4a98-adbc-6a5a7b10a18d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:10.004977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb651d06-c7d1-4a98-adbc-6a5a7b10a18d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:10.006849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb651d06-c7d1-4a98-adbc-6a5a7b10a18d service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:10.019438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1138/2297] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:10.097555 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:10.531321 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:11.588792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:11.726126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:12.616659 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:13.032843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:13.704310 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:13.706182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d02c1-04f0-431f-b3c5-5738e1d2806d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:13.706807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d02c1-04f0-431f-b3c5-5738e1d2806d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:13.709599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d02c1-04f0-431f-b3c5-5738e1d2806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:13.732735 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6a1d02c1-04f0-431f-b3c5-5738e1d2806d None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:13.738360 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6a1d02c1-04f0-431f-b3c5-5738e1d2806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:13.743901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1160/2298] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:34:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:13.767668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb651d06-c7d1-4a98-adbc-6a5a7b10a18d service nova] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:13.782895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb651d06-c7d1-4a98-adbc-6a5a7b10a18d service nova] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:13.789260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849765d-e966-4804-ad11-c9758c453964 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:13.789904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849765d-e966-4804-ad11-c9758c453964 service swift] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:13.790190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849765d-e966-4804-ad11-c9758c453964 service swift] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:13.790512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849765d-e966-4804-ad11-c9758c453964 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:13.800452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849765d-e966-4804-ad11-c9758c453964 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:13.802009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849765d-e966-4804-ad11-c9758c453964 service swift] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:13.816684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1139/2299] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:34:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:34:14.039707 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:15.835358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:16.062185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:17.440352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d02c1-04f0-431f-b3c5-5738e1d2806d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:17.441826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6a1d02c1-04f0-431f-b3c5-5738e1d2806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:17.476502 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d02c1-04f0-431f-b3c5-5738e1d2806d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:17.483737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:17.487266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.487266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.487266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] PATH_INFO: `/v3/users/be3ab140c72d4d59b1de82718c02513e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.487266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be3ab140c72d4d59b1de82718c02513e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:17.488458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:17.824359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3ab140c72d4d59b1de82718c02513e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:17.850293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3ab140c72d4d59b1de82718c02513e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:17.851165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3ab140c72d4d59b1de82718c02513e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:17.851694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3ab140c72d4d59b1de82718c02513e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:17.870468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3ab140c72d4d59b1de82718c02513e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:17.984802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1161/2300] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:17 2022] DELETE /identity/v3/users/be3ab140c72d4d59b1de82718c02513e => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:17.989168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ae8d4-c341-404b-9236-93e0b4bec721 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.989634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ae8d4-c341-404b-9236-93e0b4bec721 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.989727 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ae8d4-c341-404b-9236-93e0b4bec721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:18.038696 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d64ae8d4-c341-404b-9236-93e0b4bec721 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:18.040703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d64ae8d4-c341-404b-9236-93e0b4bec721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:18.138673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1140/2301] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:18.150138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:18.152512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:18.230524 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb65fd-1938-4b2e-abbc-ffb2f2e0a969 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:18.233466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:18.235555 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57606949-a2fe-4a70-b166-fb5b83853b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:18.236298 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57606949-a2fe-4a70-b166-fb5b83853b58 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:18.236589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57606949-a2fe-4a70-b166-fb5b83853b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:18.236862 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57606949-a2fe-4a70-b166-fb5b83853b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:18.247617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57606949-a2fe-4a70-b166-fb5b83853b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:18.249185 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57606949-a2fe-4a70-b166-fb5b83853b58 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:18.260535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1162/2302] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:18.937695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ae8d4-c341-404b-9236-93e0b4bec721 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:18.943108 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d64ae8d4-c341-404b-9236-93e0b4bec721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:18.955210 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ae8d4-c341-404b-9236-93e0b4bec721 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:18.964856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:18.965780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:18.966546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:18.967216 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d admin admin] PATH_INFO: `/v3/projects/83635d022c6c466b8873e5338ad65c2e` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:18.969288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=83635d022c6c466b8873e5338ad65c2e)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:18.973497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:19.160327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83635d022c6c466b8873e5338ad65c2e', 'request_id': 'req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.170329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83635d022c6c466b8873e5338ad65c2e', 'request_id': 'req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.179809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83635d022c6c466b8873e5338ad65c2e', 'request_id': 'req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.327612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d admin admin] The token cache is being invalidate because project 83635d022c6c466b8873e5338ad65c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:19.327612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.327612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-493c53bd-b6f3-47ad-83a3-f6dee7b91e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.327612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1141/2303] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:18 2022] DELETE /identity/v3/projects/83635d022c6c466b8873e5338ad65c2e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:19.333079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85364650-ceca-43be-8e8c-e6b7a791ce50 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:19.333974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85364650-ceca-43be-8e8c-e6b7a791ce50 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:19.333974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85364650-ceca-43be-8e8c-e6b7a791ce50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:19.407136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-85364650-ceca-43be-8e8c-e6b7a791ce50 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:19.409793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-85364650-ceca-43be-8e8c-e6b7a791ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:19.503968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1163/2304] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:19.516174 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c6431-8b57-47f0-a140-2624135c70b1 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:19.516647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c6431-8b57-47f0-a140-2624135c70b1 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:19.517024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c6431-8b57-47f0-a140-2624135c70b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:19.542717 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d53c6431-8b57-47f0-a140-2624135c70b1 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:19.543942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d53c6431-8b57-47f0-a140-2624135c70b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:19.562714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1142/2305] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:19.563019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85364650-ceca-43be-8e8c-e6b7a791ce50 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:19.578919 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85364650-ceca-43be-8e8c-e6b7a791ce50 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:19.594488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f4458-64d3-420a-b25c-b523d777c9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:19.603243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f4458-64d3-420a-b25c-b523d777c9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:19.603243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f4458-64d3-420a-b25c-b523d777c9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:19.603243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f4458-64d3-420a-b25c-b523d777c9b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:19.603243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f4458-64d3-420a-b25c-b523d777c9b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:34:19.603243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f4458-64d3-420a-b25c-b523d777c9b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:19.603243 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f4458-64d3-420a-b25c-b523d777c9b8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:19.622276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1164/2306] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:34:19.627530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c6431-8b57-47f0-a140-2624135c70b1 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:19.639828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c6431-8b57-47f0-a140-2624135c70b1 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:19.646579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2d758-d12b-49e3-b581-22a996ff6d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:19.647203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2d758-d12b-49e3-b581-22a996ff6d97 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:19.647487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2d758-d12b-49e3-b581-22a996ff6d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:19.647766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2d758-d12b-49e3-b581-22a996ff6d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:19.648456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2d758-d12b-49e3-b581-22a996ff6d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:19.652063 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2d758-d12b-49e3-b581-22a996ff6d97 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:19.665308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:19.884260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1143/2307] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:19 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:19.885640 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f4458-64d3-420a-b25c-b523d777c9b8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:19.906290 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f4458-64d3-420a-b25c-b523d777c9b8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:20.011981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f6e6-77e6-45c9-a2e3-ff9f043f9f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:20.012872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f6e6-77e6-45c9-a2e3-ff9f043f9f04 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.013156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f6e6-77e6-45c9-a2e3-ff9f043f9f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.013430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f6e6-77e6-45c9-a2e3-ff9f043f9f04 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.031400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5f6e6-77e6-45c9-a2e3-ff9f043f9f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:20.033850 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5f6e6-77e6-45c9-a2e3-ff9f043f9f04 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:20.136597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1165/2308] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:19 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:34:20.142821 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2d758-d12b-49e3-b581-22a996ff6d97 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:20.169476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2d758-d12b-49e3-b581-22a996ff6d97 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:20.176655 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890fc86-3060-4469-a234-50619840a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:20.177578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890fc86-3060-4469-a234-50619840a461 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.177935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890fc86-3060-4469-a234-50619840a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.178347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890fc86-3060-4469-a234-50619840a461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.179335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890fc86-3060-4469-a234-50619840a461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:20.181540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890fc86-3060-4469-a234-50619840a461 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:20.200523 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1144/2309] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:20.202766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f6e6-77e6-45c9-a2e3-ff9f043f9f04 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:20.223508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f6e6-77e6-45c9-a2e3-ff9f043f9f04 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:20.229624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26f707-1754-47fc-960f-82e9ef503be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:20.230264 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26f707-1754-47fc-960f-82e9ef503be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.230546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26f707-1754-47fc-960f-82e9ef503be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.230814 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26f707-1754-47fc-960f-82e9ef503be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.231521 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26f707-1754-47fc-960f-82e9ef503be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:20.236528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26f707-1754-47fc-960f-82e9ef503be3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:20.255926 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1166/2310] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:34:20.261159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890fc86-3060-4469-a234-50619840a461 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:20.297010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890fc86-3060-4469-a234-50619840a461 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:20.297010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecfa2e-e48a-4768-ada8-b6631ed7b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:20.297010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecfa2e-e48a-4768-ada8-b6631ed7b7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.297010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecfa2e-e48a-4768-ada8-b6631ed7b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.297462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecfa2e-e48a-4768-ada8-b6631ed7b7ce admin admin] PATH_INFO: `/v3/projects/5afc19a3103244c0bd58116e92d45f84/users/2d8a2063148a4f4c8d040ab903d42217/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.319271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecfa2e-e48a-4768-ada8-b6631ed7b7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afc19a3103244c0bd58116e92d45f84, user_id=2d8a2063148a4f4c8d040ab903d42217, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:20.323265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecfa2e-e48a-4768-ada8-b6631ed7b7ce admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:20.445105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1145/2311] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:20 2022] PUT /identity/v3/projects/5afc19a3103244c0bd58116e92d45f84/users/2d8a2063148a4f4c8d040ab903d42217/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:20.456134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019485a-ae2b-4d9a-b358-5340e1d11fc0 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.456725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019485a-ae2b-4d9a-b358-5340e1d11fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.456725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019485a-ae2b-4d9a-b358-5340e1d11fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.492420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9019485a-ae2b-4d9a-b358-5340e1d11fc0 None None] MFA Rules not processed for user `2d8a2063148a4f4c8d040ab903d42217`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:20.496044 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9019485a-ae2b-4d9a-b358-5340e1d11fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:20.557131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:20.612351 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1167/2312] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:20.621791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecfa2e-e48a-4768-ada8-b6631ed7b7ce admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:20.625851 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e6ecfa2e-e48a-4768-ada8-b6631ed7b7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:20.732704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecfa2e-e48a-4768-ada8-b6631ed7b7ce admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:20.738426 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090298a1-8feb-470c-9499-85bc44f6c7b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:20.739097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090298a1-8feb-470c-9499-85bc44f6c7b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.739369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090298a1-8feb-470c-9499-85bc44f6c7b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.739623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090298a1-8feb-470c-9499-85bc44f6c7b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.753635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090298a1-8feb-470c-9499-85bc44f6c7b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:20.755919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090298a1-8feb-470c-9499-85bc44f6c7b6 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:20.771855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1146/2313] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:23.789849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d393bd-5275-41b0-a2b4-570558b92a73 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:23.790538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d393bd-5275-41b0-a2b4-570558b92a73 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:23.790538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d393bd-5275-41b0-a2b4-570558b92a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:23.810368 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-73d393bd-5275-41b0-a2b4-570558b92a73 None None] MFA Rules not processed for user `2d8a2063148a4f4c8d040ab903d42217`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:23.812010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-73d393bd-5275-41b0-a2b4-570558b92a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:23.819572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1168/2314] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:28.711431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090298a1-8feb-470c-9499-85bc44f6c7b6 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:28.712982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-090298a1-8feb-470c-9499-85bc44f6c7b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:28.834677 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090298a1-8feb-470c-9499-85bc44f6c7b6 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:28.840658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:28.841317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:28.841601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:28.841877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] PATH_INFO: `/v3/users/2808e70495d74e7db13aed3848f3e646` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:28.843303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2808e70495d74e7db13aed3848f3e646)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:28.845346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:29.132139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2808e70495d74e7db13aed3848f3e646'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:29.142972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2808e70495d74e7db13aed3848f3e646'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:29.143765 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2808e70495d74e7db13aed3848f3e646'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:29.148119 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:29.245489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2808e70495d74e7db13aed3848f3e646'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:29.270371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2808e70495d74e7db13aed3848f3e646'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:29.281383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1147/2315] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:28 2022] DELETE /identity/v3/users/2808e70495d74e7db13aed3848f3e646 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:29.288458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ab10b-9df8-4470-a82a-87e9f81a2528 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:29.291808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ab10b-9df8-4470-a82a-87e9f81a2528 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:29.291808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ab10b-9df8-4470-a82a-87e9f81a2528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:29.323808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f82ab10b-9df8-4470-a82a-87e9f81a2528 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:29.326205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f82ab10b-9df8-4470-a82a-87e9f81a2528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:29.421889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1169/2316] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:29.433008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:29.434994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:29.513276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d9364-b839-4766-a6e0-14885386dfc5 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:29.516950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85de438-7017-4ff9-abac-bbbbdc0e08a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:29.517668 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de438-7017-4ff9-abac-bbbbdc0e08a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:29.517962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de438-7017-4ff9-abac-bbbbdc0e08a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:29.518305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de438-7017-4ff9-abac-bbbbdc0e08a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:29.534658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85de438-7017-4ff9-abac-bbbbdc0e08a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:29.536466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85de438-7017-4ff9-abac-bbbbdc0e08a6 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:29.547720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1148/2317] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:30.184270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ab10b-9df8-4470-a82a-87e9f81a2528 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:30.186856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f82ab10b-9df8-4470-a82a-87e9f81a2528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:30.207748 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ab10b-9df8-4470-a82a-87e9f81a2528 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:30.219993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74c37f-1f2d-454b-a23f-f4363960bad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:30.219993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74c37f-1f2d-454b-a23f-f4363960bad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:30.219993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74c37f-1f2d-454b-a23f-f4363960bad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:30.219993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74c37f-1f2d-454b-a23f-f4363960bad7 admin admin] PATH_INFO: `/v3/projects/191de4740f4e4397b00788072347ac2e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:30.220774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74c37f-1f2d-454b-a23f-f4363960bad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=191de4740f4e4397b00788072347ac2e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:30.221601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74c37f-1f2d-454b-a23f-f4363960bad7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:30.359949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f74c37f-1f2d-454b-a23f-f4363960bad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191de4740f4e4397b00788072347ac2e', 'request_id': 'req-7f74c37f-1f2d-454b-a23f-f4363960bad7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.367033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f74c37f-1f2d-454b-a23f-f4363960bad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191de4740f4e4397b00788072347ac2e', 'request_id': 'req-7f74c37f-1f2d-454b-a23f-f4363960bad7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.434238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f74c37f-1f2d-454b-a23f-f4363960bad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191de4740f4e4397b00788072347ac2e', 'request_id': 'req-7f74c37f-1f2d-454b-a23f-f4363960bad7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.447618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f74c37f-1f2d-454b-a23f-f4363960bad7 admin admin] The token cache is being invalidate because project 191de4740f4e4397b00788072347ac2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:30.447960 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f74c37f-1f2d-454b-a23f-f4363960bad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.448992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f74c37f-1f2d-454b-a23f-f4363960bad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.455114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1170/2318] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:30 2022] DELETE /identity/v3/projects/191de4740f4e4397b00788072347ac2e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:34:30.456657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53525-53a4-44b0-8830-d4391e5db8c2 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:30.465336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53525-53a4-44b0-8830-d4391e5db8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:30.465336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53525-53a4-44b0-8830-d4391e5db8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:30.484057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6ba53525-53a4-44b0-8830-d4391e5db8c2 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:30.485847 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6ba53525-53a4-44b0-8830-d4391e5db8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:30.574280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1149/2319] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:30.587206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750407d-b1cc-410d-b04f-7f1747e225a9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:30.587542 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750407d-b1cc-410d-b04f-7f1747e225a9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:30.587761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750407d-b1cc-410d-b04f-7f1747e225a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:30.608126 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3750407d-b1cc-410d-b04f-7f1747e225a9 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:30.609262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3750407d-b1cc-410d-b04f-7f1747e225a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:30.617337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1171/2320] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:30.622435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba53525-53a4-44b0-8830-d4391e5db8c2 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:30.632459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba53525-53a4-44b0-8830-d4391e5db8c2 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:30.638290 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a478193-a5fc-4cda-b89e-08475397eba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:30.638901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a478193-a5fc-4cda-b89e-08475397eba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:30.639184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a478193-a5fc-4cda-b89e-08475397eba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:30.639456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a478193-a5fc-4cda-b89e-08475397eba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:30.640113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a478193-a5fc-4cda-b89e-08475397eba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:34:30.640414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a478193-a5fc-4cda-b89e-08475397eba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:30.642005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a478193-a5fc-4cda-b89e-08475397eba4 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:30.655888 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1150/2321] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:34:30.660353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750407d-b1cc-410d-b04f-7f1747e225a9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:30.671315 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750407d-b1cc-410d-b04f-7f1747e225a9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:30.676240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3854a-3e41-496a-a05f-1da280d334f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:30.676982 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3854a-3e41-496a-a05f-1da280d334f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:30.677338 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3854a-3e41-496a-a05f-1da280d334f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:30.677605 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3854a-3e41-496a-a05f-1da280d334f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:30.678271 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3854a-3e41-496a-a05f-1da280d334f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:30.680214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3854a-3e41-496a-a05f-1da280d334f6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:30.828940 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1172/2322] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:30 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:34:30.833291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a478193-a5fc-4cda-b89e-08475397eba4 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:30.845934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a478193-a5fc-4cda-b89e-08475397eba4 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:30.936986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c4c69-1185-467e-9d2e-81d1b4c13c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:30.942198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c4c69-1185-467e-9d2e-81d1b4c13c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:30.942198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c4c69-1185-467e-9d2e-81d1b4c13c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:30.942198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c4c69-1185-467e-9d2e-81d1b4c13c31 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:30.942198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c4c69-1185-467e-9d2e-81d1b4c13c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:30.942198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c4c69-1185-467e-9d2e-81d1b4c13c31 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:30.954908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:31.032355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1151/2323] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:30 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:34:31.036508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3854a-3e41-496a-a05f-1da280d334f6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:31.049989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3854a-3e41-496a-a05f-1da280d334f6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:31.055000 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d20f8-8720-403e-9a1e-df42a75d29f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:31.055934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d20f8-8720-403e-9a1e-df42a75d29f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.056087 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d20f8-8720-403e-9a1e-df42a75d29f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.056363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d20f8-8720-403e-9a1e-df42a75d29f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.057020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d20f8-8720-403e-9a1e-df42a75d29f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:31.058665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d20f8-8720-403e-9a1e-df42a75d29f7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:31.078371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1173/2324] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:34:31.083926 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c4c69-1185-467e-9d2e-81d1b4c13c31 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:31.095861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c4c69-1185-467e-9d2e-81d1b4c13c31 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:31.101397 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e0b7-3f69-44f3-a0a4-9398e10c77d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:31.102082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e0b7-3f69-44f3-a0a4-9398e10c77d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.102356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e0b7-3f69-44f3-a0a4-9398e10c77d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.102634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e0b7-3f69-44f3-a0a4-9398e10c77d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.103294 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221e0b7-3f69-44f3-a0a4-9398e10c77d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:31.104931 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221e0b7-3f69-44f3-a0a4-9398e10c77d7 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:31.116948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1152/2325] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:31.122544 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d20f8-8720-403e-9a1e-df42a75d29f7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:31.136549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d20f8-8720-403e-9a1e-df42a75d29f7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:31.143522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a19424-3a89-4545-a2c6-acdf3e06cbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:31.143522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a19424-3a89-4545-a2c6-acdf3e06cbb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.143522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a19424-3a89-4545-a2c6-acdf3e06cbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.143522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a19424-3a89-4545-a2c6-acdf3e06cbb6 admin admin] PATH_INFO: `/v3/projects/bb931f1cbf744180b50f1b95f341c2ce/users/79c6abf0d03c4834827f723d618a92dd/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.160725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a19424-3a89-4545-a2c6-acdf3e06cbb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb931f1cbf744180b50f1b95f341c2ce, user_id=79c6abf0d03c4834827f723d618a92dd, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:31.163499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a19424-3a89-4545-a2c6-acdf3e06cbb6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:31.167842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:31.256923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1174/2326] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:31 2022] PUT /identity/v3/projects/bb931f1cbf744180b50f1b95f341c2ce/users/79c6abf0d03c4834827f723d618a92dd/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:31.268163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d45bf-d6a8-481c-bf75-1c5316306fda None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.268458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d45bf-d6a8-481c-bf75-1c5316306fda None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.268711 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d45bf-d6a8-481c-bf75-1c5316306fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.300776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-925d45bf-d6a8-481c-bf75-1c5316306fda None None] MFA Rules not processed for user `79c6abf0d03c4834827f723d618a92dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:31.302062 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-925d45bf-d6a8-481c-bf75-1c5316306fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:31.375665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1153/2327] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:31.380393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a19424-3a89-4545-a2c6-acdf3e06cbb6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:31.448238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a19424-3a89-4545-a2c6-acdf3e06cbb6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:31.453147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edba34-c252-407b-af18-f79876d13eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:31.453760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edba34-c252-407b-af18-f79876d13eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.454040 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edba34-c252-407b-af18-f79876d13eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.454445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edba34-c252-407b-af18-f79876d13eb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.455108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edba34-c252-407b-af18-f79876d13eb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:31.457061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edba34-c252-407b-af18-f79876d13eb8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:31.595597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1175/2328] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:31 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:31.597028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d45bf-d6a8-481c-bf75-1c5316306fda None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:31.621538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d45bf-d6a8-481c-bf75-1c5316306fda None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:31.749216 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd948d-7cca-4733-ac72-240eb251cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:31.751147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd948d-7cca-4733-ac72-240eb251cb39 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.751941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd948d-7cca-4733-ac72-240eb251cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.751941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd948d-7cca-4733-ac72-240eb251cb39 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.752550 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd948d-7cca-4733-ac72-240eb251cb39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:31.756123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd948d-7cca-4733-ac72-240eb251cb39 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:31.945373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1154/2329] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:31 2022] POST /identity/v3/users => generated 288 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:31.947710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edba34-c252-407b-af18-f79876d13eb8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:31.961845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edba34-c252-407b-af18-f79876d13eb8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:31.967019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524bd39-4dbe-4748-848a-69f41edd0052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:31.967684 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524bd39-4dbe-4748-848a-69f41edd0052 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.967944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524bd39-4dbe-4748-848a-69f41edd0052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.968222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524bd39-4dbe-4748-848a-69f41edd0052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.968975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524bd39-4dbe-4748-848a-69f41edd0052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:31.970892 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524bd39-4dbe-4748-848a-69f41edd0052 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:31.987372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1176/2330] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:31.988624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd948d-7cca-4733-ac72-240eb251cb39 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.001570 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd948d-7cca-4733-ac72-240eb251cb39 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.010020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1f38e-e751-44d7-a2c0-37c155d2476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.011280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1f38e-e751-44d7-a2c0-37c155d2476b admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.011909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1f38e-e751-44d7-a2c0-37c155d2476b admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.012732 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1f38e-e751-44d7-a2c0-37c155d2476b admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.014074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1f38e-e751-44d7-a2c0-37c155d2476b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.034825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1f38e-e751-44d7-a2c0-37c155d2476b admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.059123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1155/2331] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:32.063745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524bd39-4dbe-4748-848a-69f41edd0052 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.087174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524bd39-4dbe-4748-848a-69f41edd0052 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.094151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc24cd-2402-45d3-9100-2114748f3470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.095002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc24cd-2402-45d3-9100-2114748f3470 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.095391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc24cd-2402-45d3-9100-2114748f3470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.095771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc24cd-2402-45d3-9100-2114748f3470 admin admin] PATH_INFO: `/v3/projects/7ed4d114cdb04dcea6e175931c35b76b/users/1064959f6cf3405dab2c32cd8c9bafc0/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.120645 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc24cd-2402-45d3-9100-2114748f3470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed4d114cdb04dcea6e175931c35b76b, user_id=1064959f6cf3405dab2c32cd8c9bafc0, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.123846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc24cd-2402-45d3-9100-2114748f3470 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.252691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1177/2332] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:32 2022] PUT /identity/v3/projects/7ed4d114cdb04dcea6e175931c35b76b/users/1064959f6cf3405dab2c32cd8c9bafc0/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:34:32.331100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c5e27-8cf2-41e0-bd34-ecc697ee9b02 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.331388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c5e27-8cf2-41e0-bd34-ecc697ee9b02 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.331737 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c5e27-8cf2-41e0-bd34-ecc697ee9b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.386410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-cb9c5e27-8cf2-41e0-bd34-ecc697ee9b02 None None] MFA Rules not processed for user `1064959f6cf3405dab2c32cd8c9bafc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:32.391503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-cb9c5e27-8cf2-41e0-bd34-ecc697ee9b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:32.463750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:32.496110 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1156/2333] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:32.500870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc24cd-2402-45d3-9100-2114748f3470 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.546881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119f4f-56cd-4865-a0bd-21cfde8051ed None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.547562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119f4f-56cd-4865-a0bd-21cfde8051ed None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.554699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119f4f-56cd-4865-a0bd-21cfde8051ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.607794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-b6119f4f-56cd-4865-a0bd-21cfde8051ed None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:32.614591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b6119f4f-56cd-4865-a0bd-21cfde8051ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:32.694522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc24cd-2402-45d3-9100-2114748f3470 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.700318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1157/2334] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:34:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:32.704161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc0215-ad5b-4119-b1dd-f265e1f0c079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.705624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc0215-ad5b-4119-b1dd-f265e1f0c079 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.705624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc0215-ad5b-4119-b1dd-f265e1f0c079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.705770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc0215-ad5b-4119-b1dd-f265e1f0c079 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.707207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc0215-ad5b-4119-b1dd-f265e1f0c079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.709880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc0215-ad5b-4119-b1dd-f265e1f0c079 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.716590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119f4f-56cd-4865-a0bd-21cfde8051ed None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.719871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b6119f4f-56cd-4865-a0bd-21cfde8051ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:32.853611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1178/2335] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:32 2022] POST /identity/v3/projects => generated 377 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:32.857806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc0215-ad5b-4119-b1dd-f265e1f0c079 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.862963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119f4f-56cd-4865-a0bd-21cfde8051ed None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.919851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:32.995262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc0215-ad5b-4119-b1dd-f265e1f0c079 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:33.000191 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45deaf-dd72-4f48-a981-4e2549b314fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:33.000840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45deaf-dd72-4f48-a981-4e2549b314fc service swift] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:33.001120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45deaf-dd72-4f48-a981-4e2549b314fc service swift] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:33.001394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45deaf-dd72-4f48-a981-4e2549b314fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:33.009525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9fa5b-188c-4e7d-a2e1-bb6b7ae3e200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:33.011058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9fa5b-188c-4e7d-a2e1-bb6b7ae3e200 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:33.011058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9fa5b-188c-4e7d-a2e1-bb6b7ae3e200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:33.011058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9fa5b-188c-4e7d-a2e1-bb6b7ae3e200 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:33.011412 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9fa5b-188c-4e7d-a2e1-bb6b7ae3e200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:33.013669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9fa5b-188c-4e7d-a2e1-bb6b7ae3e200 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:33.054085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:33.097508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45deaf-dd72-4f48-a981-4e2549b314fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:33.099746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45deaf-dd72-4f48-a981-4e2549b314fc service swift] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:33.109457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1179/2336] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:32 2022] POST /identity/v3/users => generated 295 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:33.111303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9fa5b-188c-4e7d-a2e1-bb6b7ae3e200 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:33.119559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1158/2337] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:34:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:34:33.123368 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9fa5b-188c-4e7d-a2e1-bb6b7ae3e200 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:33.129013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697d5c1-709e-4a09-9028-471f03d2dd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:33.130417 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697d5c1-709e-4a09-9028-471f03d2dd9d admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:33.130768 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697d5c1-709e-4a09-9028-471f03d2dd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:33.131261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697d5c1-709e-4a09-9028-471f03d2dd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:33.132072 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697d5c1-709e-4a09-9028-471f03d2dd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:33.134648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697d5c1-709e-4a09-9028-471f03d2dd9d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:33.147487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1180/2338] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:33.165250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45deaf-dd72-4f48-a981-4e2549b314fc service swift] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:33.193098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45deaf-dd72-4f48-a981-4e2549b314fc service swift] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:33.207156 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84569803-0a05-44b4-8346-9fcb4445c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:33.213072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84569803-0a05-44b4-8346-9fcb4445c6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:33.215136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84569803-0a05-44b4-8346-9fcb4445c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:33.218299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84569803-0a05-44b4-8346-9fcb4445c6b7 admin admin] PATH_INFO: `/v3/projects/01341dacec5144339dbe54bff1e73f0c/users/ac8e67c7eb2643a19de0dfb3a321acf3/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:33.254783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84569803-0a05-44b4-8346-9fcb4445c6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01341dacec5144339dbe54bff1e73f0c, user_id=ac8e67c7eb2643a19de0dfb3a321acf3, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:33.261270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84569803-0a05-44b4-8346-9fcb4445c6b7 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:33.379101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1159/2339] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:33 2022] PUT /identity/v3/projects/01341dacec5144339dbe54bff1e73f0c/users/ac8e67c7eb2643a19de0dfb3a321acf3/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:33.383702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697d5c1-709e-4a09-9028-471f03d2dd9d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:33.400546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697d5c1-709e-4a09-9028-471f03d2dd9d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:33.573655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9a3c8-94c6-4141-a9bf-98a3c8975cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:33.574430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9a3c8-94c6-4141-a9bf-98a3c8975cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:33.574733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9a3c8-94c6-4141-a9bf-98a3c8975cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:33.575097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9a3c8-94c6-4141-a9bf-98a3c8975cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:33.576654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9a3c8-94c6-4141-a9bf-98a3c8975cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:33.578703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9a3c8-94c6-4141-a9bf-98a3c8975cb4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:33.605402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84569803-0a05-44b4-8346-9fcb4445c6b7 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:33.620952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1181/2340] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:33.684886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84569803-0a05-44b4-8346-9fcb4445c6b7 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:33.701561 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794bf81-7a2c-4e68-934b-bd16a1b8f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:33.703964 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794bf81-7a2c-4e68-934b-bd16a1b8f54a admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:33.705774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794bf81-7a2c-4e68-934b-bd16a1b8f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:33.706427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794bf81-7a2c-4e68-934b-bd16a1b8f54a admin admin] PATH_INFO: `/v3/projects/01341dacec5144339dbe54bff1e73f0c/users/ac8e67c7eb2643a19de0dfb3a321acf3/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:33.709655 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794bf81-7a2c-4e68-934b-bd16a1b8f54a admin admin] RBAC: Authorizing `identity:create_grant(project_id=01341dacec5144339dbe54bff1e73f0c, user_id=ac8e67c7eb2643a19de0dfb3a321acf3, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:33.715252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794bf81-7a2c-4e68-934b-bd16a1b8f54a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:33.733441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1160/2341] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:33 2022] PUT /identity/v3/projects/01341dacec5144339dbe54bff1e73f0c/users/ac8e67c7eb2643a19de0dfb3a321acf3/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:33.748878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd7ade-a6e7-4ea5-b199-9a1a646d9085 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:33.749169 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd7ade-a6e7-4ea5-b199-9a1a646d9085 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:33.749451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd7ade-a6e7-4ea5-b199-9a1a646d9085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:33.849408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c8fd7ade-a6e7-4ea5-b199-9a1a646d9085 None None] MFA Rules not processed for user `ac8e67c7eb2643a19de0dfb3a321acf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:33.881538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c8fd7ade-a6e7-4ea5-b199-9a1a646d9085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:34.018578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1182/2342] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:34.028101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794bf81-7a2c-4e68-934b-bd16a1b8f54a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:34.031154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6794bf81-7a2c-4e68-934b-bd16a1b8f54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:34.171376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794bf81-7a2c-4e68-934b-bd16a1b8f54a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:34.179124 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba93db-8826-4564-bdf3-74b3719af566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:34.180184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba93db-8826-4564-bdf3-74b3719af566 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:34.180688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba93db-8826-4564-bdf3-74b3719af566 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:34.181587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba93db-8826-4564-bdf3-74b3719af566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:34.349725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba93db-8826-4564-bdf3-74b3719af566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:34.353608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba93db-8826-4564-bdf3-74b3719af566 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:34.373219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1161/2343] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:39.323391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e05e5-24f6-4e13-8477-3286874149c1 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:39.324424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e05e5-24f6-4e13-8477-3286874149c1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:39.324881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e05e5-24f6-4e13-8477-3286874149c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:39.385763 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-732e05e5-24f6-4e13-8477-3286874149c1 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:39.387295 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-732e05e5-24f6-4e13-8477-3286874149c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:39.444601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba93db-8826-4564-bdf3-74b3719af566 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:39.447553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-11ba93db-8826-4564-bdf3-74b3719af566 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:39.463553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:39.490734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba93db-8826-4564-bdf3-74b3719af566 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:39.502467 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5565073-e15b-4d2c-ac94-81a0e3289a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:39.503923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565073-e15b-4d2c-ac94-81a0e3289a06 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:39.504269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565073-e15b-4d2c-ac94-81a0e3289a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:39.505856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565073-e15b-4d2c-ac94-81a0e3289a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:39.528736 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1183/2344] 10.222.0.117 () {58 vars in 1017 bytes} [Mon Aug 29 20:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:39.581072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:39.598695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5565073-e15b-4d2c-ac94-81a0e3289a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:39.602826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5565073-e15b-4d2c-ac94-81a0e3289a06 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:39.613828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1162/2345] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:39.805521 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e05e5-24f6-4e13-8477-3286874149c1 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:39.808321 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-732e05e5-24f6-4e13-8477-3286874149c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:40.038865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e05e5-24f6-4e13-8477-3286874149c1 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:40.052629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3a8e4-9323-4293-aac9-6393a3034661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:40.053320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3a8e4-9323-4293-aac9-6393a3034661 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:40.053601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3a8e4-9323-4293-aac9-6393a3034661 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:40.054274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3a8e4-9323-4293-aac9-6393a3034661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:40.079804 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3a8e4-9323-4293-aac9-6393a3034661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:40.079804 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3a8e4-9323-4293-aac9-6393a3034661 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:40.099706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1184/2346] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:42.152393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5565073-e15b-4d2c-ac94-81a0e3289a06 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:42.169585 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5565073-e15b-4d2c-ac94-81a0e3289a06 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:42.193429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d33da-6702-4999-bcde-80f460454aa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:42.193429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d33da-6702-4999-bcde-80f460454aa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:42.194140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d33da-6702-4999-bcde-80f460454aa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:42.194502 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d33da-6702-4999-bcde-80f460454aa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:42.219304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d33da-6702-4999-bcde-80f460454aa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:42.220974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d33da-6702-4999-bcde-80f460454aa8 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:42.298739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1163/2347] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:43.601047 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6be40f-14a9-46ac-9e38-a06d69e528fc None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:43.601571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6be40f-14a9-46ac-9e38-a06d69e528fc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:43.602868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6be40f-14a9-46ac-9e38-a06d69e528fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:43.637088 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-af6be40f-14a9-46ac-9e38-a06d69e528fc None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:43.639447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-af6be40f-14a9-46ac-9e38-a06d69e528fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:43.790052 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1185/2348] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:34:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:43.817440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d33da-6702-4999-bcde-80f460454aa8 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:43.929250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d33da-6702-4999-bcde-80f460454aa8 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:43.947788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63e5ab-e739-4683-833d-c87d84ad80e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:43.948711 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63e5ab-e739-4683-833d-c87d84ad80e2 service swift] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:43.949157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63e5ab-e739-4683-833d-c87d84ad80e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:43.950386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63e5ab-e739-4683-833d-c87d84ad80e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:43.964813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63e5ab-e739-4683-833d-c87d84ad80e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:43.967137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63e5ab-e739-4683-833d-c87d84ad80e2 service swift] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:43.978176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1164/2349] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:34:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:34:49.403791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22b4c1-e627-4827-bec9-e4e3f4b9a9d8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:49.404599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22b4c1-e627-4827-bec9-e4e3f4b9a9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:49.404599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22b4c1-e627-4827-bec9-e4e3f4b9a9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:49.498549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7a22b4c1-e627-4827-bec9-e4e3f4b9a9d8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:49.498549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7a22b4c1-e627-4827-bec9-e4e3f4b9a9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:49.525933 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1186/2350] 10.222.0.117 () {58 vars in 1017 bytes} [Mon Aug 29 20:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:49.763951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63e5ab-e739-4683-833d-c87d84ad80e2 service swift] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:49.825664 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63e5ab-e739-4683-833d-c87d84ad80e2 service swift] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:49.859572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964b1a9-cb86-4865-a701-15b9c89b9c27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:49.862816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964b1a9-cb86-4865-a701-15b9c89b9c27 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:49.862816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964b1a9-cb86-4865-a701-15b9c89b9c27 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:49.862816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964b1a9-cb86-4865-a701-15b9c89b9c27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:49.903208 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964b1a9-cb86-4865-a701-15b9c89b9c27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:49.915996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964b1a9-cb86-4865-a701-15b9c89b9c27 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:49.956794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1165/2351] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:52.140490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22b4c1-e627-4827-bec9-e4e3f4b9a9d8 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:52.151906 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22b4c1-e627-4827-bec9-e4e3f4b9a9d8 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:52.160806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:52.166366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:52.166366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:52.166366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] PATH_INFO: `/v3/users/79c6abf0d03c4834827f723d618a92dd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:52.166366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c6abf0d03c4834827f723d618a92dd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:52.168223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:52.489620 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c6abf0d03c4834827f723d618a92dd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:52.494932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:52.533060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c6abf0d03c4834827f723d618a92dd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:52.533898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c6abf0d03c4834827f723d618a92dd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:52.534704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c6abf0d03c4834827f723d618a92dd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:52.556488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c6abf0d03c4834827f723d618a92dd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:52.645312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1187/2352] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:52 2022] DELETE /identity/v3/users/79c6abf0d03c4834827f723d618a92dd => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:52.650745 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3ba64-d623-4a1d-afa8-72166d086db5 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:52.651776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3ba64-d623-4a1d-afa8-72166d086db5 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:52.652254 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3ba64-d623-4a1d-afa8-72166d086db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:52.676584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-b6f3ba64-d623-4a1d-afa8-72166d086db5 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:52.678347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b6f3ba64-d623-4a1d-afa8-72166d086db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:52.751594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1166/2353] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:52.762371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:52.764629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:52.831244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf04e4-aaf2-44e4-8499-52d87f0a5c35 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:52.834988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eaaf3-7d39-4348-a50d-7f43d2504e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:52.835594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eaaf3-7d39-4348-a50d-7f43d2504e82 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:52.835882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eaaf3-7d39-4348-a50d-7f43d2504e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:52.836338 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eaaf3-7d39-4348-a50d-7f43d2504e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:52.847071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eaaf3-7d39-4348-a50d-7f43d2504e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:52.848436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eaaf3-7d39-4348-a50d-7f43d2504e82 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:52.861526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1188/2354] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:34:53.659181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3ba64-d623-4a1d-afa8-72166d086db5 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:53.661071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b6f3ba64-d623-4a1d-afa8-72166d086db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:53.675082 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3ba64-d623-4a1d-afa8-72166d086db5 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:53.680822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:53.681471 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:53.681744 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:53.682011 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] PATH_INFO: `/v3/projects/bb931f1cbf744180b50f1b95f341c2ce` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:53.683196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb931f1cbf744180b50f1b95f341c2ce)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:53.685213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:53.877231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:53.894344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb931f1cbf744180b50f1b95f341c2ce', 'request_id': 'req-04638345-d966-4d39-9cb0-4dbf64d41c9d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:53.917675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb931f1cbf744180b50f1b95f341c2ce', 'request_id': 'req-04638345-d966-4d39-9cb0-4dbf64d41c9d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:53.925165 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb931f1cbf744180b50f1b95f341c2ce', 'request_id': 'req-04638345-d966-4d39-9cb0-4dbf64d41c9d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:54.109457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] The token cache is being invalidate because project bb931f1cbf744180b50f1b95f341c2ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:54.114064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:54.114064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:54.114064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1167/2355] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:53 2022] DELETE /identity/v3/projects/bb931f1cbf744180b50f1b95f341c2ce => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:54.118353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eaaf3-7d39-4348-a50d-7f43d2504e82 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:54.132070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eaaf3-7d39-4348-a50d-7f43d2504e82 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:54.216453 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:54.217111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:54.217391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:54.217658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] PATH_INFO: `/v3/users/1064959f6cf3405dab2c32cd8c9bafc0` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:54.219055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1064959f6cf3405dab2c32cd8c9bafc0)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:54.220929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:54.662419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1064959f6cf3405dab2c32cd8c9bafc0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:54.709687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1064959f6cf3405dab2c32cd8c9bafc0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:54.710474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1064959f6cf3405dab2c32cd8c9bafc0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:54.711127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1064959f6cf3405dab2c32cd8c9bafc0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:54.717515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:54.722469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1064959f6cf3405dab2c32cd8c9bafc0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:54.910263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1189/2356] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:54 2022] DELETE /identity/v3/users/1064959f6cf3405dab2c32cd8c9bafc0 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:55.762006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:55.776926 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:55.864054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04638345-d966-4d39-9cb0-4dbf64d41c9d admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:56.023258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:56.025206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:56.025579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:56.025849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] PATH_INFO: `/v3/projects/7ed4d114cdb04dcea6e175931c35b76b` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:56.027132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed4d114cdb04dcea6e175931c35b76b)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:56.029203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:56.171908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed4d114cdb04dcea6e175931c35b76b', 'request_id': 'req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:56.180611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed4d114cdb04dcea6e175931c35b76b', 'request_id': 'req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:56.190354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed4d114cdb04dcea6e175931c35b76b', 'request_id': 'req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:56.311887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] The token cache is being invalidate because project 7ed4d114cdb04dcea6e175931c35b76b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:56.312346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:56.313237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:56.315816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1168/2357] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:55 2022] DELETE /identity/v3/projects/7ed4d114cdb04dcea6e175931c35b76b => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:56.320130 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:56.322807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:56.342080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2851-a24a-497d-81a4-5785a31cb167 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:56.484120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a08cb-07bd-4c96-922b-612d9f870b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:56.484120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a08cb-07bd-4c96-922b-612d9f870b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:56.484120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a08cb-07bd-4c96-922b-612d9f870b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:56.484710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a08cb-07bd-4c96-922b-612d9f870b0f admin admin] PATH_INFO: `/v3/users/ac8e67c7eb2643a19de0dfb3a321acf3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:56.485490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a08cb-07bd-4c96-922b-612d9f870b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8e67c7eb2643a19de0dfb3a321acf3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:56.489973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a08cb-07bd-4c96-922b-612d9f870b0f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:56.843162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f00a08cb-07bd-4c96-922b-612d9f870b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8e67c7eb2643a19de0dfb3a321acf3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:56.866134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f00a08cb-07bd-4c96-922b-612d9f870b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8e67c7eb2643a19de0dfb3a321acf3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:56.878483 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f00a08cb-07bd-4c96-922b-612d9f870b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8e67c7eb2643a19de0dfb3a321acf3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:56.878483 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f00a08cb-07bd-4c96-922b-612d9f870b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8e67c7eb2643a19de0dfb3a321acf3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:56.885870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f00a08cb-07bd-4c96-922b-612d9f870b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8e67c7eb2643a19de0dfb3a321acf3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:57.053870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1190/2358] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:56 2022] DELETE /identity/v3/users/ac8e67c7eb2643a19de0dfb3a321acf3 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:57.972120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:57.973592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:57.993819 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc3f59-d3f1-4123-8a35-62d14bc61b5c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:58.116036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:58.118417 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:58.118998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:58.119565 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] PATH_INFO: `/v3/projects/01341dacec5144339dbe54bff1e73f0c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:58.123447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01341dacec5144339dbe54bff1e73f0c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:58.127839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:58.140337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:58.367074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01341dacec5144339dbe54bff1e73f0c', 'request_id': 'req-61bb762a-f18a-4bce-a188-f298435a0b58'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:58.381232 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01341dacec5144339dbe54bff1e73f0c', 'request_id': 'req-61bb762a-f18a-4bce-a188-f298435a0b58'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:58.390180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01341dacec5144339dbe54bff1e73f0c', 'request_id': 'req-61bb762a-f18a-4bce-a188-f298435a0b58'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:58.469996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] The token cache is being invalidate because project 01341dacec5144339dbe54bff1e73f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:58.471052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:58.472297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:58.474986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1169/2359] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:57 2022] DELETE /identity/v3/projects/01341dacec5144339dbe54bff1e73f0c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:35:07.048088 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:07.918819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d73bfe-47b2-4e76-9e68-b186ef56f616 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:07.919105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d73bfe-47b2-4e76-9e68-b186ef56f616 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:07.919379 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d73bfe-47b2-4e76-9e68-b186ef56f616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:07.940570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a4d73bfe-47b2-4e76-9e68-b186ef56f616 None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:07.941841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a4d73bfe-47b2-4e76-9e68-b186ef56f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:08.005967 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1191/2360] 10.222.0.81 () {58 vars in 967 bytes} [Mon Aug 29 20:35:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:08.020099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:08.021711 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:08.098091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb762a-f18a-4bce-a188-f298435a0b58 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:08.103751 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df252fc-25c5-474a-aa07-cdab89b2034d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:08.104487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df252fc-25c5-474a-aa07-cdab89b2034d service swift] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:08.104769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df252fc-25c5-474a-aa07-cdab89b2034d service swift] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:08.105042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df252fc-25c5-474a-aa07-cdab89b2034d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:08.113745 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df252fc-25c5-474a-aa07-cdab89b2034d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:08.115410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df252fc-25c5-474a-aa07-cdab89b2034d service swift] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:08.124401 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1170/2361] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:35:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:35:08.316489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8b68-b824-4543-bbab-4da6a601a611 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:08.317341 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8b68-b824-4543-bbab-4da6a601a611 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:08.317341 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8b68-b824-4543-bbab-4da6a601a611 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:08.322642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1192/2362] 10.222.0.81 () {54 vars in 921 bytes} [Mon Aug 29 20:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:35:08.326478 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5914ff5-c515-4986-a8f4-24c838cb2f2c None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:08.326771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5914ff5-c515-4986-a8f4-24c838cb2f2c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:08.327043 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5914ff5-c515-4986-a8f4-24c838cb2f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:08.349009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d5914ff5-c515-4986-a8f4-24c838cb2f2c None None] MFA Rules not processed for user `30946d3b3f0f4a81b2ae5aa6e84f3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:08.350342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d5914ff5-c515-4986-a8f4-24c838cb2f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:08.457080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1171/2363] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Aug 29 20:35:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:08.471721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8b68-b824-4543-bbab-4da6a601a611 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:08.474391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dc9d8b68-b824-4543-bbab-4da6a601a611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:08.543359 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8b68-b824-4543-bbab-4da6a601a611 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:08.547955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415740-b949-40ae-a002-a09eda34d52c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c841f03880c4fb1b402bac6ecce25fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:08.548593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415740-b949-40ae-a002-a09eda34d52c service glance] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:08.548874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415740-b949-40ae-a002-a09eda34d52c service glance] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:08.549149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415740-b949-40ae-a002-a09eda34d52c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:08.562064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80415740-b949-40ae-a002-a09eda34d52c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:08.563872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80415740-b949-40ae-a002-a09eda34d52c service glance] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:08.579159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1193/2364] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:08.904203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0b2d9-033c-4c09-a27d-f20710fd4ce2 None None] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:08.904489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0b2d9-033c-4c09-a27d-f20710fd4ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:08.905366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0b2d9-033c-4c09-a27d-f20710fd4ce2 None None] PATH_INFO: `/` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:08.906136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1172/2365] 10.222.0.81 () {54 vars in 921 bytes} [Mon Aug 29 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:35:08.911237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1888-7d3e-4fa1-91c3-75bfae1e210f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:08.911522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1888-7d3e-4fa1-91c3-75bfae1e210f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:08.911866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1888-7d3e-4fa1-91c3-75bfae1e210f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:08.933409 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-924c1888-7d3e-4fa1-91c3-75bfae1e210f None None] MFA Rules not processed for user `241e34a86aba4c3a92ed9d469e6a205e`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:08.934594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-924c1888-7d3e-4fa1-91c3-75bfae1e210f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:08.996441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1194/2366] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Aug 29 20:35:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:09.010686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0b2d9-033c-4c09-a27d-f20710fd4ce2 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:09.012545 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-dfb0b2d9-033c-4c09-a27d-f20710fd4ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:09.027113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0b2d9-033c-4c09-a27d-f20710fd4ce2 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:09.031176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9bbce-b95d-4695-8604-4244eec59adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:09.031786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9bbce-b95d-4695-8604-4244eec59adc service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:09.032061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9bbce-b95d-4695-8604-4244eec59adc service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:09.032329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9bbce-b95d-4695-8604-4244eec59adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:09.041186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9bbce-b95d-4695-8604-4244eec59adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:09.042683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9bbce-b95d-4695-8604-4244eec59adc service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:09.051014 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1173/2367] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:09.146908 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46eff2-f04d-4f8b-a8c2-2bd41ec22e4b None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:09.147232 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46eff2-f04d-4f8b-a8c2-2bd41ec22e4b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:09.147511 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46eff2-f04d-4f8b-a8c2-2bd41ec22e4b None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:09.149455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1195/2368] 10.222.0.81 () {54 vars in 921 bytes} [Mon Aug 29 20:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:35:09.155087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bc0ad-9270-4794-af1c-6f5232c90017 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:09.156581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bc0ad-9270-4794-af1c-6f5232c90017 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:09.157068 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bc0ad-9270-4794-af1c-6f5232c90017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:09.165827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:09.178249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-975bc0ad-9270-4794-af1c-6f5232c90017 None None] MFA Rules not processed for user `30946d3b3f0f4a81b2ae5aa6e84f3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:09.179595 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-975bc0ad-9270-4794-af1c-6f5232c90017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:09.189958 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1174/2369] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Aug 29 20:35:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:09.201553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46eff2-f04d-4f8b-a8c2-2bd41ec22e4b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:09.203436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3a46eff2-f04d-4f8b-a8c2-2bd41ec22e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:09.218166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46eff2-f04d-4f8b-a8c2-2bd41ec22e4b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:09.221843 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91395bfd-00e3-49f5-ad94-b27209cc5cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:09.222424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91395bfd-00e3-49f5-ad94-b27209cc5cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:09.222701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91395bfd-00e3-49f5-ad94-b27209cc5cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:09.222967 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91395bfd-00e3-49f5-ad94-b27209cc5cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:09.234513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91395bfd-00e3-49f5-ad94-b27209cc5cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:09.235944 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91395bfd-00e3-49f5-ad94-b27209cc5cd7 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:09.249372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1196/2370] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:11.852907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bc0ad-9270-4794-af1c-6f5232c90017 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:11.854399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-975bc0ad-9270-4794-af1c-6f5232c90017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:11.930302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bc0ad-9270-4794-af1c-6f5232c90017 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:11.935787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240a445-e4b5-470a-b0d3-868fcab4684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:11.936531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240a445-e4b5-470a-b0d3-868fcab4684f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:11.936885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240a445-e4b5-470a-b0d3-868fcab4684f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:11.937159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240a445-e4b5-470a-b0d3-868fcab4684f admin admin] PATH_INFO: `/v3/users/5078e970ba1b4f339c5be54276edb92f` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:11.939150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240a445-e4b5-470a-b0d3-868fcab4684f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5078e970ba1b4f339c5be54276edb92f)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:11.942990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240a445-e4b5-470a-b0d3-868fcab4684f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:12.203427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c240a445-e4b5-470a-b0d3-868fcab4684f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5078e970ba1b4f339c5be54276edb92f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:12.216874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c240a445-e4b5-470a-b0d3-868fcab4684f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5078e970ba1b4f339c5be54276edb92f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:12.223010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c240a445-e4b5-470a-b0d3-868fcab4684f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5078e970ba1b4f339c5be54276edb92f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:12.313842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c240a445-e4b5-470a-b0d3-868fcab4684f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5078e970ba1b4f339c5be54276edb92f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:12.333509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c240a445-e4b5-470a-b0d3-868fcab4684f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5078e970ba1b4f339c5be54276edb92f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:12.347001 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1175/2371] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:35:11 2022] DELETE /identity/v3/users/5078e970ba1b4f339c5be54276edb92f => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:35:12.712871 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91395bfd-00e3-49f5-ad94-b27209cc5cd7 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:12.734319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91395bfd-00e3-49f5-ad94-b27209cc5cd7 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:12.790377 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:12.805998 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7758a65-ca96-4e76-a8b8-48eefaef9a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:12.806732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7758a65-ca96-4e76-a8b8-48eefaef9a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:12.807014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7758a65-ca96-4e76-a8b8-48eefaef9a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:12.807318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7758a65-ca96-4e76-a8b8-48eefaef9a83 admin admin] PATH_INFO: `/v3/projects/86a9164c63714396a9789300f372ac1c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:12.808522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7758a65-ca96-4e76-a8b8-48eefaef9a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a9164c63714396a9789300f372ac1c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:12.810507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7758a65-ca96-4e76-a8b8-48eefaef9a83 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:12.972869 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f7758a65-ca96-4e76-a8b8-48eefaef9a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a9164c63714396a9789300f372ac1c', 'request_id': 'req-f7758a65-ca96-4e76-a8b8-48eefaef9a83'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:12.980060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f7758a65-ca96-4e76-a8b8-48eefaef9a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a9164c63714396a9789300f372ac1c', 'request_id': 'req-f7758a65-ca96-4e76-a8b8-48eefaef9a83'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:13.057151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f7758a65-ca96-4e76-a8b8-48eefaef9a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a9164c63714396a9789300f372ac1c', 'request_id': 'req-f7758a65-ca96-4e76-a8b8-48eefaef9a83'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:13.069065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f7758a65-ca96-4e76-a8b8-48eefaef9a83 admin admin] The token cache is being invalidate because project 86a9164c63714396a9789300f372ac1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:35:13.069629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f7758a65-ca96-4e76-a8b8-48eefaef9a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:13.070086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f7758a65-ca96-4e76-a8b8-48eefaef9a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:13.071974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1197/2372] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:35:12 2022] DELETE /identity/v3/projects/86a9164c63714396a9789300f372ac1c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:35:13.077434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c6158-29a0-4a63-9b44-1b6ffddc21c6 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:13.078401 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c6158-29a0-4a63-9b44-1b6ffddc21c6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:13.078707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c6158-29a0-4a63-9b44-1b6ffddc21c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:13.102337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f12c6158-29a0-4a63-9b44-1b6ffddc21c6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:13.103554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f12c6158-29a0-4a63-9b44-1b6ffddc21c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:13.172313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1176/2373] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:13.239905 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ce68d-23ff-4bcc-95c9-53db7cf1fad9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:13.240138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ce68d-23ff-4bcc-95c9-53db7cf1fad9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:13.240572 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ce68d-23ff-4bcc-95c9-53db7cf1fad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:13.265410 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c39ce68d-23ff-4bcc-95c9-53db7cf1fad9 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:13.266795 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c39ce68d-23ff-4bcc-95c9-53db7cf1fad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:13.275322 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1198/2374] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:13.279650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c6158-29a0-4a63-9b44-1b6ffddc21c6 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:13.290866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c6158-29a0-4a63-9b44-1b6ffddc21c6 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:13.295430 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdada0c7-0d79-4415-9c2d-355313177e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:13.296040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdada0c7-0d79-4415-9c2d-355313177e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:13.296320 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdada0c7-0d79-4415-9c2d-355313177e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:13.296862 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdada0c7-0d79-4415-9c2d-355313177e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:13.297283 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdada0c7-0d79-4415-9c2d-355313177e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:35:13.297622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdada0c7-0d79-4415-9c2d-355313177e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:13.299264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdada0c7-0d79-4415-9c2d-355313177e74 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:13.313499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1177/2375] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:35:13.319587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ce68d-23ff-4bcc-95c9-53db7cf1fad9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:13.329344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ce68d-23ff-4bcc-95c9-53db7cf1fad9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:13.334178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a79174-e674-4338-9d6a-7816d2bc70e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:13.334825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a79174-e674-4338-9d6a-7816d2bc70e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:13.335105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a79174-e674-4338-9d6a-7816d2bc70e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:13.335371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a79174-e674-4338-9d6a-7816d2bc70e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:13.336712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a79174-e674-4338-9d6a-7816d2bc70e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:13.338648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a79174-e674-4338-9d6a-7816d2bc70e3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:13.431707 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1199/2376] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:35:13 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:35:13.432947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdada0c7-0d79-4415-9c2d-355313177e74 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:13.438736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:13.445309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdada0c7-0d79-4415-9c2d-355313177e74 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:13.514685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601754d-1d5d-4c1c-b0f9-ccfe7277f177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:13.515753 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601754d-1d5d-4c1c-b0f9-ccfe7277f177 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:13.516171 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601754d-1d5d-4c1c-b0f9-ccfe7277f177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:13.516442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601754d-1d5d-4c1c-b0f9-ccfe7277f177 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:13.517086 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601754d-1d5d-4c1c-b0f9-ccfe7277f177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:13.519299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601754d-1d5d-4c1c-b0f9-ccfe7277f177 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:13.656322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1178/2377] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:35:13 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:35:13.657717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a79174-e674-4338-9d6a-7816d2bc70e3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:13.672691 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a79174-e674-4338-9d6a-7816d2bc70e3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:13.681213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f25af-d00d-4132-8390-f91c90b1981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:13.704352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f25af-d00d-4132-8390-f91c90b1981a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:13.704352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f25af-d00d-4132-8390-f91c90b1981a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:13.704352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f25af-d00d-4132-8390-f91c90b1981a admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:13.704352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f25af-d00d-4132-8390-f91c90b1981a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:13.704352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f25af-d00d-4132-8390-f91c90b1981a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:13.704352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1200/2378] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:35:13.707198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601754d-1d5d-4c1c-b0f9-ccfe7277f177 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:13.718945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601754d-1d5d-4c1c-b0f9-ccfe7277f177 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:13.724212 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd7930-8793-4025-9b33-4965d0c7d893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:13.724849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd7930-8793-4025-9b33-4965d0c7d893 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:13.725133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd7930-8793-4025-9b33-4965d0c7d893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:13.725409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd7930-8793-4025-9b33-4965d0c7d893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:13.726064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd7930-8793-4025-9b33-4965d0c7d893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:13.727827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd7930-8793-4025-9b33-4965d0c7d893 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:13.739418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1179/2379] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:35:13.749758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f25af-d00d-4132-8390-f91c90b1981a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:13.761052 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f25af-d00d-4132-8390-f91c90b1981a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:13.767280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b5100-f262-4590-a84a-a4b8244f3af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:13.768282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b5100-f262-4590-a84a-a4b8244f3af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:13.768282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b5100-f262-4590-a84a-a4b8244f3af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:13.768650 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b5100-f262-4590-a84a-a4b8244f3af7 admin admin] PATH_INFO: `/v3/projects/18edcc640f5b43cd83447a9b46d2d1fa/users/49725914c0a94afb9b4fcd89cf27297e/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:13.785527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b5100-f262-4590-a84a-a4b8244f3af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18edcc640f5b43cd83447a9b46d2d1fa, user_id=49725914c0a94afb9b4fcd89cf27297e, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:13.788188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b5100-f262-4590-a84a-a4b8244f3af7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:13.909141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1201/2380] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:35:13 2022] PUT /identity/v3/projects/18edcc640f5b43cd83447a9b46d2d1fa/users/49725914c0a94afb9b4fcd89cf27297e/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:35:13.919313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57063c-6fac-47c2-972d-55f440992054 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:13.919601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57063c-6fac-47c2-972d-55f440992054 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:13.919873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57063c-6fac-47c2-972d-55f440992054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:13.949474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ac57063c-6fac-47c2-972d-55f440992054 None None] MFA Rules not processed for user `49725914c0a94afb9b4fcd89cf27297e`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:13.950736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ac57063c-6fac-47c2-972d-55f440992054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:14.055947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1180/2381] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:14.067525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b5100-f262-4590-a84a-a4b8244f3af7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:14.069383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7d5b5100-f262-4590-a84a-a4b8244f3af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:14.135872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b5100-f262-4590-a84a-a4b8244f3af7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:14.140118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc664e-bce8-4d94-870e-4c5a4c689abd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:14.140832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc664e-bce8-4d94-870e-4c5a4c689abd service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:14.141134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc664e-bce8-4d94-870e-4c5a4c689abd service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:14.141358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc664e-bce8-4d94-870e-4c5a4c689abd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:14.151226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc664e-bce8-4d94-870e-4c5a4c689abd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:14.152674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc664e-bce8-4d94-870e-4c5a4c689abd service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:14.162970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1202/2382] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:15.221472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57063c-6fac-47c2-972d-55f440992054 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:15.223011 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ac57063c-6fac-47c2-972d-55f440992054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:15.291512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57063c-6fac-47c2-972d-55f440992054 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:15.295333 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493c16d-47be-4468-8330-2986370af3ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:15.295944 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493c16d-47be-4468-8330-2986370af3ec service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:15.296219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493c16d-47be-4468-8330-2986370af3ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:15.296478 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493c16d-47be-4468-8330-2986370af3ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:15.298189 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9493c16d-47be-4468-8330-2986370af3ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:15.327137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:15.371771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493c16d-47be-4468-8330-2986370af3ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:15.373233 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493c16d-47be-4468-8330-2986370af3ec service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:15.388724 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1181/2383] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:22.355672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52280ba-f7be-43d8-9433-d840987ab4de None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:22.357582 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52280ba-f7be-43d8-9433-d840987ab4de None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:22.358457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52280ba-f7be-43d8-9433-d840987ab4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:22.390089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b52280ba-f7be-43d8-9433-d840987ab4de None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:22.390395 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b52280ba-f7be-43d8-9433-d840987ab4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:22.401787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:22.454871 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1203/2384] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:35:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:22.469578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493c16d-47be-4468-8330-2986370af3ec service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:22.472608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9493c16d-47be-4468-8330-2986370af3ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:22.591194 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493c16d-47be-4468-8330-2986370af3ec service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:22.597002 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009cf7f-d046-409e-b11a-f1b6f88b4ec7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:22.597785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009cf7f-d046-409e-b11a-f1b6f88b4ec7 service swift] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:22.597785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009cf7f-d046-409e-b11a-f1b6f88b4ec7 service swift] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:22.597785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009cf7f-d046-409e-b11a-f1b6f88b4ec7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:22.611069 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009cf7f-d046-409e-b11a-f1b6f88b4ec7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:22.614925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009cf7f-d046-409e-b11a-f1b6f88b4ec7 service swift] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:22.634024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1182/2385] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:35:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 20:35:23.334502 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c396d-a1ed-4743-b97f-450d7a6a1304 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:23.335043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c396d-a1ed-4743-b97f-450d7a6a1304 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:23.335637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c396d-a1ed-4743-b97f-450d7a6a1304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:23.384941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6a9c396d-a1ed-4743-b97f-450d7a6a1304 None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:23.384941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6a9c396d-a1ed-4743-b97f-450d7a6a1304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:23.400016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1204/2386] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:35:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:23.425125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009cf7f-d046-409e-b11a-f1b6f88b4ec7 service swift] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:23.447879 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009cf7f-d046-409e-b11a-f1b6f88b4ec7 service swift] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:23.470512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87b61f-1e69-41b0-b8fc-812fbbb9e55d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:23.471509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87b61f-1e69-41b0-b8fc-812fbbb9e55d service swift] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:23.471966 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87b61f-1e69-41b0-b8fc-812fbbb9e55d service swift] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:23.472414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87b61f-1e69-41b0-b8fc-812fbbb9e55d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:23.488710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87b61f-1e69-41b0-b8fc-812fbbb9e55d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:23.491593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87b61f-1e69-41b0-b8fc-812fbbb9e55d service swift] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:23.518302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1183/2387] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:35:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:35:24.597120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603288d-18e0-4056-aaca-934a6046761c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:24.597851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603288d-18e0-4056-aaca-934a6046761c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:24.597851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603288d-18e0-4056-aaca-934a6046761c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:24.620778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4603288d-18e0-4056-aaca-934a6046761c None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:24.622093 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4603288d-18e0-4056-aaca-934a6046761c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:24.629783 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1205/2388] 10.222.0.81 () {58 vars in 967 bytes} [Mon Aug 29 20:35:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:35:24.685672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87b61f-1e69-41b0-b8fc-812fbbb9e55d service swift] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:24.702777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87b61f-1e69-41b0-b8fc-812fbbb9e55d service swift] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:24.716887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92969fd3-507d-4e7c-bc71-300dc2d566d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:24.721017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92969fd3-507d-4e7c-bc71-300dc2d566d1 service swift] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:24.721017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92969fd3-507d-4e7c-bc71-300dc2d566d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:24.721017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92969fd3-507d-4e7c-bc71-300dc2d566d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:24.732980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92969fd3-507d-4e7c-bc71-300dc2d566d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:24.735194 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92969fd3-507d-4e7c-bc71-300dc2d566d1 service swift] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:24.747231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1184/2389] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:35:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:35:25.992918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c68ea-3ac3-4c74-8421-4af1a460c441 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:25.994333 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c68ea-3ac3-4c74-8421-4af1a460c441 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:25.994537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c68ea-3ac3-4c74-8421-4af1a460c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:26.033619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-fb9c68ea-3ac3-4c74-8421-4af1a460c441 None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:26.033619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fb9c68ea-3ac3-4c74-8421-4af1a460c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:26.045004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1206/2390] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:35:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:26.083035 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92969fd3-507d-4e7c-bc71-300dc2d566d1 service swift] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:26.102928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92969fd3-507d-4e7c-bc71-300dc2d566d1 service swift] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:26.119614 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aac59f-0a0c-4afd-adb0-e6c3f6366303 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:26.121617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aac59f-0a0c-4afd-adb0-e6c3f6366303 service swift] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:26.122557 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aac59f-0a0c-4afd-adb0-e6c3f6366303 service swift] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:26.123530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aac59f-0a0c-4afd-adb0-e6c3f6366303 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:26.150472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aac59f-0a0c-4afd-adb0-e6c3f6366303 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:26.152570 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aac59f-0a0c-4afd-adb0-e6c3f6366303 service swift] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:26.167314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1185/2391] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:35:26.965483 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dd516-a8ec-4656-b1c8-5d591ec4818d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:26.965743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dd516-a8ec-4656-b1c8-5d591ec4818d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:26.965993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dd516-a8ec-4656-b1c8-5d591ec4818d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:27.004091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-dd7dd516-a8ec-4656-b1c8-5d591ec4818d None None] MFA Rules not processed for user `b00ef882922446daa24acef99db53519`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:27.006547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dd7dd516-a8ec-4656-b1c8-5d591ec4818d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:27.123213 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1207/2392] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:35:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:27.931758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dcb04-bf5d-4fca-a875-4c630b1609f4 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:27.933061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dcb04-bf5d-4fca-a875-4c630b1609f4 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:27.933061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dcb04-bf5d-4fca-a875-4c630b1609f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:27.972561 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-4b0dcb04-bf5d-4fca-a875-4c630b1609f4 None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:27.973963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4b0dcb04-bf5d-4fca-a875-4c630b1609f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:27.983785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1186/2393] 10.222.0.81 () {58 vars in 967 bytes} [Mon Aug 29 20:35:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:35:28.043668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dd516-a8ec-4656-b1c8-5d591ec4818d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:28.064220 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dd516-a8ec-4656-b1c8-5d591ec4818d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:28.070649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62422289-d710-4339-8078-5638c7602334 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:28.071644 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62422289-d710-4339-8078-5638c7602334 service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:28.072144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62422289-d710-4339-8078-5638c7602334 service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:28.072635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62422289-d710-4339-8078-5638c7602334 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:28.085107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62422289-d710-4339-8078-5638c7602334 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:28.088506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62422289-d710-4339-8078-5638c7602334 service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:28.101930 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1208/2394] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:35:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:35:32.350004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dcb04-bf5d-4fca-a875-4c630b1609f4 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:32.353314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4b0dcb04-bf5d-4fca-a875-4c630b1609f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:32.373895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62422289-d710-4339-8078-5638c7602334 service swift] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:32.482541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62422289-d710-4339-8078-5638c7602334 service swift] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:32.487751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1412a-6430-4ddf-94a2-eba99855d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:32.499031 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1412a-6430-4ddf-94a2-eba99855d336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:32.499938 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1412a-6430-4ddf-94a2-eba99855d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:32.500266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1412a-6430-4ddf-94a2-eba99855d336 admin admin] PATH_INFO: `/v3/users/49725914c0a94afb9b4fcd89cf27297e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:32.501720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1412a-6430-4ddf-94a2-eba99855d336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49725914c0a94afb9b4fcd89cf27297e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:32.504127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1412a-6430-4ddf-94a2-eba99855d336 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:32.508337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dcb04-bf5d-4fca-a875-4c630b1609f4 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:32.517418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121f3f2-0d05-4edb-bee9-0e0f1206e160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:32.518619 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121f3f2-0d05-4edb-bee9-0e0f1206e160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:32.519133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121f3f2-0d05-4edb-bee9-0e0f1206e160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:32.519636 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121f3f2-0d05-4edb-bee9-0e0f1206e160 admin admin] PATH_INFO: `/v3/users/2d8a2063148a4f4c8d040ab903d42217` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:32.521742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121f3f2-0d05-4edb-bee9-0e0f1206e160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8a2063148a4f4c8d040ab903d42217)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:32.526111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121f3f2-0d05-4edb-bee9-0e0f1206e160 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:32.536686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:32.784712 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:32.798487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c6c1412a-6430-4ddf-94a2-eba99855d336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49725914c0a94afb9b4fcd89cf27297e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:32.813053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c6c1412a-6430-4ddf-94a2-eba99855d336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49725914c0a94afb9b4fcd89cf27297e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:32.813837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c6c1412a-6430-4ddf-94a2-eba99855d336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49725914c0a94afb9b4fcd89cf27297e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:32.814802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c6c1412a-6430-4ddf-94a2-eba99855d336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49725914c0a94afb9b4fcd89cf27297e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:32.830827 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c6c1412a-6430-4ddf-94a2-eba99855d336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49725914c0a94afb9b4fcd89cf27297e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:32.845370 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5121f3f2-0d05-4edb-bee9-0e0f1206e160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8a2063148a4f4c8d040ab903d42217'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:32.864769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5121f3f2-0d05-4edb-bee9-0e0f1206e160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8a2063148a4f4c8d040ab903d42217'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:32.867280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5121f3f2-0d05-4edb-bee9-0e0f1206e160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8a2063148a4f4c8d040ab903d42217'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:32.984173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1209/2395] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:35:32 2022] DELETE /identity/v3/users/49725914c0a94afb9b4fcd89cf27297e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:35:32.986740 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8a6c0-0330-44e6-b449-1cfda1a703fe None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:32.987303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8a6c0-0330-44e6-b449-1cfda1a703fe None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:32.987881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8a6c0-0330-44e6-b449-1cfda1a703fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:33.014527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-93f8a6c0-0330-44e6-b449-1cfda1a703fe None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:33.016241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-93f8a6c0-0330-44e6-b449-1cfda1a703fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:33.087008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5121f3f2-0d05-4edb-bee9-0e0f1206e160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8a2063148a4f4c8d040ab903d42217'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:33.098462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1210/2396] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:33.109184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5121f3f2-0d05-4edb-bee9-0e0f1206e160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8a2063148a4f4c8d040ab903d42217'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:33.113660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8a6c0-0330-44e6-b449-1cfda1a703fe None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:33.115326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-93f8a6c0-0330-44e6-b449-1cfda1a703fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:33.122592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1187/2397] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:35:32 2022] DELETE /identity/v3/users/2d8a2063148a4f4c8d040ab903d42217 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:35:33.145207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b826a-60b3-4ccd-bc84-e27ecadf01d1 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:33.145745 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b826a-60b3-4ccd-bc84-e27ecadf01d1 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:33.149105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b826a-60b3-4ccd-bc84-e27ecadf01d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:33.209085 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f73b826a-60b3-4ccd-bc84-e27ecadf01d1 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:33.216894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f73b826a-60b3-4ccd-bc84-e27ecadf01d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:33.222500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8a6c0-0330-44e6-b449-1cfda1a703fe None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:33.355439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f47f21-b4e0-4646-a116-603cfd888592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:33.356091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f47f21-b4e0-4646-a116-603cfd888592 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:33.356413 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f47f21-b4e0-4646-a116-603cfd888592 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:33.356678 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f47f21-b4e0-4646-a116-603cfd888592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:33.389668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:33.390731 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1188/2398] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:33.402049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b826a-60b3-4ccd-bc84-e27ecadf01d1 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:33.414523 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b826a-60b3-4ccd-bc84-e27ecadf01d1 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:33.418686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c838005-b6c1-4b13-acf8-e388cf6c4cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:33.419567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c838005-b6c1-4b13-acf8-e388cf6c4cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:33.419849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c838005-b6c1-4b13-acf8-e388cf6c4cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:33.420138 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c838005-b6c1-4b13-acf8-e388cf6c4cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:33.436364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c838005-b6c1-4b13-acf8-e388cf6c4cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:33.440871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c838005-b6c1-4b13-acf8-e388cf6c4cb1 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:33.464009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1189/2399] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:33.493989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f47f21-b4e0-4646-a116-603cfd888592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:33.499507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f47f21-b4e0-4646-a116-603cfd888592 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:33.527327 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1211/2400] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:35:34.723473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c838005-b6c1-4b13-acf8-e388cf6c4cb1 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:34.727144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3c838005-b6c1-4b13-acf8-e388cf6c4cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:34.761352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c838005-b6c1-4b13-acf8-e388cf6c4cb1 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:34.769810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a269b24-5b8f-4001-a861-c346e905e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:34.770539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a269b24-5b8f-4001-a861-c346e905e9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:34.770822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a269b24-5b8f-4001-a861-c346e905e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:34.771101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a269b24-5b8f-4001-a861-c346e905e9da admin admin] PATH_INFO: `/v3/projects/5afc19a3103244c0bd58116e92d45f84` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:34.772323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a269b24-5b8f-4001-a861-c346e905e9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afc19a3103244c0bd58116e92d45f84)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:34.774970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a269b24-5b8f-4001-a861-c346e905e9da admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:35.005405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5a269b24-5b8f-4001-a861-c346e905e9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afc19a3103244c0bd58116e92d45f84', 'request_id': 'req-5a269b24-5b8f-4001-a861-c346e905e9da'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:35.013600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5a269b24-5b8f-4001-a861-c346e905e9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afc19a3103244c0bd58116e92d45f84', 'request_id': 'req-5a269b24-5b8f-4001-a861-c346e905e9da'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:35.021076 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5a269b24-5b8f-4001-a861-c346e905e9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afc19a3103244c0bd58116e92d45f84', 'request_id': 'req-5a269b24-5b8f-4001-a861-c346e905e9da'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:35.025340 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:35.072431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f47f21-b4e0-4646-a116-603cfd888592 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:35.074962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-68f47f21-b4e0-4646-a116-603cfd888592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:35.100735 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f47f21-b4e0-4646-a116-603cfd888592 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:35.149283 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5a269b24-5b8f-4001-a861-c346e905e9da admin admin] The token cache is being invalidate because project 5afc19a3103244c0bd58116e92d45f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:35:35.149553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5a269b24-5b8f-4001-a861-c346e905e9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:35.150402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5a269b24-5b8f-4001-a861-c346e905e9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:35.152431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1190/2401] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:35:34 2022] DELETE /identity/v3/projects/5afc19a3103244c0bd58116e92d45f84 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:35:35.157395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec66d7d-3921-425f-94fe-4f02ef296af5 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:35.157961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec66d7d-3921-425f-94fe-4f02ef296af5 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:35.158703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec66d7d-3921-425f-94fe-4f02ef296af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:35.178057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:35.179476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:35.179787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:35.180233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] PATH_INFO: `/v3/projects/18edcc640f5b43cd83447a9b46d2d1fa` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:35.181692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18edcc640f5b43cd83447a9b46d2d1fa)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:35.183683 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:35.184311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6ec66d7d-3921-425f-94fe-4f02ef296af5 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:35.186139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6ec66d7d-3921-425f-94fe-4f02ef296af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:35.197278 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1191/2402] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:35.207433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb819b6-a77d-4ce4-8f55-eedfb71cb13a None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:35.207734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb819b6-a77d-4ce4-8f55-eedfb71cb13a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:35.208051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb819b6-a77d-4ce4-8f55-eedfb71cb13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:35.236695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-7bb819b6-a77d-4ce4-8f55-eedfb71cb13a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:35.239458 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7bb819b6-a77d-4ce4-8f55-eedfb71cb13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:35.255391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1192/2403] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:35:35.264738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb819b6-a77d-4ce4-8f55-eedfb71cb13a None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:35.271805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb819b6-a77d-4ce4-8f55-eedfb71cb13a None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:35.277401 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d2534-e76b-423a-b6f2-39d4499f4c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:35.278026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d2534-e76b-423a-b6f2-39d4499f4c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:35.278337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d2534-e76b-423a-b6f2-39d4499f4c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:35.278615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d2534-e76b-423a-b6f2-39d4499f4c0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:35.279386 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d2534-e76b-423a-b6f2-39d4499f4c0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:35:35.279691 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d2534-e76b-423a-b6f2-39d4499f4c0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:35.281491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d2534-e76b-423a-b6f2-39d4499f4c0d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:35.299478 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1193/2404] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:35:35.306600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d2534-e76b-423a-b6f2-39d4499f4c0d admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:35.318293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d2534-e76b-423a-b6f2-39d4499f4c0d admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:35.324674 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8cc61-3d3d-4a09-a586-a8410f046ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:35.325291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8cc61-3d3d-4a09-a586-a8410f046ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:35.325571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8cc61-3d3d-4a09-a586-a8410f046ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:35.325864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8cc61-3d3d-4a09-a586-a8410f046ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:35.326543 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8cc61-3d3d-4a09-a586-a8410f046ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:35.328478 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8cc61-3d3d-4a09-a586-a8410f046ee7 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:35.403151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18edcc640f5b43cd83447a9b46d2d1fa', 'request_id': 'req-0f030555-18ce-4049-a726-d1af3aeaae55'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:35.410553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18edcc640f5b43cd83447a9b46d2d1fa', 'request_id': 'req-0f030555-18ce-4049-a726-d1af3aeaae55'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:35.504013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1194/2405] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:35:35 2022] POST /identity/v3/projects => generated 399 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:35:35.508028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8cc61-3d3d-4a09-a586-a8410f046ee7 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:35.571535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18edcc640f5b43cd83447a9b46d2d1fa', 'request_id': 'req-0f030555-18ce-4049-a726-d1af3aeaae55'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:35.574783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8cc61-3d3d-4a09-a586-a8410f046ee7 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:35.580423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fb6fd-800d-4f75-adb7-6259b38f1b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:35.581104 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fb6fd-800d-4f75-adb7-6259b38f1b29 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:35.581347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fb6fd-800d-4f75-adb7-6259b38f1b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:35.581615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fb6fd-800d-4f75-adb7-6259b38f1b29 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:35.582310 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fb6fd-800d-4f75-adb7-6259b38f1b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:35.584310 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fb6fd-800d-4f75-adb7-6259b38f1b29 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:35.584632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] The token cache is being invalidate because project 18edcc640f5b43cd83447a9b46d2d1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:35:35.584923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:35.586411 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:35.588148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1212/2406] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:35:35 2022] DELETE /identity/v3/projects/18edcc640f5b43cd83447a9b46d2d1fa => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:35:35.729006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1195/2407] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:35:35 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:35:35.735316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:35.739363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:35.858740 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:35.880741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f030555-18ce-4049-a726-d1af3aeaae55 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:35.887147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4c567-da31-4a23-8b6a-a6e10082c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:35.887823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4c567-da31-4a23-8b6a-a6e10082c081 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:35.888110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4c567-da31-4a23-8b6a-a6e10082c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:35.888560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4c567-da31-4a23-8b6a-a6e10082c081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:35.889510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4c567-da31-4a23-8b6a-a6e10082c081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:35.891255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4c567-da31-4a23-8b6a-a6e10082c081 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:35.905339 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1213/2408] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:35:35.909151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fb6fd-800d-4f75-adb7-6259b38f1b29 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:35.928669 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fb6fd-800d-4f75-adb7-6259b38f1b29 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:35.934618 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4cc11-35fe-4a32-b480-14279c14de78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:35.937361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4cc11-35fe-4a32-b480-14279c14de78 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:35.937933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4cc11-35fe-4a32-b480-14279c14de78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:35.938387 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4cc11-35fe-4a32-b480-14279c14de78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:35.939154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4cc11-35fe-4a32-b480-14279c14de78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:35.940990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4cc11-35fe-4a32-b480-14279c14de78 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:35.953313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1196/2409] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:35:35.957489 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4c567-da31-4a23-8b6a-a6e10082c081 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:35.980674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4c567-da31-4a23-8b6a-a6e10082c081 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:35.989342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71458a49-a3cd-400a-9104-733229376ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:35.990013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71458a49-a3cd-400a-9104-733229376ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:35.990332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71458a49-a3cd-400a-9104-733229376ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:35.990614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71458a49-a3cd-400a-9104-733229376ac6 admin admin] PATH_INFO: `/v3/projects/e7177152b498478ba4202d511985b600/users/2cbae5b4d1e14c00aa5f8d85e839edf2/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:36.006849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71458a49-a3cd-400a-9104-733229376ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7177152b498478ba4202d511985b600, user_id=2cbae5b4d1e14c00aa5f8d85e839edf2, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:36.010378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71458a49-a3cd-400a-9104-733229376ac6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:36.137442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1214/2410] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:35:35 2022] PUT /identity/v3/projects/e7177152b498478ba4202d511985b600/users/2cbae5b4d1e14c00aa5f8d85e839edf2/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:35:36.150379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc7e59-ce59-4ae0-8bc4-1f605e6766ba None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:36.150790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc7e59-ce59-4ae0-8bc4-1f605e6766ba None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:36.151079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc7e59-ce59-4ae0-8bc4-1f605e6766ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:36.199787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-89cc7e59-ce59-4ae0-8bc4-1f605e6766ba None None] MFA Rules not processed for user `2cbae5b4d1e14c00aa5f8d85e839edf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:36.201168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-89cc7e59-ce59-4ae0-8bc4-1f605e6766ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:36.276319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1197/2411] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:35:36.288866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71458a49-a3cd-400a-9104-733229376ac6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:36.290739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-71458a49-a3cd-400a-9104-733229376ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:36.354810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71458a49-a3cd-400a-9104-733229376ac6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:36.359248 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8c634-11bb-4d63-94a3-e70365ed9c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:36.359920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8c634-11bb-4d63-94a3-e70365ed9c1b service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:36.360401 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8c634-11bb-4d63-94a3-e70365ed9c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:36.360704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8c634-11bb-4d63-94a3-e70365ed9c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:36.371024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8c634-11bb-4d63-94a3-e70365ed9c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:36.372589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8c634-11bb-4d63-94a3-e70365ed9c1b service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:36.382676 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1215/2412] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:42.661599 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc7e59-ce59-4ae0-8bc4-1f605e6766ba None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:42.683907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:42.741063 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc7e59-ce59-4ae0-8bc4-1f605e6766ba None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:42.747186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:42.747924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:42.748214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:42.748471 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] PATH_INFO: `/v3/users/2cbae5b4d1e14c00aa5f8d85e839edf2` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:42.749621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cbae5b4d1e14c00aa5f8d85e839edf2)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:42.751646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:43.033316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cbae5b4d1e14c00aa5f8d85e839edf2'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:43.055558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cbae5b4d1e14c00aa5f8d85e839edf2'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:43.056480 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cbae5b4d1e14c00aa5f8d85e839edf2'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:43.182389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cbae5b4d1e14c00aa5f8d85e839edf2'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:43.199345 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cbae5b4d1e14c00aa5f8d85e839edf2'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:43.205515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1198/2413] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:35:42 2022] DELETE /identity/v3/users/2cbae5b4d1e14c00aa5f8d85e839edf2 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:35:43.212064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820235ec-ac58-4753-b088-16f5efddc4e2 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:43.212596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820235ec-ac58-4753-b088-16f5efddc4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:43.212596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820235ec-ac58-4753-b088-16f5efddc4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:43.233019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-820235ec-ac58-4753-b088-16f5efddc4e2 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:43.234180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-820235ec-ac58-4753-b088-16f5efddc4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:43.306458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1216/2414] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:43.318236 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:43.319683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:43.388055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd86be-7e3c-4136-be52-8a2c340e2c25 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:43.392131 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dfacf-42f1-441a-a83b-04c59d133b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:43.392737 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dfacf-42f1-441a-a83b-04c59d133b22 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:43.393036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dfacf-42f1-441a-a83b-04c59d133b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:43.393307 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dfacf-42f1-441a-a83b-04c59d133b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:43.404196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dfacf-42f1-441a-a83b-04c59d133b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:43.405675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dfacf-42f1-441a-a83b-04c59d133b22 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:43.416107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1199/2415] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:44.008205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820235ec-ac58-4753-b088-16f5efddc4e2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:44.010340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-820235ec-ac58-4753-b088-16f5efddc4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:44.030160 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820235ec-ac58-4753-b088-16f5efddc4e2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:44.035200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:44.035851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:44.036251 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:44.036526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] PATH_INFO: `/v3/projects/e7177152b498478ba4202d511985b600` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:44.037732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7177152b498478ba4202d511985b600)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:44.039943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:44.217197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7177152b498478ba4202d511985b600', 'request_id': 'req-f48b141e-e08d-45d1-8910-dc4278b83da6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:44.223874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7177152b498478ba4202d511985b600', 'request_id': 'req-f48b141e-e08d-45d1-8910-dc4278b83da6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:44.226510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:44.285304 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7177152b498478ba4202d511985b600', 'request_id': 'req-f48b141e-e08d-45d1-8910-dc4278b83da6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:44.299376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] The token cache is being invalidate because project e7177152b498478ba4202d511985b600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:35:44.299670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:44.300938 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:44.302465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1217/2416] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:35:44 2022] DELETE /identity/v3/projects/e7177152b498478ba4202d511985b600 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:35:47.356360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd0320-44b8-49fb-914f-58a8243ae412 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:47.357540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd0320-44b8-49fb-914f-58a8243ae412 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:47.357540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd0320-44b8-49fb-914f-58a8243ae412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:47.378416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-86fd0320-44b8-49fb-914f-58a8243ae412 None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:47.379871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-86fd0320-44b8-49fb-914f-58a8243ae412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:47.425779 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:47.455460 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1200/2417] 10.222.0.81 () {58 vars in 967 bytes} [Mon Aug 29 20:35:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:47.478118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:47.479842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:47.557121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b141e-e08d-45d1-8910-dc4278b83da6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:47.562436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1be38-49ca-40ed-ab24-e2d6e712b1de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:47.562985 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1be38-49ca-40ed-ab24-e2d6e712b1de service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:47.563264 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1be38-49ca-40ed-ab24-e2d6e712b1de service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:47.563537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1be38-49ca-40ed-ab24-e2d6e712b1de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:47.573558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1be38-49ca-40ed-ab24-e2d6e712b1de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:47.575282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1be38-49ca-40ed-ab24-e2d6e712b1de service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:47.590208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1218/2418] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:35:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:35:57.580783 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=3,keystone:SELECT=36 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:57.644541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=9 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:00.388021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee366d1-af03-4387-a3e2-cea113c357c2 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:00.388637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee366d1-af03-4387-a3e2-cea113c357c2 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:00.388637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee366d1-af03-4387-a3e2-cea113c357c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:00.409475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6ee366d1-af03-4387-a3e2-cea113c357c2 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:00.410813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6ee366d1-af03-4387-a3e2-cea113c357c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:00.474558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1201/2419] 10.222.0.117 () {58 vars in 1017 bytes} [Mon Aug 29 20:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:00.511280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1be38-49ca-40ed-ab24-e2d6e712b1de service swift] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:00.512961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5da1be38-49ca-40ed-ab24-e2d6e712b1de service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:00.601672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1be38-49ca-40ed-ab24-e2d6e712b1de service swift] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:00.607645 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47367b4-b6c8-4620-ac1e-a1535a53f67f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:00.608188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47367b4-b6c8-4620-ac1e-a1535a53f67f service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:00.608472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47367b4-b6c8-4620-ac1e-a1535a53f67f service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:00.608743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47367b4-b6c8-4620-ac1e-a1535a53f67f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:00.617214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47367b4-b6c8-4620-ac1e-a1535a53f67f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:00.619332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47367b4-b6c8-4620-ac1e-a1535a53f67f service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:00.629488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1219/2420] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:05.668150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee366d1-af03-4387-a3e2-cea113c357c2 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:05.669562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6ee366d1-af03-4387-a3e2-cea113c357c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:05.729930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee366d1-af03-4387-a3e2-cea113c357c2 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:05.733697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8b93c-e881-45d7-be9b-85e1b3e3bf95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:05.734405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8b93c-e881-45d7-be9b-85e1b3e3bf95 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:05.734650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8b93c-e881-45d7-be9b-85e1b3e3bf95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:05.734930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8b93c-e881-45d7-be9b-85e1b3e3bf95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:05.736720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-35e8b93c-e881-45d7-be9b-85e1b3e3bf95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:05.751863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8b93c-e881-45d7-be9b-85e1b3e3bf95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:05.753316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8b93c-e881-45d7-be9b-85e1b3e3bf95 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:05.765902 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1202/2421] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:06.119325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5415fe-d251-44ff-852c-88a0576d7800 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:06.119947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5415fe-d251-44ff-852c-88a0576d7800 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:06.119947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5415fe-d251-44ff-852c-88a0576d7800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:06.141772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-da5415fe-d251-44ff-852c-88a0576d7800 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:06.143450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-da5415fe-d251-44ff-852c-88a0576d7800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:06.152486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1220/2422] 10.222.0.117 () {58 vars in 1017 bytes} [Mon Aug 29 20:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:06.197101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8b93c-e881-45d7-be9b-85e1b3e3bf95 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:06.208793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8b93c-e881-45d7-be9b-85e1b3e3bf95 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:06.215539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fdd9c-3fb3-4a28-8bf5-591161cb518f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:06.216157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fdd9c-3fb3-4a28-8bf5-591161cb518f service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:06.216439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fdd9c-3fb3-4a28-8bf5-591161cb518f service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:06.216714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fdd9c-3fb3-4a28-8bf5-591161cb518f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:06.225536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fdd9c-3fb3-4a28-8bf5-591161cb518f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:06.227246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fdd9c-3fb3-4a28-8bf5-591161cb518f service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:06.237435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1203/2423] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:09.155868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5415fe-d251-44ff-852c-88a0576d7800 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:09.164217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-da5415fe-d251-44ff-852c-88a0576d7800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:09.216995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5415fe-d251-44ff-852c-88a0576d7800 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:09.220504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5c381-fd64-422f-b089-e4de82588dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:09.221102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5c381-fd64-422f-b089-e4de82588dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:09.221381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5c381-fd64-422f-b089-e4de82588dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:09.221638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5c381-fd64-422f-b089-e4de82588dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:09.223379 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3da5c381-fd64-422f-b089-e4de82588dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:09.237162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5c381-fd64-422f-b089-e4de82588dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:09.238641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5c381-fd64-422f-b089-e4de82588dc2 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:09.250004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1221/2424] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:09.987464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31eca9-df77-41ec-8c25-6154cdfc3557 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:09.988016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31eca9-df77-41ec-8c25-6154cdfc3557 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:09.988016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31eca9-df77-41ec-8c25-6154cdfc3557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:10.011208 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-8c31eca9-df77-41ec-8c25-6154cdfc3557 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:10.012340 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8c31eca9-df77-41ec-8c25-6154cdfc3557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:10.020780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1204/2425] 10.222.0.117 () {58 vars in 1017 bytes} [Mon Aug 29 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:10.051427 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5c381-fd64-422f-b089-e4de82588dc2 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:10.063486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5c381-fd64-422f-b089-e4de82588dc2 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:10.069317 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74928112-fc3c-4c38-8b2e-df55b26a384c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:10.069926 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74928112-fc3c-4c38-8b2e-df55b26a384c service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:10.070206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74928112-fc3c-4c38-8b2e-df55b26a384c service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:10.070506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74928112-fc3c-4c38-8b2e-df55b26a384c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:10.080387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74928112-fc3c-4c38-8b2e-df55b26a384c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:10.081971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74928112-fc3c-4c38-8b2e-df55b26a384c service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:10.092895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1222/2426] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:14.294257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02f50e-05b9-4812-b704-4347b4da6849 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:14.300259 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02f50e-05b9-4812-b704-4347b4da6849 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:14.300259 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02f50e-05b9-4812-b704-4347b4da6849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:14.316289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6b02f50e-05b9-4812-b704-4347b4da6849 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:14.317555 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6b02f50e-05b9-4812-b704-4347b4da6849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:14.326768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1205/2427] 10.222.0.117 () {58 vars in 1017 bytes} [Mon Aug 29 20:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:14.362158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74928112-fc3c-4c38-8b2e-df55b26a384c service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:14.374052 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74928112-fc3c-4c38-8b2e-df55b26a384c service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:14.379729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8c37f-201f-4b1a-bfbc-2b11f8745885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:14.380412 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8c37f-201f-4b1a-bfbc-2b11f8745885 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:14.380635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8c37f-201f-4b1a-bfbc-2b11f8745885 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:14.380902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8c37f-201f-4b1a-bfbc-2b11f8745885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:14.392360 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8c37f-201f-4b1a-bfbc-2b11f8745885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:14.397657 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8c37f-201f-4b1a-bfbc-2b11f8745885 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:14.406123 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1223/2428] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:19.606939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f530-7674-4396-9b52-ffe823e500d0 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:19.607499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f530-7674-4396-9b52-ffe823e500d0 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:19.607605 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f530-7674-4396-9b52-ffe823e500d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:19.629502 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-65f0f530-7674-4396-9b52-ffe823e500d0 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:19.630828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-65f0f530-7674-4396-9b52-ffe823e500d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:19.638875 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1206/2429] 10.222.0.117 () {58 vars in 1017 bytes} [Mon Aug 29 20:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:19.668503 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8c37f-201f-4b1a-bfbc-2b11f8745885 service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:19.679873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8c37f-201f-4b1a-bfbc-2b11f8745885 service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:19.686992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1864a-325c-40fa-821f-2530f9c5f576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:19.687631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1864a-325c-40fa-821f-2530f9c5f576 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:19.687909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1864a-325c-40fa-821f-2530f9c5f576 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:19.688176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1864a-325c-40fa-821f-2530f9c5f576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:19.696636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1864a-325c-40fa-821f-2530f9c5f576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:19.698525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1864a-325c-40fa-821f-2530f9c5f576 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:19.707935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1224/2430] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:36:23.835886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0f530-7674-4396-9b52-ffe823e500d0 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:23.848911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0f530-7674-4396-9b52-ffe823e500d0 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:23.855373 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e7f90-052d-4907-b213-068fb93c1a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:23.856154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e7f90-052d-4907-b213-068fb93c1a07 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:23.856262 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e7f90-052d-4907-b213-068fb93c1a07 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:23.856527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e7f90-052d-4907-b213-068fb93c1a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:23.858379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-eb6e7f90-052d-4907-b213-068fb93c1a07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:23.919905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e7f90-052d-4907-b213-068fb93c1a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:23.921496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e7f90-052d-4907-b213-068fb93c1a07 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:23.930722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1207/2431] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:29.703681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=81 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:33.926524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=96 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:35.051680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1864a-325c-40fa-821f-2530f9c5f576 service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:35.062721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1864a-325c-40fa-821f-2530f9c5f576 service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:35.066751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ba064-768e-4d2a-a449-66046b5da4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:35.067426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ba064-768e-4d2a-a449-66046b5da4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:35.067708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ba064-768e-4d2a-a449-66046b5da4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:35.067981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ba064-768e-4d2a-a449-66046b5da4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:35.069723 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0e7ba064-768e-4d2a-a449-66046b5da4b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:35.081181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ba064-768e-4d2a-a449-66046b5da4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:35.082714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ba064-768e-4d2a-a449-66046b5da4b7 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:35.091955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1225/2432] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:38.370879 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b029179-a1ac-4a4b-a33f-a267cb5c1767 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:38.371573 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b029179-a1ac-4a4b-a33f-a267cb5c1767 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:38.371573 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b029179-a1ac-4a4b-a33f-a267cb5c1767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:38.390941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-5b029179-a1ac-4a4b-a33f-a267cb5c1767 None None] MFA Rules not processed for user `948542e68a5c499681d5faf8507cebe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:38.392125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5b029179-a1ac-4a4b-a33f-a267cb5c1767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:38.399246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1208/2433] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:36:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:42.790194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ba064-768e-4d2a-a449-66046b5da4b7 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:42.803823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ba064-768e-4d2a-a449-66046b5da4b7 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:42.809600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed7983-4aa9-4020-ad5c-809d9af9812d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:42.810196 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7983-4aa9-4020-ad5c-809d9af9812d service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:42.810502 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7983-4aa9-4020-ad5c-809d9af9812d service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:42.810775 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7983-4aa9-4020-ad5c-809d9af9812d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:42.812492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2fed7983-4aa9-4020-ad5c-809d9af9812d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:42.874687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed7983-4aa9-4020-ad5c-809d9af9812d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:42.877037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed7983-4aa9-4020-ad5c-809d9af9812d service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:42.889079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1226/2434] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:44.877275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b029179-a1ac-4a4b-a33f-a267cb5c1767 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:44.941125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b029179-a1ac-4a4b-a33f-a267cb5c1767 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:44.947067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9e30d-0fa1-4254-ad9d-2d21fa6d4943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:44.947687 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9e30d-0fa1-4254-ad9d-2d21fa6d4943 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:44.947969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9e30d-0fa1-4254-ad9d-2d21fa6d4943 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:44.948238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9e30d-0fa1-4254-ad9d-2d21fa6d4943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:44.950184 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-acf9e30d-0fa1-4254-ad9d-2d21fa6d4943 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:44.977828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9e30d-0fa1-4254-ad9d-2d21fa6d4943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:44.979364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9e30d-0fa1-4254-ad9d-2d21fa6d4943 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:44.993939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1209/2435] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:50.118989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed7983-4aa9-4020-ad5c-809d9af9812d service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:50.164881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed7983-4aa9-4020-ad5c-809d9af9812d service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:50.171542 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bec9c-ac49-48bf-b7d4-180e82e370a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:50.172169 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bec9c-ac49-48bf-b7d4-180e82e370a9 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:50.172443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bec9c-ac49-48bf-b7d4-180e82e370a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:50.172721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bec9c-ac49-48bf-b7d4-180e82e370a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:50.174590 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d16bec9c-ac49-48bf-b7d4-180e82e370a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:50.198827 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bec9c-ac49-48bf-b7d4-180e82e370a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:50.200612 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bec9c-ac49-48bf-b7d4-180e82e370a9 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:50.216119 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1227/2436] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:54.989159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=24 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:56.423383 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c004a0-cc3e-4267-906c-7003bb63848c None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:56.423988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c004a0-cc3e-4267-906c-7003bb63848c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:56.423988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c004a0-cc3e-4267-906c-7003bb63848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:56.443586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-19c004a0-cc3e-4267-906c-7003bb63848c None None] MFA Rules not processed for user `67a947140e4c4075acd70bbb57022baa`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:56.444811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-19c004a0-cc3e-4267-906c-7003bb63848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:56.453089 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1210/2437] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:36:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:56.787897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bec9c-ac49-48bf-b7d4-180e82e370a9 service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:56.808183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bec9c-ac49-48bf-b7d4-180e82e370a9 service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:56.812463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766840a-eaad-458c-a0b8-d378aafb801b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:56.813064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766840a-eaad-458c-a0b8-d378aafb801b service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:56.813336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766840a-eaad-458c-a0b8-d378aafb801b service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:56.813598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766840a-eaad-458c-a0b8-d378aafb801b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:56.815453 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b766840a-eaad-458c-a0b8-d378aafb801b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:56.839749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766840a-eaad-458c-a0b8-d378aafb801b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:56.841403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766840a-eaad-458c-a0b8-d378aafb801b service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:56.850183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1228/2438] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:57.280510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c004a0-cc3e-4267-906c-7003bb63848c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:57.288511 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-19c004a0-cc3e-4267-906c-7003bb63848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:57.372573 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c004a0-cc3e-4267-906c-7003bb63848c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:57.377497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aecf2-138d-43d4-b7df-80ffbbbe9095 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:57.378110 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aecf2-138d-43d4-b7df-80ffbbbe9095 service placement] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:57.378427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aecf2-138d-43d4-b7df-80ffbbbe9095 service placement] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:57.378704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aecf2-138d-43d4-b7df-80ffbbbe9095 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:57.380506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-230aecf2-138d-43d4-b7df-80ffbbbe9095 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:57.392980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aecf2-138d-43d4-b7df-80ffbbbe9095 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:57.394562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aecf2-138d-43d4-b7df-80ffbbbe9095 service placement] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:57.406400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1211/2439] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:58.413537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766840a-eaad-458c-a0b8-d378aafb801b service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:58.415750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b766840a-eaad-458c-a0b8-d378aafb801b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:58.454515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766840a-eaad-458c-a0b8-d378aafb801b service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:58.457311 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eec564-de46-4a5f-80c3-c16a5c672bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:58.457889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eec564-de46-4a5f-80c3-c16a5c672bae service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:58.458170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eec564-de46-4a5f-80c3-c16a5c672bae service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:58.458474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eec564-de46-4a5f-80c3-c16a5c672bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:58.460221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-75eec564-de46-4a5f-80c3-c16a5c672bae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:58.501425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:58.522541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eec564-de46-4a5f-80c3-c16a5c672bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:58.524002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eec564-de46-4a5f-80c3-c16a5c672bae service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:58.533919 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1229/2440] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:37:02.984232 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aecf2-138d-43d4-b7df-80ffbbbe9095 service placement] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:02.986360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-230aecf2-138d-43d4-b7df-80ffbbbe9095 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:03.006613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aecf2-138d-43d4-b7df-80ffbbbe9095 service placement] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:03.022859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c862c-06dc-4dd8-a0bd-fcea7d74c923 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:03.023515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c862c-06dc-4dd8-a0bd-fcea7d74c923 service placement] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:03.023815 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c862c-06dc-4dd8-a0bd-fcea7d74c923 service placement] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:03.024105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c862c-06dc-4dd8-a0bd-fcea7d74c923 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:03.026652 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3f1c862c-06dc-4dd8-a0bd-fcea7d74c923 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:03.039702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c862c-06dc-4dd8-a0bd-fcea7d74c923 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:03.041400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c862c-06dc-4dd8-a0bd-fcea7d74c923 service placement] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:03.053229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1212/2441] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:37:03.191437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eec564-de46-4a5f-80c3-c16a5c672bae service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:03.193453 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-75eec564-de46-4a5f-80c3-c16a5c672bae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:03.255136 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eec564-de46-4a5f-80c3-c16a5c672bae service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:03.260241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42032717-6234-4661-b483-b0ca2e103348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:03.261121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032717-6234-4661-b483-b0ca2e103348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:03.261617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032717-6234-4661-b483-b0ca2e103348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:03.261903 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032717-6234-4661-b483-b0ca2e103348 admin admin] PATH_INFO: `/v3/users/b00ef882922446daa24acef99db53519` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:03.263112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42032717-6234-4661-b483-b0ca2e103348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00ef882922446daa24acef99db53519)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:03.265424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42032717-6234-4661-b483-b0ca2e103348 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:03.490823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-42032717-6234-4661-b483-b0ca2e103348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00ef882922446daa24acef99db53519'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:03.505573 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-42032717-6234-4661-b483-b0ca2e103348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00ef882922446daa24acef99db53519'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:03.506447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-42032717-6234-4661-b483-b0ca2e103348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00ef882922446daa24acef99db53519'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:03.507055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-42032717-6234-4661-b483-b0ca2e103348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00ef882922446daa24acef99db53519'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:03.514207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-42032717-6234-4661-b483-b0ca2e103348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00ef882922446daa24acef99db53519'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:03.633812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1230/2442] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:37:03 2022] DELETE /identity/v3/users/b00ef882922446daa24acef99db53519 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:03.988163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c862c-06dc-4dd8-a0bd-fcea7d74c923 service placement] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:04.001034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c862c-06dc-4dd8-a0bd-fcea7d74c923 service placement] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:04.086482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:04.087140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:04.087491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:04.087775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92 admin admin] PATH_INFO: `/v3/projects/f1145b6597af457da0f5dc09eb281d13` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:04.088967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1145b6597af457da0f5dc09eb281d13)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:04.091132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:04.225365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1145b6597af457da0f5dc09eb281d13', 'request_id': 'req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:04.235896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1145b6597af457da0f5dc09eb281d13', 'request_id': 'req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:04.243097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1145b6597af457da0f5dc09eb281d13', 'request_id': 'req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:04.651318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:04.656899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92 admin admin] The token cache is being invalidate because project f1145b6597af457da0f5dc09eb281d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:37:04.656899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:04.657171 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-b3a0a48d-b6c0-4e08-8ada-9018da4afc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:04.658671 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1213/2443] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:37:03 2022] DELETE /identity/v3/projects/f1145b6597af457da0f5dc09eb281d13 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:04.663885 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135da5-61fd-4398-a12b-b070aceba441 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:04.664419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135da5-61fd-4398-a12b-b070aceba441 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:04.664591 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135da5-61fd-4398-a12b-b070aceba441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:04.734537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e5135da5-61fd-4398-a12b-b070aceba441 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:04.738609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e5135da5-61fd-4398-a12b-b070aceba441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:04.836673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:04.857922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1231/2444] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:04.867841 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391201ce-52f1-49bb-8101-cf327a5b35b8 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:04.868622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391201ce-52f1-49bb-8101-cf327a5b35b8 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:04.868969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391201ce-52f1-49bb-8101-cf327a5b35b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:04.896329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-391201ce-52f1-49bb-8101-cf327a5b35b8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:04.897925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-391201ce-52f1-49bb-8101-cf327a5b35b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:04.908207 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1214/2445] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:04.916565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5135da5-61fd-4398-a12b-b070aceba441 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:04.929874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5135da5-61fd-4398-a12b-b070aceba441 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:04.935809 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd76fa7-13de-4380-bc2d-0038984ac366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:04.936547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd76fa7-13de-4380-bc2d-0038984ac366 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:04.936837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd76fa7-13de-4380-bc2d-0038984ac366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:04.937101 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd76fa7-13de-4380-bc2d-0038984ac366 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:04.937886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd76fa7-13de-4380-bc2d-0038984ac366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:37:04.938193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd76fa7-13de-4380-bc2d-0038984ac366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:04.939895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd76fa7-13de-4380-bc2d-0038984ac366 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:04.955059 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1232/2446] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:37:04.959649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391201ce-52f1-49bb-8101-cf327a5b35b8 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:04.974115 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391201ce-52f1-49bb-8101-cf327a5b35b8 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:04.980744 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9479ae9-78ed-4d27-8da7-f28f305c44a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:04.981473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9479ae9-78ed-4d27-8da7-f28f305c44a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:04.981826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9479ae9-78ed-4d27-8da7-f28f305c44a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:04.982294 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9479ae9-78ed-4d27-8da7-f28f305c44a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:04.983231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9479ae9-78ed-4d27-8da7-f28f305c44a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:04.985321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9479ae9-78ed-4d27-8da7-f28f305c44a2 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:05.082038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1215/2447] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:37:04 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:37:05.086493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd76fa7-13de-4380-bc2d-0038984ac366 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:05.100126 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd76fa7-13de-4380-bc2d-0038984ac366 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:05.197868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfe760-110e-4696-a63a-eec5fb462613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:05.198963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfe760-110e-4696-a63a-eec5fb462613 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:05.198963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfe760-110e-4696-a63a-eec5fb462613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:05.199791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfe760-110e-4696-a63a-eec5fb462613 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:05.200145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfe760-110e-4696-a63a-eec5fb462613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:05.202577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfe760-110e-4696-a63a-eec5fb462613 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:05.289270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9479ae9-78ed-4d27-8da7-f28f305c44a2 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:05.298756 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1233/2448] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:37:05 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:37:05.304231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9479ae9-78ed-4d27-8da7-f28f305c44a2 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:05.317916 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9e19-35de-4e1b-bd3a-0a90b2045d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:05.318672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9e19-35de-4e1b-bd3a-0a90b2045d6c admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:05.319027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9e19-35de-4e1b-bd3a-0a90b2045d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:05.319372 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9e19-35de-4e1b-bd3a-0a90b2045d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:05.320173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a9e19-35de-4e1b-bd3a-0a90b2045d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:05.322817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a9e19-35de-4e1b-bd3a-0a90b2045d6c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:05.337690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1216/2449] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:37:05.342514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfe760-110e-4696-a63a-eec5fb462613 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:05.366924 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfe760-110e-4696-a63a-eec5fb462613 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:05.373828 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0fcf2-463e-4b38-94b9-0a1a9952980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:05.374776 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0fcf2-463e-4b38-94b9-0a1a9952980b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:05.375248 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0fcf2-463e-4b38-94b9-0a1a9952980b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:05.380299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0fcf2-463e-4b38-94b9-0a1a9952980b admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:05.380299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0fcf2-463e-4b38-94b9-0a1a9952980b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:05.380299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0fcf2-463e-4b38-94b9-0a1a9952980b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:05.402890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1234/2450] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:37:05.408581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9e19-35de-4e1b-bd3a-0a90b2045d6c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:05.431828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9e19-35de-4e1b-bd3a-0a90b2045d6c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:05.439899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfa5ba-658d-44aa-b38f-411bc95150a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:05.440577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfa5ba-658d-44aa-b38f-411bc95150a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:05.443619 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfa5ba-658d-44aa-b38f-411bc95150a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:05.443619 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfa5ba-658d-44aa-b38f-411bc95150a5 admin admin] PATH_INFO: `/v3/projects/0a7363d577c84e0f9fe8b0174273b9e6/users/9781018d57ce4c0fb0400c66874ee5dd/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:05.463353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfa5ba-658d-44aa-b38f-411bc95150a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7363d577c84e0f9fe8b0174273b9e6, user_id=9781018d57ce4c0fb0400c66874ee5dd, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:05.468167 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfa5ba-658d-44aa-b38f-411bc95150a5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:05.549241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1217/2451] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:37:05 2022] PUT /identity/v3/projects/0a7363d577c84e0f9fe8b0174273b9e6/users/9781018d57ce4c0fb0400c66874ee5dd/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:05.560426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7a193-8620-45d1-ac13-b7ef5abe1c40 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:05.560818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7a193-8620-45d1-ac13-b7ef5abe1c40 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:05.561207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7a193-8620-45d1-ac13-b7ef5abe1c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:05.604286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d1c7a193-8620-45d1-ac13-b7ef5abe1c40 None None] MFA Rules not processed for user `9781018d57ce4c0fb0400c66874ee5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:05.605626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d1c7a193-8620-45d1-ac13-b7ef5abe1c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:05.682355 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1235/2452] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:05.693673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfa5ba-658d-44aa-b38f-411bc95150a5 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:05.695407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e2cfa5ba-658d-44aa-b38f-411bc95150a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:05.771475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfa5ba-658d-44aa-b38f-411bc95150a5 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:05.776287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b8323-b88b-45a6-8cda-d41abcfa9b14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:05.776998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b8323-b88b-45a6-8cda-d41abcfa9b14 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:05.777562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b8323-b88b-45a6-8cda-d41abcfa9b14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:05.777842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b8323-b88b-45a6-8cda-d41abcfa9b14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:05.789005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b8323-b88b-45a6-8cda-d41abcfa9b14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:05.790786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b8323-b88b-45a6-8cda-d41abcfa9b14 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:05.800967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1218/2453] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:37:11.322674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8c1cd-100d-42f4-99a7-b3e0259c1f13 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:11.323313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8c1cd-100d-42f4-99a7-b3e0259c1f13 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:11.323313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8c1cd-100d-42f4-99a7-b3e0259c1f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:11.353182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-14d8c1cd-100d-42f4-99a7-b3e0259c1f13 None None] MFA Rules not processed for user `63b7b33a0dd64d44ba980122f83eba4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:11.355526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-14d8c1cd-100d-42f4-99a7-b3e0259c1f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:11.411416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:11.426890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1236/2454] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:37:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:11.889786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b8323-b88b-45a6-8cda-d41abcfa9b14 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:11.891457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-718b8323-b88b-45a6-8cda-d41abcfa9b14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:11.979266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b8323-b88b-45a6-8cda-d41abcfa9b14 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:11.985892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101b532-3fdb-47e0-88b9-20e409e64ec6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:11.986577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101b532-3fdb-47e0-88b9-20e409e64ec6 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:11.998311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101b532-3fdb-47e0-88b9-20e409e64ec6 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:11.998311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101b532-3fdb-47e0-88b9-20e409e64ec6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:11.998311 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3101b532-3fdb-47e0-88b9-20e409e64ec6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:12.003466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101b532-3fdb-47e0-88b9-20e409e64ec6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:12.005156 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101b532-3fdb-47e0-88b9-20e409e64ec6 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:12.019815 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1219/2455] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:37:18.665036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8c1cd-100d-42f4-99a7-b3e0259c1f13 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:18.732622 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8c1cd-100d-42f4-99a7-b3e0259c1f13 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:18.738661 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:18.739312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:18.739590 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:18.739865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] PATH_INFO: `/v3/users/9781018d57ce4c0fb0400c66874ee5dd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:18.741028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9781018d57ce4c0fb0400c66874ee5dd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:18.742995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:19.002530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9781018d57ce4c0fb0400c66874ee5dd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:19.016684 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9781018d57ce4c0fb0400c66874ee5dd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:19.017424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9781018d57ce4c0fb0400c66874ee5dd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:19.018456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9781018d57ce4c0fb0400c66874ee5dd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:19.025416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9781018d57ce4c0fb0400c66874ee5dd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:19.108500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1237/2456] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:37:18 2022] DELETE /identity/v3/users/9781018d57ce4c0fb0400c66874ee5dd => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:19.113393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a2907-bfc4-4924-8278-c72b0ca2463e None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:19.114441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a2907-bfc4-4924-8278-c72b0ca2463e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:19.114880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a2907-bfc4-4924-8278-c72b0ca2463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:19.137240 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-bc5a2907-bfc4-4924-8278-c72b0ca2463e None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:19.138911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bc5a2907-bfc4-4924-8278-c72b0ca2463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:19.167986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:19.205578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1220/2457] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:19.220085 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:19.221501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:19.288964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b345bb-bbb5-4434-8f42-bbe3e8ef9d57 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:19.292761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb0aec-43bf-4b0c-8130-fb1205dd4d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:19.293350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb0aec-43bf-4b0c-8130-fb1205dd4d98 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:19.293529 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb0aec-43bf-4b0c-8130-fb1205dd4d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:19.293844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb0aec-43bf-4b0c-8130-fb1205dd4d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:19.304237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb0aec-43bf-4b0c-8130-fb1205dd4d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:19.306088 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb0aec-43bf-4b0c-8130-fb1205dd4d98 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:19.318725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1238/2458] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:37:19.931713 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a2907-bfc4-4924-8278-c72b0ca2463e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:19.933245 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-bc5a2907-bfc4-4924-8278-c72b0ca2463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:19.946907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a2907-bfc4-4924-8278-c72b0ca2463e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:19.952504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:19.953151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:19.953429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:19.953701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] PATH_INFO: `/v3/projects/0a7363d577c84e0f9fe8b0174273b9e6` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:19.954922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a7363d577c84e0f9fe8b0174273b9e6)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:19.956833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:20.064558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7363d577c84e0f9fe8b0174273b9e6', 'request_id': 'req-9df793d9-45bb-4762-bffa-ae3eb51bc108'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:20.070956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7363d577c84e0f9fe8b0174273b9e6', 'request_id': 'req-9df793d9-45bb-4762-bffa-ae3eb51bc108'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:20.077425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7363d577c84e0f9fe8b0174273b9e6', 'request_id': 'req-9df793d9-45bb-4762-bffa-ae3eb51bc108'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:20.197442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] The token cache is being invalidate because project 0a7363d577c84e0f9fe8b0174273b9e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:37:20.198186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:20.198354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:20.200221 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1221/2459] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:37:19 2022] DELETE /identity/v3/projects/0a7363d577c84e0f9fe8b0174273b9e6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:25.549225 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4fa3f-7d9d-43c7-a062-b32900e70c69 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:25.549699 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4fa3f-7d9d-43c7-a062-b32900e70c69 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:25.549812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4fa3f-7d9d-43c7-a062-b32900e70c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:25.568916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:25.580422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6cd4fa3f-7d9d-43c7-a062-b32900e70c69 None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:25.581672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6cd4fa3f-7d9d-43c7-a062-b32900e70c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:25.639570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1239/2460] 10.222.0.81 () {58 vars in 967 bytes} [Mon Aug 29 20:37:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:25.805837 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:25.805837 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:25.879380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df793d9-45bb-4762-bffa-ae3eb51bc108 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:25.884498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599c376-1bcb-4ae8-9b39-17d55c5c023e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:25.885113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599c376-1bcb-4ae8-9b39-17d55c5c023e service swift] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:25.885394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599c376-1bcb-4ae8-9b39-17d55c5c023e service swift] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:25.885664 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599c376-1bcb-4ae8-9b39-17d55c5c023e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:25.895390 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599c376-1bcb-4ae8-9b39-17d55c5c023e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:25.897113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599c376-1bcb-4ae8-9b39-17d55c5c023e service swift] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:25.906463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1222/2461] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:37:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:37:35.568804 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4fa3f-7d9d-43c7-a062-b32900e70c69 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:35.570337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6cd4fa3f-7d9d-43c7-a062-b32900e70c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:35.637806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4fa3f-7d9d-43c7-a062-b32900e70c69 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:35.643104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:35.643722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:35.643998 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:35.644268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] PATH_INFO: `/v3/users/d03b0800204f4b70b33f35b4b3468d52` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:35.645404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d03b0800204f4b70b33f35b4b3468d52)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:35.647451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:35.871048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd03b0800204f4b70b33f35b4b3468d52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:35.885338 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd03b0800204f4b70b33f35b4b3468d52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:35.886096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd03b0800204f4b70b33f35b4b3468d52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:35.886796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd03b0800204f4b70b33f35b4b3468d52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:35.894597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd03b0800204f4b70b33f35b4b3468d52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:35.903223 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:35.959456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1240/2462] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:37:35 2022] DELETE /identity/v3/users/d03b0800204f4b70b33f35b4b3468d52 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:36.210793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599c376-1bcb-4ae8-9b39-17d55c5c023e service swift] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:36.222604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599c376-1bcb-4ae8-9b39-17d55c5c023e service swift] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:36.285081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:36.285712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:36.285993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:36.286296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] PATH_INFO: `/v3/projects/7c5e2204d83b4fa6bc16381b632a4714` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:36.287418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c5e2204d83b4fa6bc16381b632a4714)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:36.289380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:36.411477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5e2204d83b4fa6bc16381b632a4714', 'request_id': 'req-556699e0-f3be-44ce-b70e-c2f57359cdc3'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:36.418094 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5e2204d83b4fa6bc16381b632a4714', 'request_id': 'req-556699e0-f3be-44ce-b70e-c2f57359cdc3'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:36.424044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5e2204d83b4fa6bc16381b632a4714', 'request_id': 'req-556699e0-f3be-44ce-b70e-c2f57359cdc3'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:36.495213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] The token cache is being invalidate because project 7c5e2204d83b4fa6bc16381b632a4714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:37:36.495431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:36.496050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:36.497575 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1223/2463] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:37:36 2022] DELETE /identity/v3/projects/7c5e2204d83b4fa6bc16381b632a4714 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:36.502127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:36.503598 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:36.517273 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681bb7f-672c-42e6-b869-e33c51297043 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:36.545512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:36.591560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:36.592291 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:36.592545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:36.592821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] PATH_INFO: `/v3/users/159a9ad89fcb44858499dc7679abe481` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:36.594983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=159a9ad89fcb44858499dc7679abe481)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:36.597010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:36.767778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159a9ad89fcb44858499dc7679abe481'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:36.779838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159a9ad89fcb44858499dc7679abe481'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:36.780548 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159a9ad89fcb44858499dc7679abe481'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:36.781162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159a9ad89fcb44858499dc7679abe481'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:36.788208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159a9ad89fcb44858499dc7679abe481'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:36.867348 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1241/2464] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:37:36 2022] DELETE /identity/v3/users/159a9ad89fcb44858499dc7679abe481 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:37.145309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:37.146836 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:37.160175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556699e0-f3be-44ce-b70e-c2f57359cdc3 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:37.222438 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:37.223081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:37.223372 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:37.223649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] PATH_INFO: `/v3/projects/560b2bda236d4c2ab112b13125216c66` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:37.224784 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=560b2bda236d4c2ab112b13125216c66)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:37.226768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:37.323245 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:37.335342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560b2bda236d4c2ab112b13125216c66', 'request_id': 'req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:37.341653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560b2bda236d4c2ab112b13125216c66', 'request_id': 'req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:37.347651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560b2bda236d4c2ab112b13125216c66', 'request_id': 'req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:37.438400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] The token cache is being invalidate because project 560b2bda236d4c2ab112b13125216c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:37:37.439453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:37.440405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:37.442012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1224/2465] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:37:37 2022] DELETE /identity/v3/projects/560b2bda236d4c2ab112b13125216c66 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:46.863518 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=40,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:47.688238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:58.358072 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:58.359655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:58.421072 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4d5d4-6606-4e87-861d-0b96c147fc18 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:58.469735 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96ab45-edc1-4db0-ae81-810aa6f851b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:58.470452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96ab45-edc1-4db0-ae81-810aa6f851b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:58.470726 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96ab45-edc1-4db0-ae81-810aa6f851b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:58.470993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96ab45-edc1-4db0-ae81-810aa6f851b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:58.473258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bd96ab45-edc1-4db0-ae81-810aa6f851b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:58.537892 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96ab45-edc1-4db0-ae81-810aa6f851b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:58.539380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96ab45-edc1-4db0-ae81-810aa6f851b4 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:58.549226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1242/2466] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:38:02.251638 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:02.253155 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:02.338105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de8bbc-b0d1-4f01-9c49-3916de27fb5d admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:02.343277 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244e47f-700f-4390-b816-91d48f1d4264 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:02.343889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244e47f-700f-4390-b816-91d48f1d4264 service placement] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:02.344168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244e47f-700f-4390-b816-91d48f1d4264 service placement] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:02.344441 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244e47f-700f-4390-b816-91d48f1d4264 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:02.346187 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e244e47f-700f-4390-b816-91d48f1d4264 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:02.359616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244e47f-700f-4390-b816-91d48f1d4264 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:02.361139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244e47f-700f-4390-b816-91d48f1d4264 service placement] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:02.372461 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1225/2467] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:02.421560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96ab45-edc1-4db0-ae81-810aa6f851b4 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:02.423044 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bd96ab45-edc1-4db0-ae81-810aa6f851b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:02.437150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96ab45-edc1-4db0-ae81-810aa6f851b4 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:02.442770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50747d03-9a1d-4ca8-9e18-526f4f54d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:02.443701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50747d03-9a1d-4ca8-9e18-526f4f54d3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:02.443992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50747d03-9a1d-4ca8-9e18-526f4f54d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:02.444490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50747d03-9a1d-4ca8-9e18-526f4f54d3f4 admin admin] PATH_INFO: `/v3/users/948542e68a5c499681d5faf8507cebe7` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:02.446481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50747d03-9a1d-4ca8-9e18-526f4f54d3f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948542e68a5c499681d5faf8507cebe7)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:02.448554 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50747d03-9a1d-4ca8-9e18-526f4f54d3f4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:02.647001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-50747d03-9a1d-4ca8-9e18-526f4f54d3f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948542e68a5c499681d5faf8507cebe7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:02.657439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:02.660735 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-50747d03-9a1d-4ca8-9e18-526f4f54d3f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948542e68a5c499681d5faf8507cebe7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:02.661433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-50747d03-9a1d-4ca8-9e18-526f4f54d3f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948542e68a5c499681d5faf8507cebe7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:02.662056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-50747d03-9a1d-4ca8-9e18-526f4f54d3f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948542e68a5c499681d5faf8507cebe7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:02.669439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-50747d03-9a1d-4ca8-9e18-526f4f54d3f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948542e68a5c499681d5faf8507cebe7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:02.759517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1243/2468] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:02 2022] DELETE /identity/v3/users/948542e68a5c499681d5faf8507cebe7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:03.004538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244e47f-700f-4390-b816-91d48f1d4264 service placement] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:03.017432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244e47f-700f-4390-b816-91d48f1d4264 service placement] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:03.080940 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab355bdb-5826-4204-9447-6cd82dabb5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:03.081565 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab355bdb-5826-4204-9447-6cd82dabb5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:03.081843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab355bdb-5826-4204-9447-6cd82dabb5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:03.082148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab355bdb-5826-4204-9447-6cd82dabb5dd admin admin] PATH_INFO: `/v3/projects/5df4efab927a4696a73b88cde0fb0ff9` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:03.083738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab355bdb-5826-4204-9447-6cd82dabb5dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df4efab927a4696a73b88cde0fb0ff9)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:03.085630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab355bdb-5826-4204-9447-6cd82dabb5dd admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:03.222646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ab355bdb-5826-4204-9447-6cd82dabb5dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df4efab927a4696a73b88cde0fb0ff9', 'request_id': 'req-ab355bdb-5826-4204-9447-6cd82dabb5dd'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:03.229410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ab355bdb-5826-4204-9447-6cd82dabb5dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df4efab927a4696a73b88cde0fb0ff9', 'request_id': 'req-ab355bdb-5826-4204-9447-6cd82dabb5dd'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:03.235331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ab355bdb-5826-4204-9447-6cd82dabb5dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df4efab927a4696a73b88cde0fb0ff9', 'request_id': 'req-ab355bdb-5826-4204-9447-6cd82dabb5dd'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:03.330010 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ab355bdb-5826-4204-9447-6cd82dabb5dd admin admin] The token cache is being invalidate because project 5df4efab927a4696a73b88cde0fb0ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:03.330718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ab355bdb-5826-4204-9447-6cd82dabb5dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:03.330914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ab355bdb-5826-4204-9447-6cd82dabb5dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:03.333018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1226/2469] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:03 2022] DELETE /identity/v3/projects/5df4efab927a4696a73b88cde0fb0ff9 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:03.338168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf332e8-ec36-4665-94d6-944e23579e08 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:03.338480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf332e8-ec36-4665-94d6-944e23579e08 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:03.338750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf332e8-ec36-4665-94d6-944e23579e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:03.360760 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-daf332e8-ec36-4665-94d6-944e23579e08 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:03.361235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-daf332e8-ec36-4665-94d6-944e23579e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:03.425687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1244/2470] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:03.434683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27fcf7-f7bf-47bf-af56-69a909aca8e7 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:03.434972 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27fcf7-f7bf-47bf-af56-69a909aca8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:03.435247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27fcf7-f7bf-47bf-af56-69a909aca8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:03.457860 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-9b27fcf7-f7bf-47bf-af56-69a909aca8e7 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:03.459133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9b27fcf7-f7bf-47bf-af56-69a909aca8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:03.467282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1227/2471] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:03.475141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf332e8-ec36-4665-94d6-944e23579e08 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:03.485145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf332e8-ec36-4665-94d6-944e23579e08 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:03.489863 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b54aa-8695-4d95-bce5-3890f731bc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:03.490685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b54aa-8695-4d95-bce5-3890f731bc36 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:03.491148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b54aa-8695-4d95-bce5-3890f731bc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:03.491601 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b54aa-8695-4d95-bce5-3890f731bc36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:03.492652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b54aa-8695-4d95-bce5-3890f731bc36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:03.493144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b54aa-8695-4d95-bce5-3890f731bc36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:03.495836 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b54aa-8695-4d95-bce5-3890f731bc36 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:03.511990 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1245/2472] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:03.518750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27fcf7-f7bf-47bf-af56-69a909aca8e7 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:03.531361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27fcf7-f7bf-47bf-af56-69a909aca8e7 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:03.537034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29913eb4-c2f9-47f3-ad57-70bdcf5c20ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:03.537650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29913eb4-c2f9-47f3-ad57-70bdcf5c20ef admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:03.537931 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29913eb4-c2f9-47f3-ad57-70bdcf5c20ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:03.538205 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29913eb4-c2f9-47f3-ad57-70bdcf5c20ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:03.538896 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29913eb4-c2f9-47f3-ad57-70bdcf5c20ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:03.541008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29913eb4-c2f9-47f3-ad57-70bdcf5c20ef admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:03.557710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:03.681357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1228/2473] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:03 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:03.685581 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b54aa-8695-4d95-bce5-3890f731bc36 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:03.696746 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b54aa-8695-4d95-bce5-3890f731bc36 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:03.757842 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7462-d320-4ea4-b9c7-77325f248eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:03.758788 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7462-d320-4ea4-b9c7-77325f248eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:03.759176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7462-d320-4ea4-b9c7-77325f248eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:03.759554 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7462-d320-4ea4-b9c7-77325f248eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:03.760403 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c7462-d320-4ea4-b9c7-77325f248eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:03.762590 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c7462-d320-4ea4-b9c7-77325f248eb5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:03.866477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1246/2474] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:03 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:03.870919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29913eb4-c2f9-47f3-ad57-70bdcf5c20ef admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:03.882544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29913eb4-c2f9-47f3-ad57-70bdcf5c20ef admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:03.887493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a6a80-46c4-4fef-a4e6-54e2939fc41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:03.888112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a6a80-46c4-4fef-a4e6-54e2939fc41a admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:03.888392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a6a80-46c4-4fef-a4e6-54e2939fc41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:03.888704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a6a80-46c4-4fef-a4e6-54e2939fc41a admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:03.889356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a6a80-46c4-4fef-a4e6-54e2939fc41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:03.891407 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a6a80-46c4-4fef-a4e6-54e2939fc41a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:03.904236 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1229/2475] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:03.908663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7462-d320-4ea4-b9c7-77325f248eb5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:03.930681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7462-d320-4ea4-b9c7-77325f248eb5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:03.935663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b551b5-fb6b-444f-9588-9262ab75a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:03.936274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b551b5-fb6b-444f-9588-9262ab75a013 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:03.936551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b551b5-fb6b-444f-9588-9262ab75a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:03.936953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b551b5-fb6b-444f-9588-9262ab75a013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:03.937626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b551b5-fb6b-444f-9588-9262ab75a013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:03.939225 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b551b5-fb6b-444f-9588-9262ab75a013 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:03.950555 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1247/2476] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:03.954919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a6a80-46c4-4fef-a4e6-54e2939fc41a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:03.965648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a6a80-46c4-4fef-a4e6-54e2939fc41a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:03.970792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498db2d7-ac6b-497c-b841-8c295c732c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:03.971451 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498db2d7-ac6b-497c-b841-8c295c732c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:03.971734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498db2d7-ac6b-497c-b841-8c295c732c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:03.972009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498db2d7-ac6b-497c-b841-8c295c732c6b admin admin] PATH_INFO: `/v3/projects/335619acfd894e71867795b12c10a136/users/1bf51335d8404c1fb4829a747a1f6ef0/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:03.988822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498db2d7-ac6b-497c-b841-8c295c732c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=335619acfd894e71867795b12c10a136, user_id=1bf51335d8404c1fb4829a747a1f6ef0, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:03.990769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498db2d7-ac6b-497c-b841-8c295c732c6b admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:04.102508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1230/2477] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:03 2022] PUT /identity/v3/projects/335619acfd894e71867795b12c10a136/users/1bf51335d8404c1fb4829a747a1f6ef0/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:04.112670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d7c34-542f-4962-a2e1-41950bc8f0eb None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:04.112957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d7c34-542f-4962-a2e1-41950bc8f0eb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:04.113232 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d7c34-542f-4962-a2e1-41950bc8f0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:04.147700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-237d7c34-542f-4962-a2e1-41950bc8f0eb None None] MFA Rules not processed for user `1bf51335d8404c1fb4829a747a1f6ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:04.148959 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-237d7c34-542f-4962-a2e1-41950bc8f0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:04.187217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:04.227002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1248/2478] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:04.239887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498db2d7-ac6b-497c-b841-8c295c732c6b admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:04.241689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-498db2d7-ac6b-497c-b841-8c295c732c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:04.307619 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498db2d7-ac6b-497c-b841-8c295c732c6b admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:04.311394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59796d24-dffb-4efb-b4b5-3a536a1d5ee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:04.312696 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59796d24-dffb-4efb-b4b5-3a536a1d5ee5 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:04.312983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59796d24-dffb-4efb-b4b5-3a536a1d5ee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:04.313260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59796d24-dffb-4efb-b4b5-3a536a1d5ee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:04.323178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59796d24-dffb-4efb-b4b5-3a536a1d5ee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:04.324613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59796d24-dffb-4efb-b4b5-3a536a1d5ee5 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:04.334578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1231/2479] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:14.329699 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:14.401307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d7c34-542f-4962-a2e1-41950bc8f0eb None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:14.466792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d7c34-542f-4962-a2e1-41950bc8f0eb None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:14.471388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:14.477849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:14.477849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:14.477849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] PATH_INFO: `/v3/users/1bf51335d8404c1fb4829a747a1f6ef0` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:14.477849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf51335d8404c1fb4829a747a1f6ef0)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:14.477849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:14.789751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf51335d8404c1fb4829a747a1f6ef0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:14.802621 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf51335d8404c1fb4829a747a1f6ef0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:14.804791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf51335d8404c1fb4829a747a1f6ef0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:14.804791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf51335d8404c1fb4829a747a1f6ef0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:14.813107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf51335d8404c1fb4829a747a1f6ef0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:14.907920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1249/2480] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:14 2022] DELETE /identity/v3/users/1bf51335d8404c1fb4829a747a1f6ef0 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:14.912707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ec39b-df7e-4e95-86ac-93a810408e05 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:14.912989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ec39b-df7e-4e95-86ac-93a810408e05 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:14.913244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ec39b-df7e-4e95-86ac-93a810408e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:14.934750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ff7ec39b-df7e-4e95-86ac-93a810408e05 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:14.935996 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ff7ec39b-df7e-4e95-86ac-93a810408e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:15.002971 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1232/2481] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:15.013346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:15.014822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:15.081289 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b735a4-a44d-4cbc-865d-f30ca339e210 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:15.085583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f2ac4-d161-4bfd-83e9-edb115430ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:15.086201 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f2ac4-d161-4bfd-83e9-edb115430ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:15.086510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f2ac4-d161-4bfd-83e9-edb115430ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:15.086797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f2ac4-d161-4bfd-83e9-edb115430ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:15.094504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:15.097158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f2ac4-d161-4bfd-83e9-edb115430ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:15.100169 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f2ac4-d161-4bfd-83e9-edb115430ad1 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:15.110792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1250/2482] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:15.617536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ec39b-df7e-4e95-86ac-93a810408e05 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:15.620308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ff7ec39b-df7e-4e95-86ac-93a810408e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:15.631144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ec39b-df7e-4e95-86ac-93a810408e05 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:15.636028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eb80b-740d-47f8-9ad9-91d51354f873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:15.636689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eb80b-740d-47f8-9ad9-91d51354f873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:15.637017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eb80b-740d-47f8-9ad9-91d51354f873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:15.637393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eb80b-740d-47f8-9ad9-91d51354f873 admin admin] PATH_INFO: `/v3/projects/335619acfd894e71867795b12c10a136` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:15.639617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2eb80b-740d-47f8-9ad9-91d51354f873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=335619acfd894e71867795b12c10a136)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:15.641903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2eb80b-740d-47f8-9ad9-91d51354f873 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:15.742589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ab2eb80b-740d-47f8-9ad9-91d51354f873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335619acfd894e71867795b12c10a136', 'request_id': 'req-ab2eb80b-740d-47f8-9ad9-91d51354f873'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:15.748929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ab2eb80b-740d-47f8-9ad9-91d51354f873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335619acfd894e71867795b12c10a136', 'request_id': 'req-ab2eb80b-740d-47f8-9ad9-91d51354f873'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:15.755342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ab2eb80b-740d-47f8-9ad9-91d51354f873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335619acfd894e71867795b12c10a136', 'request_id': 'req-ab2eb80b-740d-47f8-9ad9-91d51354f873'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:15.849973 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ab2eb80b-740d-47f8-9ad9-91d51354f873 admin admin] The token cache is being invalidate because project 335619acfd894e71867795b12c10a136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:15.850288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ab2eb80b-740d-47f8-9ad9-91d51354f873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:15.850954 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-ab2eb80b-740d-47f8-9ad9-91d51354f873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:15.852508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1233/2483] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:15 2022] DELETE /identity/v3/projects/335619acfd894e71867795b12c10a136 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:15.859276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf46cf-d656-4a9c-9d60-536b2b1d9942 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:15.859824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf46cf-d656-4a9c-9d60-536b2b1d9942 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:15.860024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf46cf-d656-4a9c-9d60-536b2b1d9942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:15.881439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a0bf46cf-d656-4a9c-9d60-536b2b1d9942 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:15.882742 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a0bf46cf-d656-4a9c-9d60-536b2b1d9942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:15.949614 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1251/2484] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:15.957763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650070b-d8f9-4774-b52b-32a2a459d86d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:15.958047 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650070b-d8f9-4774-b52b-32a2a459d86d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:15.958360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650070b-d8f9-4774-b52b-32a2a459d86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:15.978847 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d650070b-d8f9-4774-b52b-32a2a459d86d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:15.980368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d650070b-d8f9-4774-b52b-32a2a459d86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:15.988496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1234/2485] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:15.993537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf46cf-d656-4a9c-9d60-536b2b1d9942 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:16.003433 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf46cf-d656-4a9c-9d60-536b2b1d9942 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:16.008938 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3d181-66d8-4f56-acda-d794e21b108d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:16.009533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3d181-66d8-4f56-acda-d794e21b108d admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:16.009810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3d181-66d8-4f56-acda-d794e21b108d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:16.010078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3d181-66d8-4f56-acda-d794e21b108d admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:16.010826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3d181-66d8-4f56-acda-d794e21b108d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:16.011127 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3d181-66d8-4f56-acda-d794e21b108d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:16.012704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3d181-66d8-4f56-acda-d794e21b108d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:16.025600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1252/2486] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:16.029861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650070b-d8f9-4774-b52b-32a2a459d86d None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:16.040008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650070b-d8f9-4774-b52b-32a2a459d86d None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:16.044648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b4a61-cf44-4c7c-b26b-3da780800878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:16.045233 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b4a61-cf44-4c7c-b26b-3da780800878 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:16.045514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b4a61-cf44-4c7c-b26b-3da780800878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:16.045785 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b4a61-cf44-4c7c-b26b-3da780800878 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:16.046508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b4a61-cf44-4c7c-b26b-3da780800878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:16.048394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b4a61-cf44-4c7c-b26b-3da780800878 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:16.143237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1235/2487] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:16 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:16.148472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3d181-66d8-4f56-acda-d794e21b108d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:16.159155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3d181-66d8-4f56-acda-d794e21b108d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:16.220554 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0f00b-32e5-4590-91d3-b2c195bfb731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:16.221255 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0f00b-32e5-4590-91d3-b2c195bfb731 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:16.221529 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0f00b-32e5-4590-91d3-b2c195bfb731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:16.221797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0f00b-32e5-4590-91d3-b2c195bfb731 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:16.222557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0f00b-32e5-4590-91d3-b2c195bfb731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:16.224927 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0f00b-32e5-4590-91d3-b2c195bfb731 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:16.313003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1253/2488] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:16 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:16.317789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b4a61-cf44-4c7c-b26b-3da780800878 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:16.328421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b4a61-cf44-4c7c-b26b-3da780800878 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:16.335095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10116fa3-aba6-4702-897c-360ad7325a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:16.335721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10116fa3-aba6-4702-897c-360ad7325a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:16.336008 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10116fa3-aba6-4702-897c-360ad7325a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:16.336285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10116fa3-aba6-4702-897c-360ad7325a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:16.336946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10116fa3-aba6-4702-897c-360ad7325a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:16.339436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10116fa3-aba6-4702-897c-360ad7325a95 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:16.351124 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1236/2489] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:38:16.359294 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0f00b-32e5-4590-91d3-b2c195bfb731 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:16.367845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0f00b-32e5-4590-91d3-b2c195bfb731 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:16.372957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5100b-f7f2-480e-aa69-a39774785b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:16.373565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5100b-f7f2-480e-aa69-a39774785b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:16.373850 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5100b-f7f2-480e-aa69-a39774785b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:16.374125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5100b-f7f2-480e-aa69-a39774785b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:16.374837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5100b-f7f2-480e-aa69-a39774785b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:16.380138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5100b-f7f2-480e-aa69-a39774785b70 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:16.388564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1254/2490] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:16.393130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10116fa3-aba6-4702-897c-360ad7325a95 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:16.407358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10116fa3-aba6-4702-897c-360ad7325a95 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:16.412861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e196ad3-e943-4769-b8dc-c3dc5bee25cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:16.413527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e196ad3-e943-4769-b8dc-c3dc5bee25cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:16.413861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e196ad3-e943-4769-b8dc-c3dc5bee25cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:16.414135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e196ad3-e943-4769-b8dc-c3dc5bee25cc admin admin] PATH_INFO: `/v3/projects/af3e2e38a9134e09851d3d933b2aad40/users/d58c31db51304c89bac1c9dcf7ea87cd/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:16.430769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e196ad3-e943-4769-b8dc-c3dc5bee25cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3e2e38a9134e09851d3d933b2aad40, user_id=d58c31db51304c89bac1c9dcf7ea87cd, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:16.433501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e196ad3-e943-4769-b8dc-c3dc5bee25cc admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:16.508328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1237/2491] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:16 2022] PUT /identity/v3/projects/af3e2e38a9134e09851d3d933b2aad40/users/d58c31db51304c89bac1c9dcf7ea87cd/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:16.521772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eea1f8-f6ab-45b5-b189-db0a8612c106 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:16.522113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eea1f8-f6ab-45b5-b189-db0a8612c106 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:16.522420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eea1f8-f6ab-45b5-b189-db0a8612c106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:16.554794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-00eea1f8-f6ab-45b5-b189-db0a8612c106 None None] MFA Rules not processed for user `d58c31db51304c89bac1c9dcf7ea87cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:16.556065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-00eea1f8-f6ab-45b5-b189-db0a8612c106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:16.618132 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:16.635140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1255/2492] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:16.639729 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e196ad3-e943-4769-b8dc-c3dc5bee25cc admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:16.664889 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:16.706080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e196ad3-e943-4769-b8dc-c3dc5bee25cc admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:16.711404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f797fd8-2327-4179-950c-eae373d5beb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:16.712214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f797fd8-2327-4179-950c-eae373d5beb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:16.712789 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f797fd8-2327-4179-950c-eae373d5beb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:16.713454 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f797fd8-2327-4179-950c-eae373d5beb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:16.714268 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f797fd8-2327-4179-950c-eae373d5beb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:16.716374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f797fd8-2327-4179-950c-eae373d5beb1 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:16.806276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1238/2493] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:16 2022] POST /identity/v3/projects => generated 393 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:16.810904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eea1f8-f6ab-45b5-b189-db0a8612c106 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:16.821719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eea1f8-f6ab-45b5-b189-db0a8612c106 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:16.880694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad057341-84e2-4918-b986-a8ccaf432027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:16.881313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad057341-84e2-4918-b986-a8ccaf432027 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:16.881581 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad057341-84e2-4918-b986-a8ccaf432027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:16.881854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad057341-84e2-4918-b986-a8ccaf432027 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:16.882541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad057341-84e2-4918-b986-a8ccaf432027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:16.884459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad057341-84e2-4918-b986-a8ccaf432027 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:16.984965 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1256/2494] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:16 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:16.986361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f797fd8-2327-4179-950c-eae373d5beb1 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:16.999178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f797fd8-2327-4179-950c-eae373d5beb1 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.005945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6f25c-f6f4-4322-9edc-9f845885053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.006759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6f25c-f6f4-4322-9edc-9f845885053c admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.007237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6f25c-f6f4-4322-9edc-9f845885053c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.007651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6f25c-f6f4-4322-9edc-9f845885053c admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.008647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6f25c-f6f4-4322-9edc-9f845885053c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.011148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6f25c-f6f4-4322-9edc-9f845885053c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.026992 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1239/2495] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:17.028342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad057341-84e2-4918-b986-a8ccaf432027 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.039780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad057341-84e2-4918-b986-a8ccaf432027 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.044620 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b9824-d2e8-4e61-8464-802cebe5ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.045277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b9824-d2e8-4e61-8464-802cebe5ce80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.045559 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b9824-d2e8-4e61-8464-802cebe5ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.045830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b9824-d2e8-4e61-8464-802cebe5ce80 admin admin] PATH_INFO: `/v3/projects/7e766544b56f47b2902117b7c5354756/users/56ab3263a8be49dc97b9468175b8c7c9/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.063237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b9824-d2e8-4e61-8464-802cebe5ce80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e766544b56f47b2902117b7c5354756, user_id=56ab3263a8be49dc97b9468175b8c7c9, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.065968 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b9824-d2e8-4e61-8464-802cebe5ce80 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.146500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1257/2496] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:17 2022] PUT /identity/v3/projects/7e766544b56f47b2902117b7c5354756/users/56ab3263a8be49dc97b9468175b8c7c9/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:17.150587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6f25c-f6f4-4322-9edc-9f845885053c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.161852 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6f25c-f6f4-4322-9edc-9f845885053c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.222161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929c7af-ba53-4742-b879-2b4c7e60ebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.222868 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929c7af-ba53-4742-b879-2b4c7e60ebeb admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.223930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929c7af-ba53-4742-b879-2b4c7e60ebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.224209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929c7af-ba53-4742-b879-2b4c7e60ebeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.224855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929c7af-ba53-4742-b879-2b4c7e60ebeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.226490 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929c7af-ba53-4742-b879-2b4c7e60ebeb admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.237680 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1240/2497] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:17.242585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b9824-d2e8-4e61-8464-802cebe5ce80 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.253034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b9824-d2e8-4e61-8464-802cebe5ce80 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.258767 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd58a6-0090-44af-852b-6a5f6af8b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.259448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd58a6-0090-44af-852b-6a5f6af8b4ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.263245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd58a6-0090-44af-852b-6a5f6af8b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.263245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd58a6-0090-44af-852b-6a5f6af8b4ca admin admin] PATH_INFO: `/v3/projects/7e766544b56f47b2902117b7c5354756/users/56ab3263a8be49dc97b9468175b8c7c9/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.263245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd58a6-0090-44af-852b-6a5f6af8b4ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e766544b56f47b2902117b7c5354756, user_id=56ab3263a8be49dc97b9468175b8c7c9, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.265470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd58a6-0090-44af-852b-6a5f6af8b4ca admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.280704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1258/2498] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:17 2022] PUT /identity/v3/projects/7e766544b56f47b2902117b7c5354756/users/56ab3263a8be49dc97b9468175b8c7c9/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:17.297566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e322-c331-4933-a2d9-61c0fdc36a46 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.301037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e322-c331-4933-a2d9-61c0fdc36a46 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.301037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e322-c331-4933-a2d9-61c0fdc36a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.329023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-5215e322-c331-4933-a2d9-61c0fdc36a46 None None] MFA Rules not processed for user `56ab3263a8be49dc97b9468175b8c7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:17.330264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5215e322-c331-4933-a2d9-61c0fdc36a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:17.409313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1241/2499] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:17.421224 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd58a6-0090-44af-852b-6a5f6af8b4ca admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.422964 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cefd58a6-0090-44af-852b-6a5f6af8b4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:17.486244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd58a6-0090-44af-852b-6a5f6af8b4ca admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.495184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34269d26-e18d-4ec1-90c1-b24aa980d07c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.495812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34269d26-e18d-4ec1-90c1-b24aa980d07c service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.496198 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34269d26-e18d-4ec1-90c1-b24aa980d07c service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.496469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34269d26-e18d-4ec1-90c1-b24aa980d07c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.508106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34269d26-e18d-4ec1-90c1-b24aa980d07c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.513043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34269d26-e18d-4ec1-90c1-b24aa980d07c service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.524927 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1259/2500] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:17.573267 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215e322-c331-4933-a2d9-61c0fdc36a46 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.574678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5215e322-c331-4933-a2d9-61c0fdc36a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:17.587637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215e322-c331-4933-a2d9-61c0fdc36a46 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.610729 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e500c-3c5c-4691-9b78-3e3a78186592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.610729 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e500c-3c5c-4691-9b78-3e3a78186592 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.610729 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e500c-3c5c-4691-9b78-3e3a78186592 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.610729 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e500c-3c5c-4691-9b78-3e3a78186592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.625763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:17.686463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e500c-3c5c-4691-9b78-3e3a78186592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.687923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e500c-3c5c-4691-9b78-3e3a78186592 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.698816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1242/2501] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:17 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:23.111037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34269d26-e18d-4ec1-90c1-b24aa980d07c service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:23.163844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:23.179710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34269d26-e18d-4ec1-90c1-b24aa980d07c service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:23.184416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:23.185064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:23.185344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:23.185615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] PATH_INFO: `/v3/users/d58c31db51304c89bac1c9dcf7ea87cd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:23.186834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58c31db51304c89bac1c9dcf7ea87cd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:23.194311 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:23.493320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58c31db51304c89bac1c9dcf7ea87cd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.507767 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58c31db51304c89bac1c9dcf7ea87cd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.508664 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58c31db51304c89bac1c9dcf7ea87cd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.509221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58c31db51304c89bac1c9dcf7ea87cd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.517100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58c31db51304c89bac1c9dcf7ea87cd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.614193 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1260/2502] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:23 2022] DELETE /identity/v3/users/d58c31db51304c89bac1c9dcf7ea87cd => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:23.620059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e95d24-bffb-4cf2-bf41-fc34037ff91c None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:23.620915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e95d24-bffb-4cf2-bf41-fc34037ff91c None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:23.621107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e95d24-bffb-4cf2-bf41-fc34037ff91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:23.646843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-93e95d24-bffb-4cf2-bf41-fc34037ff91c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:23.648111 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-93e95d24-bffb-4cf2-bf41-fc34037ff91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:23.730218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1243/2503] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:23.743028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:23.748546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:23.821282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97965d-ec29-4d0e-926d-244a6111747f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:23.825533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acb11c-7b9b-4751-bb91-d53082a80e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:23.826164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acb11c-7b9b-4751-bb91-d53082a80e31 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:23.826469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acb11c-7b9b-4751-bb91-d53082a80e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:23.826738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acb11c-7b9b-4751-bb91-d53082a80e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:23.838457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acb11c-7b9b-4751-bb91-d53082a80e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:23.839900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acb11c-7b9b-4751-bb91-d53082a80e31 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:23.851827 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1261/2504] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:38:24.379398 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e95d24-bffb-4cf2-bf41-fc34037ff91c None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.380127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-93e95d24-bffb-4cf2-bf41-fc34037ff91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:24.401917 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e95d24-bffb-4cf2-bf41-fc34037ff91c None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.412524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.413745 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.413745 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.414116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] PATH_INFO: `/v3/projects/af3e2e38a9134e09851d3d933b2aad40` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.415172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3e2e38a9134e09851d3d933b2aad40)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.417313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.602872 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3e2e38a9134e09851d3d933b2aad40', 'request_id': 'req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.609166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3e2e38a9134e09851d3d933b2aad40', 'request_id': 'req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.615369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3e2e38a9134e09851d3d933b2aad40', 'request_id': 'req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.798180 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] The token cache is being invalidate because project af3e2e38a9134e09851d3d933b2aad40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:24.798901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.799152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.801400 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1244/2505] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:24 2022] DELETE /identity/v3/projects/af3e2e38a9134e09851d3d933b2aad40 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:24.805881 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acb11c-7b9b-4751-bb91-d53082a80e31 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.823039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acb11c-7b9b-4751-bb91-d53082a80e31 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.890837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ebb16-ed5a-466f-a827-2e044afb9af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.891819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ebb16-ed5a-466f-a827-2e044afb9af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.892277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ebb16-ed5a-466f-a827-2e044afb9af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.892618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ebb16-ed5a-466f-a827-2e044afb9af9 admin admin] PATH_INFO: `/v3/users/56ab3263a8be49dc97b9468175b8c7c9` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.893918 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ebb16-ed5a-466f-a827-2e044afb9af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ab3263a8be49dc97b9468175b8c7c9)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.896093 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ebb16-ed5a-466f-a827-2e044afb9af9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.907083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:25.128765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-141ebb16-ed5a-466f-a827-2e044afb9af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ab3263a8be49dc97b9468175b8c7c9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.140830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-141ebb16-ed5a-466f-a827-2e044afb9af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ab3263a8be49dc97b9468175b8c7c9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.141798 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-141ebb16-ed5a-466f-a827-2e044afb9af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ab3263a8be49dc97b9468175b8c7c9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.142436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-141ebb16-ed5a-466f-a827-2e044afb9af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ab3263a8be49dc97b9468175b8c7c9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.149969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-141ebb16-ed5a-466f-a827-2e044afb9af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ab3263a8be49dc97b9468175b8c7c9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.238920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1262/2506] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:24 2022] DELETE /identity/v3/users/56ab3263a8be49dc97b9468175b8c7c9 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:25.691163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:25.693463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:25.707967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5af07c-ff72-4622-9a9b-70e1c27f25cb admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:25.747032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:25.778660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:25.779312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:25.779597 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:25.779873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2 admin admin] PATH_INFO: `/v3/projects/7e766544b56f47b2902117b7c5354756` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:25.781187 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e766544b56f47b2902117b7c5354756)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:25.783196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:25.930107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e766544b56f47b2902117b7c5354756', 'request_id': 'req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.938047 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e766544b56f47b2902117b7c5354756', 'request_id': 'req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.946471 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e766544b56f47b2902117b7c5354756', 'request_id': 'req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:26.033802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2 admin admin] The token cache is being invalidate because project 7e766544b56f47b2902117b7c5354756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:26.038520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:26.038520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-5e157d36-3ee5-4fb0-8d33-52d2e5130db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:26.038520 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1245/2507] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:25 2022] DELETE /identity/v3/projects/7e766544b56f47b2902117b7c5354756 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:26.042486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b05a-af73-4bc3-9bf9-380e0b4f9104 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.043049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b05a-af73-4bc3-9bf9-380e0b4f9104 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.043163 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b05a-af73-4bc3-9bf9-380e0b4f9104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.066907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-46a6b05a-af73-4bc3-9bf9-380e0b4f9104 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:26.068763 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-46a6b05a-af73-4bc3-9bf9-380e0b4f9104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:26.149037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1263/2508] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:26.156800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9de12c-3724-410c-8da0-1b789fb0ff8b None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.157136 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9de12c-3724-410c-8da0-1b789fb0ff8b None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.157413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9de12c-3724-410c-8da0-1b789fb0ff8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.179183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-ff9de12c-3724-410c-8da0-1b789fb0ff8b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:26.180464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ff9de12c-3724-410c-8da0-1b789fb0ff8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:26.188924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1246/2509] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:26.193710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6b05a-af73-4bc3-9bf9-380e0b4f9104 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:26.203496 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6b05a-af73-4bc3-9bf9-380e0b4f9104 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:26.208648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cd0cc-72e7-447b-8a9b-72edb094f5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:26.209244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cd0cc-72e7-447b-8a9b-72edb094f5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.209558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cd0cc-72e7-447b-8a9b-72edb094f5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.209832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cd0cc-72e7-447b-8a9b-72edb094f5b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.210519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cd0cc-72e7-447b-8a9b-72edb094f5b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:26.210813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cd0cc-72e7-447b-8a9b-72edb094f5b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:26.212408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cd0cc-72e7-447b-8a9b-72edb094f5b0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:26.225226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1264/2510] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:26.229773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9de12c-3724-410c-8da0-1b789fb0ff8b None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:26.239487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9de12c-3724-410c-8da0-1b789fb0ff8b None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:26.244591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212db594-3ae7-47c8-82f6-412824d28dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:26.245226 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212db594-3ae7-47c8-82f6-412824d28dde admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.246308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212db594-3ae7-47c8-82f6-412824d28dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.246597 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212db594-3ae7-47c8-82f6-412824d28dde admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.247294 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212db594-3ae7-47c8-82f6-412824d28dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:26.249418 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212db594-3ae7-47c8-82f6-412824d28dde admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:26.353968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1247/2511] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:26 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:26.358102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cd0cc-72e7-447b-8a9b-72edb094f5b0 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:26.369092 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cd0cc-72e7-447b-8a9b-72edb094f5b0 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:26.431048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c6052-5c96-41ca-9c2d-0348195e83de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:26.431660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c6052-5c96-41ca-9c2d-0348195e83de admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.431945 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c6052-5c96-41ca-9c2d-0348195e83de admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.432216 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c6052-5c96-41ca-9c2d-0348195e83de admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.432867 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c6052-5c96-41ca-9c2d-0348195e83de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:26.434854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c6052-5c96-41ca-9c2d-0348195e83de admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:26.519717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1265/2512] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:26 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:26.532688 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212db594-3ae7-47c8-82f6-412824d28dde admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:26.544740 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212db594-3ae7-47c8-82f6-412824d28dde admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:26.549721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9de1c-4698-44de-9554-dcd4dc5f60e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:26.550411 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9de1c-4698-44de-9554-dcd4dc5f60e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.550694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9de1c-4698-44de-9554-dcd4dc5f60e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.550988 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9de1c-4698-44de-9554-dcd4dc5f60e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.551654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9de1c-4698-44de-9554-dcd4dc5f60e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:26.553273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9de1c-4698-44de-9554-dcd4dc5f60e8 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:26.569078 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1248/2513] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:26.570666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c6052-5c96-41ca-9c2d-0348195e83de admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:26.577744 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:26.585405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c6052-5c96-41ca-9c2d-0348195e83de admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:26.590792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b68c44-1325-41b4-8534-e55b1ac2676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:26.591453 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b68c44-1325-41b4-8534-e55b1ac2676f admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.591732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b68c44-1325-41b4-8534-e55b1ac2676f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.592007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b68c44-1325-41b4-8534-e55b1ac2676f admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.592663 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b68c44-1325-41b4-8534-e55b1ac2676f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:26.594372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b68c44-1325-41b4-8534-e55b1ac2676f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:26.606765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1266/2514] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:38:26.611378 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9de1c-4698-44de-9554-dcd4dc5f60e8 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:26.622288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9de1c-4698-44de-9554-dcd4dc5f60e8 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:26.629728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e871ea-e0de-4bda-ade1-ffac1aad9693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:26.629728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e871ea-e0de-4bda-ade1-ffac1aad9693 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.629728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e871ea-e0de-4bda-ade1-ffac1aad9693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.629728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e871ea-e0de-4bda-ade1-ffac1aad9693 admin admin] PATH_INFO: `/v3/projects/56d9db36f62d473d958693cb7c781699/users/5141edc619d342cebb0be0be86cc0212/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.646901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e871ea-e0de-4bda-ade1-ffac1aad9693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d9db36f62d473d958693cb7c781699, user_id=5141edc619d342cebb0be0be86cc0212, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:26.649631 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e871ea-e0de-4bda-ade1-ffac1aad9693 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:26.725506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1249/2515] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:26 2022] PUT /identity/v3/projects/56d9db36f62d473d958693cb7c781699/users/5141edc619d342cebb0be0be86cc0212/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:26.737845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d3033-97f2-48ee-b391-a896c8ac9e35 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.738381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d3033-97f2-48ee-b391-a896c8ac9e35 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.738817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d3033-97f2-48ee-b391-a896c8ac9e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.774175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-788d3033-97f2-48ee-b391-a896c8ac9e35 None None] MFA Rules not processed for user `5141edc619d342cebb0be0be86cc0212`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:26.775458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-788d3033-97f2-48ee-b391-a896c8ac9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:26.852152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1267/2516] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:26.861687 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e871ea-e0de-4bda-ade1-ffac1aad9693 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:26.933210 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e871ea-e0de-4bda-ade1-ffac1aad9693 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:26.938064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca9e03-9078-43c0-bc07-2bd74e9efc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:26.938697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca9e03-9078-43c0-bc07-2bd74e9efc39 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.939020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca9e03-9078-43c0-bc07-2bd74e9efc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.939395 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca9e03-9078-43c0-bc07-2bd74e9efc39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.940023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca9e03-9078-43c0-bc07-2bd74e9efc39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:26.942158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca9e03-9078-43c0-bc07-2bd74e9efc39 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:26.952649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:27.057524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1250/2517] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:26 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:38:27.061394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d3033-97f2-48ee-b391-a896c8ac9e35 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:27.072184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d3033-97f2-48ee-b391-a896c8ac9e35 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:27.135980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271091b-3cf2-45e6-941f-e5d109a134bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:27.136768 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271091b-3cf2-45e6-941f-e5d109a134bc admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:27.137030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271091b-3cf2-45e6-941f-e5d109a134bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:27.137387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271091b-3cf2-45e6-941f-e5d109a134bc admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:27.139161 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271091b-3cf2-45e6-941f-e5d109a134bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:27.143182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271091b-3cf2-45e6-941f-e5d109a134bc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:27.242915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1268/2518] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:27 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:27.244380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca9e03-9078-43c0-bc07-2bd74e9efc39 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:27.257046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca9e03-9078-43c0-bc07-2bd74e9efc39 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:27.262075 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610868e1-2ad1-45b1-9923-fb58c7bd9fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:27.266456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610868e1-2ad1-45b1-9923-fb58c7bd9fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:27.266456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610868e1-2ad1-45b1-9923-fb58c7bd9fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:27.266456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610868e1-2ad1-45b1-9923-fb58c7bd9fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:27.266456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610868e1-2ad1-45b1-9923-fb58c7bd9fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:27.266456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610868e1-2ad1-45b1-9923-fb58c7bd9fc9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:27.279423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1251/2519] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:27.283858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271091b-3cf2-45e6-941f-e5d109a134bc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:27.295715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271091b-3cf2-45e6-941f-e5d109a134bc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:27.300493 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce7300-4fbc-4c29-a136-ebe93fbb1dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:27.301355 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce7300-4fbc-4c29-a136-ebe93fbb1dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:27.301690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce7300-4fbc-4c29-a136-ebe93fbb1dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:27.302024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce7300-4fbc-4c29-a136-ebe93fbb1dc5 admin admin] PATH_INFO: `/v3/projects/1a1483ce35fe49f48166227d869e9463/users/789f8bcc42144a9096bd64f6c555893a/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:27.318637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce7300-4fbc-4c29-a136-ebe93fbb1dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1483ce35fe49f48166227d869e9463, user_id=789f8bcc42144a9096bd64f6c555893a, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:27.321266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce7300-4fbc-4c29-a136-ebe93fbb1dc5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:27.404436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1269/2520] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:27 2022] PUT /identity/v3/projects/1a1483ce35fe49f48166227d869e9463/users/789f8bcc42144a9096bd64f6c555893a/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:27.408495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610868e1-2ad1-45b1-9923-fb58c7bd9fc9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:27.419332 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610868e1-2ad1-45b1-9923-fb58c7bd9fc9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:27.482206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35bc65-2f74-46ae-9a6c-562518a39b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:27.482847 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35bc65-2f74-46ae-9a6c-562518a39b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:27.483126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35bc65-2f74-46ae-9a6c-562518a39b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:27.483396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35bc65-2f74-46ae-9a6c-562518a39b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:27.484042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35bc65-2f74-46ae-9a6c-562518a39b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:27.485670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35bc65-2f74-46ae-9a6c-562518a39b3b admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:27.496482 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1252/2521] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:27.500769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce7300-4fbc-4c29-a136-ebe93fbb1dc5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:27.512442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce7300-4fbc-4c29-a136-ebe93fbb1dc5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:27.517734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54dd9c-834b-4112-8b28-8c57fbb39afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:27.518424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54dd9c-834b-4112-8b28-8c57fbb39afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:27.518701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54dd9c-834b-4112-8b28-8c57fbb39afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:27.518994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54dd9c-834b-4112-8b28-8c57fbb39afe admin admin] PATH_INFO: `/v3/projects/1a1483ce35fe49f48166227d869e9463/users/789f8bcc42144a9096bd64f6c555893a/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:27.521963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54dd9c-834b-4112-8b28-8c57fbb39afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1483ce35fe49f48166227d869e9463, user_id=789f8bcc42144a9096bd64f6c555893a, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:27.524671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54dd9c-834b-4112-8b28-8c57fbb39afe admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:27.536328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1270/2522] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:27 2022] PUT /identity/v3/projects/1a1483ce35fe49f48166227d869e9463/users/789f8bcc42144a9096bd64f6c555893a/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:27.547046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b288b3-491e-454f-beba-91540dfce2cf None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:27.547331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b288b3-491e-454f-beba-91540dfce2cf None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:27.548393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b288b3-491e-454f-beba-91540dfce2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:27.576962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-11b288b3-491e-454f-beba-91540dfce2cf None None] MFA Rules not processed for user `789f8bcc42144a9096bd64f6c555893a`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:27.578175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-11b288b3-491e-454f-beba-91540dfce2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:27.656286 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1253/2523] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:27.667261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54dd9c-834b-4112-8b28-8c57fbb39afe admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:27.669002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-de54dd9c-834b-4112-8b28-8c57fbb39afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:27.718485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:27.740935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54dd9c-834b-4112-8b28-8c57fbb39afe admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:27.745748 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ac8cd-959e-46c7-9710-78890a5b6d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:27.746405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ac8cd-959e-46c7-9710-78890a5b6d07 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:27.746767 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ac8cd-959e-46c7-9710-78890a5b6d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:27.747074 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ac8cd-959e-46c7-9710-78890a5b6d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:27.759038 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ac8cd-959e-46c7-9710-78890a5b6d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:27.760669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ac8cd-959e-46c7-9710-78890a5b6d07 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:27.775372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1271/2524] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:28.098031 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775adad2-d82f-4237-9fdc-ed92fac77996 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:28.098031 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775adad2-d82f-4237-9fdc-ed92fac77996 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:28.098681 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775adad2-d82f-4237-9fdc-ed92fac77996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:28.120786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-775adad2-d82f-4237-9fdc-ed92fac77996 None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:28.120786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-775adad2-d82f-4237-9fdc-ed92fac77996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:28.190903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1254/2525] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:38:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:28.409190 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ac8cd-959e-46c7-9710-78890a5b6d07 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:28.410828 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-090ac8cd-959e-46c7-9710-78890a5b6d07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:28.451095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775adad2-d82f-4237-9fdc-ed92fac77996 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:28.457491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:28.503508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ac8cd-959e-46c7-9710-78890a5b6d07 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:28.509692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6124d-eace-4ab9-8895-a0b70d25f2f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:28.510481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6124d-eace-4ab9-8895-a0b70d25f2f3 service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:28.511124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6124d-eace-4ab9-8895-a0b70d25f2f3 service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:28.511420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6124d-eace-4ab9-8895-a0b70d25f2f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:28.524361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6124d-eace-4ab9-8895-a0b70d25f2f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:28.526426 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6124d-eace-4ab9-8895-a0b70d25f2f3 service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:28.533902 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775adad2-d82f-4237-9fdc-ed92fac77996 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:28.534849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1272/2526] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:38:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:28.535595 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:28.536327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:28.536786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:28.537183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] PATH_INFO: `/v3/users/5141edc619d342cebb0be0be86cc0212` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:28.538083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5141edc619d342cebb0be0be86cc0212)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:28.540067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:28.861238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5141edc619d342cebb0be0be86cc0212'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:28.873650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5141edc619d342cebb0be0be86cc0212'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:28.875167 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5141edc619d342cebb0be0be86cc0212'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:28.976027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5141edc619d342cebb0be0be86cc0212'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:28.995463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5141edc619d342cebb0be0be86cc0212'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:29.004461 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1255/2527] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:28 2022] DELETE /identity/v3/users/5141edc619d342cebb0be0be86cc0212 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:29.012710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0a3d3-0b2c-4ba2-a5e1-0be2c43485f6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:29.013222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0a3d3-0b2c-4ba2-a5e1-0be2c43485f6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:29.013584 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0a3d3-0b2c-4ba2-a5e1-0be2c43485f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:29.041525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ebf0a3d3-0b2c-4ba2-a5e1-0be2c43485f6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:29.042865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ebf0a3d3-0b2c-4ba2-a5e1-0be2c43485f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:29.126633 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1273/2528] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:29.139746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:29.141564 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:29.219894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f5b0-1205-4843-a38e-65133de51540 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:29.224574 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21456cd7-a412-4e95-ac0f-fb85abd51eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:29.225217 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21456cd7-a412-4e95-ac0f-fb85abd51eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:29.225499 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21456cd7-a412-4e95-ac0f-fb85abd51eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:29.225802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21456cd7-a412-4e95-ac0f-fb85abd51eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:29.240924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21456cd7-a412-4e95-ac0f-fb85abd51eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:29.242433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21456cd7-a412-4e95-ac0f-fb85abd51eb0 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:29.259442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1256/2529] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:29.817854 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0a3d3-0b2c-4ba2-a5e1-0be2c43485f6 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:29.820345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ebf0a3d3-0b2c-4ba2-a5e1-0be2c43485f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:29.852308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0a3d3-0b2c-4ba2-a5e1-0be2c43485f6 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:29.860309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:29.861118 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:29.861389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:29.861706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] PATH_INFO: `/v3/projects/56d9db36f62d473d958693cb7c781699` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:29.862992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d9db36f62d473d958693cb7c781699)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:29.866082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:30.017404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d9db36f62d473d958693cb7c781699', 'request_id': 'req-fa5beb08-194f-4528-a97b-650245b01aed'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:30.027069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d9db36f62d473d958693cb7c781699', 'request_id': 'req-fa5beb08-194f-4528-a97b-650245b01aed'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:30.118541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d9db36f62d473d958693cb7c781699', 'request_id': 'req-fa5beb08-194f-4528-a97b-650245b01aed'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:30.121010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:30.134797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] The token cache is being invalidate because project 56d9db36f62d473d958693cb7c781699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:30.135105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:30.135779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:30.143504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21456cd7-a412-4e95-ac0f-fb85abd51eb0 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:30.149407 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1274/2530] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:29 2022] DELETE /identity/v3/projects/56d9db36f62d473d958693cb7c781699 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:30.156198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21456cd7-a412-4e95-ac0f-fb85abd51eb0 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:30.190561 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:30.239703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca345ec-ad67-4545-b23b-4a0d731846c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:30.240476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca345ec-ad67-4545-b23b-4a0d731846c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:30.240826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca345ec-ad67-4545-b23b-4a0d731846c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:30.241173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca345ec-ad67-4545-b23b-4a0d731846c0 admin admin] PATH_INFO: `/v3/users/789f8bcc42144a9096bd64f6c555893a` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:30.242496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca345ec-ad67-4545-b23b-4a0d731846c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789f8bcc42144a9096bd64f6c555893a)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:30.244662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca345ec-ad67-4545-b23b-4a0d731846c0 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:30.508915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9ca345ec-ad67-4545-b23b-4a0d731846c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789f8bcc42144a9096bd64f6c555893a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:30.517150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9ca345ec-ad67-4545-b23b-4a0d731846c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789f8bcc42144a9096bd64f6c555893a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:30.518658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9ca345ec-ad67-4545-b23b-4a0d731846c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789f8bcc42144a9096bd64f6c555893a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:30.581176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9ca345ec-ad67-4545-b23b-4a0d731846c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789f8bcc42144a9096bd64f6c555893a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:30.600302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9ca345ec-ad67-4545-b23b-4a0d731846c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789f8bcc42144a9096bd64f6c555893a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:30.608125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1257/2531] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:30 2022] DELETE /identity/v3/users/789f8bcc42144a9096bd64f6c555893a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:31.247319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:31.249149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:31.267010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5beb08-194f-4528-a97b-650245b01aed admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:31.343797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a10eea-b0e7-4022-8df2-3839e1c96a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:31.344396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a10eea-b0e7-4022-8df2-3839e1c96a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:31.344670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a10eea-b0e7-4022-8df2-3839e1c96a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:31.344939 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a10eea-b0e7-4022-8df2-3839e1c96a42 admin admin] PATH_INFO: `/v3/projects/1a1483ce35fe49f48166227d869e9463` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:31.346313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a10eea-b0e7-4022-8df2-3839e1c96a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1483ce35fe49f48166227d869e9463)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:31.349694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a10eea-b0e7-4022-8df2-3839e1c96a42 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:31.737165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c3a10eea-b0e7-4022-8df2-3839e1c96a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1483ce35fe49f48166227d869e9463', 'request_id': 'req-c3a10eea-b0e7-4022-8df2-3839e1c96a42'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:31.747388 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c3a10eea-b0e7-4022-8df2-3839e1c96a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1483ce35fe49f48166227d869e9463', 'request_id': 'req-c3a10eea-b0e7-4022-8df2-3839e1c96a42'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:31.964209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c3a10eea-b0e7-4022-8df2-3839e1c96a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1483ce35fe49f48166227d869e9463', 'request_id': 'req-c3a10eea-b0e7-4022-8df2-3839e1c96a42'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:31.976023 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c3a10eea-b0e7-4022-8df2-3839e1c96a42 admin admin] The token cache is being invalidate because project 1a1483ce35fe49f48166227d869e9463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:31.976367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c3a10eea-b0e7-4022-8df2-3839e1c96a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:31.976992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c3a10eea-b0e7-4022-8df2-3839e1c96a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:31.978587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1275/2532] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:31 2022] DELETE /identity/v3/projects/1a1483ce35fe49f48166227d869e9463 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:31.983716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391c140-16c6-4931-bacb-bbccbe8354b8 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:31.984224 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391c140-16c6-4931-bacb-bbccbe8354b8 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:31.984322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391c140-16c6-4931-bacb-bbccbe8354b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:32.007212 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-e391c140-16c6-4931-bacb-bbccbe8354b8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:32.008428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e391c140-16c6-4931-bacb-bbccbe8354b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:32.079598 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1258/2533] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:32.089319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ccc8e-bbce-4394-9e3d-932aea60758c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:32.089604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ccc8e-bbce-4394-9e3d-932aea60758c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:32.089877 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ccc8e-bbce-4394-9e3d-932aea60758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:32.115812 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-656ccc8e-bbce-4394-9e3d-932aea60758c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:32.119529 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-656ccc8e-bbce-4394-9e3d-932aea60758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:32.127205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1276/2534] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:32.132187 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391c140-16c6-4931-bacb-bbccbe8354b8 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:32.146679 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391c140-16c6-4931-bacb-bbccbe8354b8 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:32.153854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97a6a3-58fa-4127-9aaf-1e605992e586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:32.153854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97a6a3-58fa-4127-9aaf-1e605992e586 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:32.153854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97a6a3-58fa-4127-9aaf-1e605992e586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:32.154349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97a6a3-58fa-4127-9aaf-1e605992e586 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:32.154678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97a6a3-58fa-4127-9aaf-1e605992e586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:32.154979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97a6a3-58fa-4127-9aaf-1e605992e586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:32.156602 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97a6a3-58fa-4127-9aaf-1e605992e586 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:32.192475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1259/2535] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:32.194525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ccc8e-bbce-4394-9e3d-932aea60758c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:32.205184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ccc8e-bbce-4394-9e3d-932aea60758c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:32.214678 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673ea08-73b8-41b5-a2c2-c4c0f5668b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:32.215639 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673ea08-73b8-41b5-a2c2-c4c0f5668b83 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:32.215923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673ea08-73b8-41b5-a2c2-c4c0f5668b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:32.216196 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673ea08-73b8-41b5-a2c2-c4c0f5668b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:32.216846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673ea08-73b8-41b5-a2c2-c4c0f5668b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:32.218891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673ea08-73b8-41b5-a2c2-c4c0f5668b83 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:32.330270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1277/2536] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:32 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:38:32.331859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97a6a3-58fa-4127-9aaf-1e605992e586 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:32.345964 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97a6a3-58fa-4127-9aaf-1e605992e586 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:32.384501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:32.421486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257b9bb-3035-459a-a322-4da2adcfaa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:32.422461 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257b9bb-3035-459a-a322-4da2adcfaa26 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:32.428695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257b9bb-3035-459a-a322-4da2adcfaa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:32.428695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257b9bb-3035-459a-a322-4da2adcfaa26 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:32.428695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257b9bb-3035-459a-a322-4da2adcfaa26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:32.428695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257b9bb-3035-459a-a322-4da2adcfaa26 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:32.564702 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1260/2537] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:32 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:38:32.565862 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673ea08-73b8-41b5-a2c2-c4c0f5668b83 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:32.579826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673ea08-73b8-41b5-a2c2-c4c0f5668b83 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:32.585715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b3dce-d732-45b4-a6f9-bc65ee460fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:32.586423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b3dce-d732-45b4-a6f9-bc65ee460fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:32.586703 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b3dce-d732-45b4-a6f9-bc65ee460fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:32.586969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b3dce-d732-45b4-a6f9-bc65ee460fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:32.587620 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b3dce-d732-45b4-a6f9-bc65ee460fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:32.589236 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b3dce-d732-45b4-a6f9-bc65ee460fbd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:32.603901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1278/2538] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:32.617628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257b9bb-3035-459a-a322-4da2adcfaa26 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:32.631204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257b9bb-3035-459a-a322-4da2adcfaa26 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:32.636684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf9c06-8dd5-43da-8125-a084e1e5bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:32.637430 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf9c06-8dd5-43da-8125-a084e1e5bca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:32.637771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf9c06-8dd5-43da-8125-a084e1e5bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:32.638065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf9c06-8dd5-43da-8125-a084e1e5bca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:32.639024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf9c06-8dd5-43da-8125-a084e1e5bca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:32.640840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf9c06-8dd5-43da-8125-a084e1e5bca8 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:32.658183 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1261/2539] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:32.659509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b3dce-d732-45b4-a6f9-bc65ee460fbd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:32.678092 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b3dce-d732-45b4-a6f9-bc65ee460fbd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:32.687231 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a4742-fb98-4552-b0a6-ab01c2023895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:32.687928 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a4742-fb98-4552-b0a6-ab01c2023895 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:32.688198 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a4742-fb98-4552-b0a6-ab01c2023895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:32.688473 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a4742-fb98-4552-b0a6-ab01c2023895 admin admin] PATH_INFO: `/v3/projects/871382b220b54ae287f3c5b40ab1f526/users/891acc84f257410899877a2380ebffa4/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:32.709527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a4742-fb98-4552-b0a6-ab01c2023895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=871382b220b54ae287f3c5b40ab1f526, user_id=891acc84f257410899877a2380ebffa4, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:32.713846 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a4742-fb98-4552-b0a6-ab01c2023895 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:32.901248 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1279/2540] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:32 2022] PUT /identity/v3/projects/871382b220b54ae287f3c5b40ab1f526/users/891acc84f257410899877a2380ebffa4/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:32.914827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716962e-7c5a-4d08-992a-87411e6a739e None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:32.915201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716962e-7c5a-4d08-992a-87411e6a739e None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:32.915539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716962e-7c5a-4d08-992a-87411e6a739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:32.950272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-3716962e-7c5a-4d08-992a-87411e6a739e None None] MFA Rules not processed for user `891acc84f257410899877a2380ebffa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:32.952034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3716962e-7c5a-4d08-992a-87411e6a739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:33.038355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1262/2541] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:33.051232 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a4742-fb98-4552-b0a6-ab01c2023895 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:33.053284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-308a4742-fb98-4552-b0a6-ab01c2023895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:33.078719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:33.134397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a4742-fb98-4552-b0a6-ab01c2023895 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:33.139117 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab70d2e-eeac-46db-87de-7d9d8a41afd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:33.139728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab70d2e-eeac-46db-87de-7d9d8a41afd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:33.140005 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab70d2e-eeac-46db-87de-7d9d8a41afd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:33.140277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab70d2e-eeac-46db-87de-7d9d8a41afd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:33.152480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab70d2e-eeac-46db-87de-7d9d8a41afd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:33.154057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab70d2e-eeac-46db-87de-7d9d8a41afd6 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:33.166619 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1280/2542] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:33.191881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716962e-7c5a-4d08-992a-87411e6a739e None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:33.289428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716962e-7c5a-4d08-992a-87411e6a739e None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:33.295163 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:33.296675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:33.297124 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:33.297273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] PATH_INFO: `/v3/users/891acc84f257410899877a2380ebffa4` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:33.299287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891acc84f257410899877a2380ebffa4)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:33.301672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:33.523572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:33.528319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891acc84f257410899877a2380ebffa4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:33.536969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891acc84f257410899877a2380ebffa4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:33.538863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891acc84f257410899877a2380ebffa4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:33.599959 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891acc84f257410899877a2380ebffa4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:33.617741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891acc84f257410899877a2380ebffa4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:33.627020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1263/2543] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:33 2022] DELETE /identity/v3/users/891acc84f257410899877a2380ebffa4 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:33.631477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa802556-a150-43f4-b8ec-fbbcb0eb3e36 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:33.631988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa802556-a150-43f4-b8ec-fbbcb0eb3e36 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:33.632078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa802556-a150-43f4-b8ec-fbbcb0eb3e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:33.655833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-fa802556-a150-43f4-b8ec-fbbcb0eb3e36 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:33.657063 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fa802556-a150-43f4-b8ec-fbbcb0eb3e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:33.744003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1281/2544] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:33.756881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:33.758603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:33.853990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13ece-1141-4147-a86c-65460a176855 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:33.858706 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c31034-0d56-4742-82e1-ef11e1418488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:33.859607 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c31034-0d56-4742-82e1-ef11e1418488 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:33.860494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c31034-0d56-4742-82e1-ef11e1418488 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:33.860953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c31034-0d56-4742-82e1-ef11e1418488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:33.892178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c31034-0d56-4742-82e1-ef11e1418488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:33.905251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c31034-0d56-4742-82e1-ef11e1418488 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:33.915368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1264/2545] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:38:34.507757 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa802556-a150-43f4-b8ec-fbbcb0eb3e36 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:34.509826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fa802556-a150-43f4-b8ec-fbbcb0eb3e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:34.533769 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa802556-a150-43f4-b8ec-fbbcb0eb3e36 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:34.555008 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da54356-8b88-45b3-841b-14751755e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:34.555967 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da54356-8b88-45b3-841b-14751755e5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:34.556506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da54356-8b88-45b3-841b-14751755e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:34.557534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da54356-8b88-45b3-841b-14751755e5a9 admin admin] PATH_INFO: `/v3/projects/871382b220b54ae287f3c5b40ab1f526` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:34.559096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da54356-8b88-45b3-841b-14751755e5a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=871382b220b54ae287f3c5b40ab1f526)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:34.561932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da54356-8b88-45b3-841b-14751755e5a9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:34.715753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8da54356-8b88-45b3-841b-14751755e5a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871382b220b54ae287f3c5b40ab1f526', 'request_id': 'req-8da54356-8b88-45b3-841b-14751755e5a9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:34.727807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8da54356-8b88-45b3-841b-14751755e5a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871382b220b54ae287f3c5b40ab1f526', 'request_id': 'req-8da54356-8b88-45b3-841b-14751755e5a9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:34.796684 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8da54356-8b88-45b3-841b-14751755e5a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871382b220b54ae287f3c5b40ab1f526', 'request_id': 'req-8da54356-8b88-45b3-841b-14751755e5a9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:34.815801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8da54356-8b88-45b3-841b-14751755e5a9 admin admin] The token cache is being invalidate because project 871382b220b54ae287f3c5b40ab1f526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:34.818047 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8da54356-8b88-45b3-841b-14751755e5a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:34.821312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8da54356-8b88-45b3-841b-14751755e5a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:34.822924 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1282/2546] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:34 2022] DELETE /identity/v3/projects/871382b220b54ae287f3c5b40ab1f526 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:34.828033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a3c46-e986-42d8-ad16-c35567b85805 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:34.828548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a3c46-e986-42d8-ad16-c35567b85805 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:34.828644 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a3c46-e986-42d8-ad16-c35567b85805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:34.861547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-1f2a3c46-e986-42d8-ad16-c35567b85805 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:34.861804 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-1f2a3c46-e986-42d8-ad16-c35567b85805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:34.943763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1265/2547] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:34.951717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640c121-048d-45ff-b968-09639541a376 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:34.951962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640c121-048d-45ff-b968-09639541a376 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:34.952091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640c121-048d-45ff-b968-09639541a376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:34.977211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0640c121-048d-45ff-b968-09639541a376 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:34.978669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0640c121-048d-45ff-b968-09639541a376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:34.995475 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a3c46-e986-42d8-ad16-c35567b85805 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:35.000479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1283/2548] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:35.012508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a3c46-e986-42d8-ad16-c35567b85805 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:35.018639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb58f4-bbbf-40ea-a97b-d71d5969526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:35.018639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb58f4-bbbf-40ea-a97b-d71d5969526a admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:35.018936 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb58f4-bbbf-40ea-a97b-d71d5969526a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:35.019046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb58f4-bbbf-40ea-a97b-d71d5969526a admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:35.019802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb58f4-bbbf-40ea-a97b-d71d5969526a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:35.020121 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb58f4-bbbf-40ea-a97b-d71d5969526a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:35.021794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb58f4-bbbf-40ea-a97b-d71d5969526a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:35.036036 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1266/2549] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:38:35.040709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640c121-048d-45ff-b968-09639541a376 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:35.052798 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640c121-048d-45ff-b968-09639541a376 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:35.057963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbfe08-9fdf-49a8-a2e7-b854ca24ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:35.058635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbfe08-9fdf-49a8-a2e7-b854ca24ac49 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:35.058910 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbfe08-9fdf-49a8-a2e7-b854ca24ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:35.059179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbfe08-9fdf-49a8-a2e7-b854ca24ac49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:35.059839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbfe08-9fdf-49a8-a2e7-b854ca24ac49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:35.061803 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbfe08-9fdf-49a8-a2e7-b854ca24ac49 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:35.457794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1284/2550] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:35 2022] POST /identity/v3/projects => generated 369 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:38:35.473171 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb58f4-bbbf-40ea-a97b-d71d5969526a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:35.483939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb58f4-bbbf-40ea-a97b-d71d5969526a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:35.533435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:35.543833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0a4eb-962f-4f2b-b365-2d66cd6ed593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:35.544468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0a4eb-962f-4f2b-b365-2d66cd6ed593 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:35.544771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0a4eb-962f-4f2b-b365-2d66cd6ed593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:35.545067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0a4eb-962f-4f2b-b365-2d66cd6ed593 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:35.545758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0a4eb-962f-4f2b-b365-2d66cd6ed593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:35.548542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0a4eb-962f-4f2b-b365-2d66cd6ed593 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:35.733991 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1267/2551] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:35 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:35.738256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbfe08-9fdf-49a8-a2e7-b854ca24ac49 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:35.750097 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbfe08-9fdf-49a8-a2e7-b854ca24ac49 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:35.758058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca08554-dda1-4f8c-b4c3-5bc9c3a84f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:35.758700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca08554-dda1-4f8c-b4c3-5bc9c3a84f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:35.758976 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca08554-dda1-4f8c-b4c3-5bc9c3a84f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:35.759246 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca08554-dda1-4f8c-b4c3-5bc9c3a84f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:35.759892 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca08554-dda1-4f8c-b4c3-5bc9c3a84f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:35.761534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca08554-dda1-4f8c-b4c3-5bc9c3a84f91 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:35.774506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1285/2552] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:35.778545 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0a4eb-962f-4f2b-b365-2d66cd6ed593 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:35.789452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0a4eb-962f-4f2b-b365-2d66cd6ed593 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:35.794447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8be1d-ef93-4ac8-a7b1-366855ab1296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:35.795067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8be1d-ef93-4ac8-a7b1-366855ab1296 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:35.795333 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8be1d-ef93-4ac8-a7b1-366855ab1296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:35.795603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8be1d-ef93-4ac8-a7b1-366855ab1296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:35.796252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8be1d-ef93-4ac8-a7b1-366855ab1296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:35.798247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8be1d-ef93-4ac8-a7b1-366855ab1296 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:35.812476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1268/2553] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:38:35.817479 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca08554-dda1-4f8c-b4c3-5bc9c3a84f91 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:35.824058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:35.828010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca08554-dda1-4f8c-b4c3-5bc9c3a84f91 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:35.833817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8859-391c-40d9-a200-a133da4e9d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:35.834665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8859-391c-40d9-a200-a133da4e9d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:35.834943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8859-391c-40d9-a200-a133da4e9d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:35.835218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8859-391c-40d9-a200-a133da4e9d2c admin admin] PATH_INFO: `/v3/projects/eef0fa501f7e4a74835a04dd580f8611/users/9499d0800c204af4ac9a514090ef7843/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:35.851269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c8859-391c-40d9-a200-a133da4e9d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef0fa501f7e4a74835a04dd580f8611, user_id=9499d0800c204af4ac9a514090ef7843, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:35.854076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c8859-391c-40d9-a200-a133da4e9d2c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:35.946725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1286/2554] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:35 2022] PUT /identity/v3/projects/eef0fa501f7e4a74835a04dd580f8611/users/9499d0800c204af4ac9a514090ef7843/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:35.950171 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf1850-ca07-43ad-b86d-12e245fce91a None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:35.951039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf1850-ca07-43ad-b86d-12e245fce91a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:35.951507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf1850-ca07-43ad-b86d-12e245fce91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:35.995119 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-49cf1850-ca07-43ad-b86d-12e245fce91a None None] MFA Rules not processed for user `9499d0800c204af4ac9a514090ef7843`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:35.996388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-49cf1850-ca07-43ad-b86d-12e245fce91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:36.088440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1269/2555] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:36.101483 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8859-391c-40d9-a200-a133da4e9d2c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:36.103780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-628c8859-391c-40d9-a200-a133da4e9d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:36.216804 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8859-391c-40d9-a200-a133da4e9d2c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:36.221992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b134a67-53a8-4ded-85d9-a0d754a1e472 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c841f03880c4fb1b402bac6ecce25fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:36.223950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b134a67-53a8-4ded-85d9-a0d754a1e472 service glance] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:36.224457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b134a67-53a8-4ded-85d9-a0d754a1e472 service glance] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:36.224887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b134a67-53a8-4ded-85d9-a0d754a1e472 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:36.238901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b134a67-53a8-4ded-85d9-a0d754a1e472 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:36.241303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b134a67-53a8-4ded-85d9-a0d754a1e472 service glance] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:36.263677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1287/2556] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:46.084295 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=43,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:46.251457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:46.703593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf1850-ca07-43ad-b86d-12e245fce91a None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:46.705018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-49cf1850-ca07-43ad-b86d-12e245fce91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:46.770872 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf1850-ca07-43ad-b86d-12e245fce91a None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:46.776660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e7a24-9107-4db5-b0aa-a9ce176ecb3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:46.777473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e7a24-9107-4db5-b0aa-a9ce176ecb3c service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:46.777760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e7a24-9107-4db5-b0aa-a9ce176ecb3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:46.778063 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e7a24-9107-4db5-b0aa-a9ce176ecb3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:46.779930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-ad9e7a24-9107-4db5-b0aa-a9ce176ecb3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:46.851420 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e7a24-9107-4db5-b0aa-a9ce176ecb3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:46.853040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e7a24-9107-4db5-b0aa-a9ce176ecb3c service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:46.864081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1270/2557] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:51.115821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b134a67-53a8-4ded-85d9-a0d754a1e472 service glance] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:51.126632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1b134a67-53a8-4ded-85d9-a0d754a1e472 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:51.149778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b134a67-53a8-4ded-85d9-a0d754a1e472 service glance] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:51.155444 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a4191-1190-4809-9a47-d510040e0102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:51.155444 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a4191-1190-4809-9a47-d510040e0102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:51.155727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a4191-1190-4809-9a47-d510040e0102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:51.155727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a4191-1190-4809-9a47-d510040e0102 admin admin] PATH_INFO: `/v3/users/63b7b33a0dd64d44ba980122f83eba4f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:51.157062 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a4191-1190-4809-9a47-d510040e0102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b7b33a0dd64d44ba980122f83eba4f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:51.159098 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a4191-1190-4809-9a47-d510040e0102 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:51.340895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7d2a4191-1190-4809-9a47-d510040e0102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b7b33a0dd64d44ba980122f83eba4f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.362686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7d2a4191-1190-4809-9a47-d510040e0102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b7b33a0dd64d44ba980122f83eba4f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.364271 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7d2a4191-1190-4809-9a47-d510040e0102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b7b33a0dd64d44ba980122f83eba4f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.365757 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7d2a4191-1190-4809-9a47-d510040e0102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b7b33a0dd64d44ba980122f83eba4f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.373864 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7d2a4191-1190-4809-9a47-d510040e0102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b7b33a0dd64d44ba980122f83eba4f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.466124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1288/2558] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:51 2022] DELETE /identity/v3/users/63b7b33a0dd64d44ba980122f83eba4f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:51.778250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e7a24-9107-4db5-b0aa-a9ce176ecb3c service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:51.790548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e7a24-9107-4db5-b0aa-a9ce176ecb3c service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:51.860993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd08c6-a503-478a-8b37-369199bcb88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:51.861735 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd08c6-a503-478a-8b37-369199bcb88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:51.862329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd08c6-a503-478a-8b37-369199bcb88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:51.862451 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd08c6-a503-478a-8b37-369199bcb88c admin admin] PATH_INFO: `/v3/projects/bdd239fcefef4a408d7ad333323ed4c9` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:51.863619 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd08c6-a503-478a-8b37-369199bcb88c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd239fcefef4a408d7ad333323ed4c9)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:51.867410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd08c6-a503-478a-8b37-369199bcb88c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.045895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-45cd08c6-a503-478a-8b37-369199bcb88c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd239fcefef4a408d7ad333323ed4c9', 'request_id': 'req-45cd08c6-a503-478a-8b37-369199bcb88c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:52.047864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:52.052866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-45cd08c6-a503-478a-8b37-369199bcb88c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd239fcefef4a408d7ad333323ed4c9', 'request_id': 'req-45cd08c6-a503-478a-8b37-369199bcb88c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:52.058950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-45cd08c6-a503-478a-8b37-369199bcb88c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd239fcefef4a408d7ad333323ed4c9', 'request_id': 'req-45cd08c6-a503-478a-8b37-369199bcb88c'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:52.175547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-45cd08c6-a503-478a-8b37-369199bcb88c admin admin] The token cache is being invalidate because project bdd239fcefef4a408d7ad333323ed4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:52.175977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-45cd08c6-a503-478a-8b37-369199bcb88c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:52.176488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-45cd08c6-a503-478a-8b37-369199bcb88c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:52.178004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1271/2559] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:51 2022] DELETE /identity/v3/projects/bdd239fcefef4a408d7ad333323ed4c9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:52.183813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb833f8-0225-41cd-a2c4-89489d7f1cd6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.184387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb833f8-0225-41cd-a2c4-89489d7f1cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.184508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb833f8-0225-41cd-a2c4-89489d7f1cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.209156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1cb833f8-0225-41cd-a2c4-89489d7f1cd6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:52.210625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1cb833f8-0225-41cd-a2c4-89489d7f1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:52.296058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1289/2560] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:52.308751 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac15542-a689-4f68-9b5c-206e4a0a2fb6 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.309248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac15542-a689-4f68-9b5c-206e4a0a2fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.309716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac15542-a689-4f68-9b5c-206e4a0a2fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.337334 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-5ac15542-a689-4f68-9b5c-206e4a0a2fb6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:52.339222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5ac15542-a689-4f68-9b5c-206e4a0a2fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:52.349396 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1272/2561] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:52.356750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb833f8-0225-41cd-a2c4-89489d7f1cd6 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.369705 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb833f8-0225-41cd-a2c4-89489d7f1cd6 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.374853 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e93cd-01ac-464c-9edc-d9a584639317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.375465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e93cd-01ac-464c-9edc-d9a584639317 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.375722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e93cd-01ac-464c-9edc-d9a584639317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.379630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e93cd-01ac-464c-9edc-d9a584639317 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.379630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e93cd-01ac-464c-9edc-d9a584639317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:52.379630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e93cd-01ac-464c-9edc-d9a584639317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.379630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e93cd-01ac-464c-9edc-d9a584639317 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.391914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1290/2562] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:52.396900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac15542-a689-4f68-9b5c-206e4a0a2fb6 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.407222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac15542-a689-4f68-9b5c-206e4a0a2fb6 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.416814 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018c16-4bda-4b41-bfd5-d13fc54c8b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.417697 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018c16-4bda-4b41-bfd5-d13fc54c8b24 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.417883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018c16-4bda-4b41-bfd5-d13fc54c8b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.418156 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018c16-4bda-4b41-bfd5-d13fc54c8b24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.418850 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22018c16-4bda-4b41-bfd5-d13fc54c8b24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.420778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22018c16-4bda-4b41-bfd5-d13fc54c8b24 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.528950 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1273/2563] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:52 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:52.529175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e93cd-01ac-464c-9edc-d9a584639317 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.546415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e93cd-01ac-464c-9edc-d9a584639317 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.613666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285a19b-5dbc-485d-a96d-e3d08aa8177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.614428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285a19b-5dbc-485d-a96d-e3d08aa8177b admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.619538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285a19b-5dbc-485d-a96d-e3d08aa8177b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.619538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285a19b-5dbc-485d-a96d-e3d08aa8177b admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.619538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285a19b-5dbc-485d-a96d-e3d08aa8177b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.619538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285a19b-5dbc-485d-a96d-e3d08aa8177b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.633357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:52.742256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1291/2564] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:52 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:52.747769 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018c16-4bda-4b41-bfd5-d13fc54c8b24 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.762601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018c16-4bda-4b41-bfd5-d13fc54c8b24 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.766961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd3aa4-7e49-4403-9b88-f3fb5a267158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.767866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd3aa4-7e49-4403-9b88-f3fb5a267158 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.768352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd3aa4-7e49-4403-9b88-f3fb5a267158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.768853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd3aa4-7e49-4403-9b88-f3fb5a267158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.769582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd3aa4-7e49-4403-9b88-f3fb5a267158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.771359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd3aa4-7e49-4403-9b88-f3fb5a267158 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.784358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1274/2565] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:52.790328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285a19b-5dbc-485d-a96d-e3d08aa8177b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.801569 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285a19b-5dbc-485d-a96d-e3d08aa8177b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.808845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a8721-410b-4784-b05d-36d3658928a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.809451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a8721-410b-4784-b05d-36d3658928a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.809733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a8721-410b-4784-b05d-36d3658928a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.810004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a8721-410b-4784-b05d-36d3658928a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.810717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a8721-410b-4784-b05d-36d3658928a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.812317 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a8721-410b-4784-b05d-36d3658928a8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.823997 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1292/2566] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:52.829403 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd3aa4-7e49-4403-9b88-f3fb5a267158 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.840258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd3aa4-7e49-4403-9b88-f3fb5a267158 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.845933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b3fd5-4fc9-472e-a7bc-9c44a7e6ffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.847000 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b3fd5-4fc9-472e-a7bc-9c44a7e6ffe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.847452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b3fd5-4fc9-472e-a7bc-9c44a7e6ffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.847928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b3fd5-4fc9-472e-a7bc-9c44a7e6ffe9 admin admin] PATH_INFO: `/v3/projects/b4c64e7616f547338da1ad88125837ce/users/910619c33d774c5db8d41f4fe6f6e6aa/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.873214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b3fd5-4fc9-472e-a7bc-9c44a7e6ffe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4c64e7616f547338da1ad88125837ce, user_id=910619c33d774c5db8d41f4fe6f6e6aa, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.876758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b3fd5-4fc9-472e-a7bc-9c44a7e6ffe9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.985374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1275/2567] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:52 2022] PUT /identity/v3/projects/b4c64e7616f547338da1ad88125837ce/users/910619c33d774c5db8d41f4fe6f6e6aa/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:52.996922 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022c4ea-cde7-443e-a1f5-868926d5c8e5 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.997200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022c4ea-cde7-443e-a1f5-868926d5c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.997469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022c4ea-cde7-443e-a1f5-868926d5c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:53.033638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-8022c4ea-cde7-443e-a1f5-868926d5c8e5 None None] MFA Rules not processed for user `910619c33d774c5db8d41f4fe6f6e6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:53.034804 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8022c4ea-cde7-443e-a1f5-868926d5c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:53.107951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1293/2568] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:53.120541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b3fd5-4fc9-472e-a7bc-9c44a7e6ffe9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:53.122350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-513b3fd5-4fc9-472e-a7bc-9c44a7e6ffe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:53.243430 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b3fd5-4fc9-472e-a7bc-9c44a7e6ffe9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:53.249560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01d9c8-63a1-4a10-817f-bec9a1679f8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:53.250263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01d9c8-63a1-4a10-817f-bec9a1679f8f service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:53.250595 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01d9c8-63a1-4a10-817f-bec9a1679f8f service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:53.250914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01d9c8-63a1-4a10-817f-bec9a1679f8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:53.260827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01d9c8-63a1-4a10-817f-bec9a1679f8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:53.262502 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01d9c8-63a1-4a10-817f-bec9a1679f8f service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:53.272703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1276/2569] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:53.700022 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40862302-d255-4e6d-8047-66dfe94c4a24 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:53.700577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40862302-d255-4e6d-8047-66dfe94c4a24 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:53.700577 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40862302-d255-4e6d-8047-66dfe94c4a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:53.731917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-40862302-d255-4e6d-8047-66dfe94c4a24 None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:53.733149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-40862302-d255-4e6d-8047-66dfe94c4a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:53.797654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1294/2570] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Aug 29 20:38:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:53.811204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01d9c8-63a1-4a10-817f-bec9a1679f8f service nova] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:53.812529 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-1d01d9c8-63a1-4a10-817f-bec9a1679f8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:53.856329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:53.890696 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01d9c8-63a1-4a10-817f-bec9a1679f8f service nova] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:53.897192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f11ac-04b8-4217-9ba8-40a50ac1516a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:53.897820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f11ac-04b8-4217-9ba8-40a50ac1516a service swift] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:53.898098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f11ac-04b8-4217-9ba8-40a50ac1516a service swift] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:53.898404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f11ac-04b8-4217-9ba8-40a50ac1516a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:53.908307 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f11ac-04b8-4217-9ba8-40a50ac1516a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:53.909910 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f11ac-04b8-4217-9ba8-40a50ac1516a service swift] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:53.918682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1277/2571] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:38:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:56.710920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40862302-d255-4e6d-8047-66dfe94c4a24 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:56.773509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40862302-d255-4e6d-8047-66dfe94c4a24 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:56.778476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:56.779263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:56.779650 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:56.780031 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] PATH_INFO: `/v3/users/910619c33d774c5db8d41f4fe6f6e6aa` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:56.781513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] RBAC: Authorizing `identity:delete_user(user_id=910619c33d774c5db8d41f4fe6f6e6aa)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:56.783649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:56.800722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:57.047065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '910619c33d774c5db8d41f4fe6f6e6aa'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:57.083340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '910619c33d774c5db8d41f4fe6f6e6aa'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:57.084999 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '910619c33d774c5db8d41f4fe6f6e6aa'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:57.088893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '910619c33d774c5db8d41f4fe6f6e6aa'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:57.104034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '910619c33d774c5db8d41f4fe6f6e6aa'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:57.204104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1295/2572] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:56 2022] DELETE /identity/v3/users/910619c33d774c5db8d41f4fe6f6e6aa => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:57.216309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857d173-8312-4892-a840-086ea2749968 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:57.216854 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857d173-8312-4892-a840-086ea2749968 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:57.216938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857d173-8312-4892-a840-086ea2749968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:57.239817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-6857d173-8312-4892-a840-086ea2749968 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:57.241340 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6857d173-8312-4892-a840-086ea2749968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:57.336456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1278/2573] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:57.346658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:57.348580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:57.447150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bb309-e513-4cbf-9116-d34420b2bfee admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:57.455753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6468abc-b442-4eb3-97ed-a7b795c3a7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:57.456873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6468abc-b442-4eb3-97ed-a7b795c3a7fc service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:57.457326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6468abc-b442-4eb3-97ed-a7b795c3a7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:57.457709 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6468abc-b442-4eb3-97ed-a7b795c3a7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:57.474076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6468abc-b442-4eb3-97ed-a7b795c3a7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:57.476049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6468abc-b442-4eb3-97ed-a7b795c3a7fc service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:57.510325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1296/2574] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:58.164817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857d173-8312-4892-a840-086ea2749968 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:58.166733 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6857d173-8312-4892-a840-086ea2749968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:58.181540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857d173-8312-4892-a840-086ea2749968 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:58.188442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd416ef-2170-4897-b544-f552bcbdcfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:58.189226 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd416ef-2170-4897-b544-f552bcbdcfbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:58.189620 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd416ef-2170-4897-b544-f552bcbdcfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:58.189844 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd416ef-2170-4897-b544-f552bcbdcfbc admin admin] PATH_INFO: `/v3/projects/b4c64e7616f547338da1ad88125837ce` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:58.191465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd416ef-2170-4897-b544-f552bcbdcfbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4c64e7616f547338da1ad88125837ce)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:58.193388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd416ef-2170-4897-b544-f552bcbdcfbc admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:58.380977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9cd416ef-2170-4897-b544-f552bcbdcfbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4c64e7616f547338da1ad88125837ce', 'request_id': 'req-9cd416ef-2170-4897-b544-f552bcbdcfbc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:58.388986 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9cd416ef-2170-4897-b544-f552bcbdcfbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4c64e7616f547338da1ad88125837ce', 'request_id': 'req-9cd416ef-2170-4897-b544-f552bcbdcfbc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:58.395686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9cd416ef-2170-4897-b544-f552bcbdcfbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4c64e7616f547338da1ad88125837ce', 'request_id': 'req-9cd416ef-2170-4897-b544-f552bcbdcfbc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:58.522816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9cd416ef-2170-4897-b544-f552bcbdcfbc admin admin] The token cache is being invalidate because project b4c64e7616f547338da1ad88125837ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:58.523102 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9cd416ef-2170-4897-b544-f552bcbdcfbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:58.523783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-9cd416ef-2170-4897-b544-f552bcbdcfbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:58.525662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1279/2575] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:58 2022] DELETE /identity/v3/projects/b4c64e7616f547338da1ad88125837ce => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:58.530617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785a94-2778-43c5-8391-5f0a5c054a24 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:58.531129 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785a94-2778-43c5-8391-5f0a5c054a24 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:58.531129 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785a94-2778-43c5-8391-5f0a5c054a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:58.552192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f9785a94-2778-43c5-8391-5f0a5c054a24 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:58.554009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f9785a94-2778-43c5-8391-5f0a5c054a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:58.629277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1297/2576] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:58.640382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f78be9-4d4b-4540-b238-ede6e43c5f93 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:58.640657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f78be9-4d4b-4540-b238-ede6e43c5f93 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:58.640935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f78be9-4d4b-4540-b238-ede6e43c5f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:58.666937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-35f78be9-4d4b-4540-b238-ede6e43c5f93 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:58.667728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-35f78be9-4d4b-4540-b238-ede6e43c5f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:58.676898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1280/2577] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:58.683973 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9785a94-2778-43c5-8391-5f0a5c054a24 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:58.694604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9785a94-2778-43c5-8391-5f0a5c054a24 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:58.700379 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec98e17-d518-4ced-ab6d-0bd9b12eaec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:58.701338 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec98e17-d518-4ced-ab6d-0bd9b12eaec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:58.701702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec98e17-d518-4ced-ab6d-0bd9b12eaec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:58.702257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec98e17-d518-4ced-ab6d-0bd9b12eaec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:58.703162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec98e17-d518-4ced-ab6d-0bd9b12eaec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:58.703473 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec98e17-d518-4ced-ab6d-0bd9b12eaec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:58.705126 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec98e17-d518-4ced-ab6d-0bd9b12eaec5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:58.729494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1298/2578] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:38:58.733997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f78be9-4d4b-4540-b238-ede6e43c5f93 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:58.776773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f78be9-4d4b-4540-b238-ede6e43c5f93 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:58.793416 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a883ab-790b-43c6-a699-3d34ee501bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:58.794032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a883ab-790b-43c6-a699-3d34ee501bdd admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:58.794347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a883ab-790b-43c6-a699-3d34ee501bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:58.794621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a883ab-790b-43c6-a699-3d34ee501bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:58.795365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a883ab-790b-43c6-a699-3d34ee501bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:58.797744 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a883ab-790b-43c6-a699-3d34ee501bdd admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:58.984376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1281/2579] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:58 2022] POST /identity/v3/projects => generated 375 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:58.988772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec98e17-d518-4ced-ab6d-0bd9b12eaec5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:59.006057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec98e17-d518-4ced-ab6d-0bd9b12eaec5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:59.038861 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:59.090398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400d0c-82be-47a5-9c39-d6adf019b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:59.091318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400d0c-82be-47a5-9c39-d6adf019b0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:59.091604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400d0c-82be-47a5-9c39-d6adf019b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:59.091878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400d0c-82be-47a5-9c39-d6adf019b0d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:59.092536 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400d0c-82be-47a5-9c39-d6adf019b0d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:59.095429 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400d0c-82be-47a5-9c39-d6adf019b0d4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:59.222425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1299/2580] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:58 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:59.228162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a883ab-790b-43c6-a699-3d34ee501bdd admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:59.240094 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a883ab-790b-43c6-a699-3d34ee501bdd admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:59.245459 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a9564-7cf2-4e74-b5c4-f82cdca12d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:59.246079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a9564-7cf2-4e74-b5c4-f82cdca12d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:59.246394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a9564-7cf2-4e74-b5c4-f82cdca12d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:59.246669 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a9564-7cf2-4e74-b5c4-f82cdca12d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:59.247322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a9564-7cf2-4e74-b5c4-f82cdca12d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:59.248955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a9564-7cf2-4e74-b5c4-f82cdca12d49 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:59.264491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1282/2581] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:59.268524 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400d0c-82be-47a5-9c39-d6adf019b0d4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:59.279371 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400d0c-82be-47a5-9c39-d6adf019b0d4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:59.286343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68522-a337-4d87-88d2-e381bdeb04c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:59.287978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68522-a337-4d87-88d2-e381bdeb04c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:59.287978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68522-a337-4d87-88d2-e381bdeb04c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:59.287978 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68522-a337-4d87-88d2-e381bdeb04c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:59.288677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68522-a337-4d87-88d2-e381bdeb04c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:59.290517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68522-a337-4d87-88d2-e381bdeb04c6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:59.302984 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1300/2582] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:59.308788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a9564-7cf2-4e74-b5c4-f82cdca12d49 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:59.321714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a9564-7cf2-4e74-b5c4-f82cdca12d49 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:59.326893 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55b9d8-fe1a-4d7e-a591-a460fff64c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:59.327637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b9d8-fe1a-4d7e-a591-a460fff64c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:59.328032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b9d8-fe1a-4d7e-a591-a460fff64c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:59.328286 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b9d8-fe1a-4d7e-a591-a460fff64c37 admin admin] PATH_INFO: `/v3/projects/bc5251b2e3f3496696a5eb3fe852801b/users/de8123b8c9e2411c93b23abf30cacf80/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:59.331942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:59.346153 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55b9d8-fe1a-4d7e-a591-a460fff64c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5251b2e3f3496696a5eb3fe852801b, user_id=de8123b8c9e2411c93b23abf30cacf80, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:59.350129 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55b9d8-fe1a-4d7e-a591-a460fff64c37 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:59.457308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1283/2583] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:59 2022] PUT /identity/v3/projects/bc5251b2e3f3496696a5eb3fe852801b/users/de8123b8c9e2411c93b23abf30cacf80/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:59.468144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500575e9-62f6-4e0f-b459-5cc39c5dad4a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:59.468453 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500575e9-62f6-4e0f-b459-5cc39c5dad4a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:59.468701 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500575e9-62f6-4e0f-b459-5cc39c5dad4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:59.503294 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-500575e9-62f6-4e0f-b459-5cc39c5dad4a None None] MFA Rules not processed for user `de8123b8c9e2411c93b23abf30cacf80`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:59.504492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-500575e9-62f6-4e0f-b459-5cc39c5dad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:59.583313 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1301/2584] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:38:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:59.596555 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55b9d8-fe1a-4d7e-a591-a460fff64c37 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:59.599155 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2a55b9d8-fe1a-4d7e-a591-a460fff64c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:59.702790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55b9d8-fe1a-4d7e-a591-a460fff64c37 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:59.714287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456be43-87f0-49ff-a54a-93a86d53894b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:59.714969 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456be43-87f0-49ff-a54a-93a86d53894b service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:59.715290 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456be43-87f0-49ff-a54a-93a86d53894b service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:59.715596 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456be43-87f0-49ff-a54a-93a86d53894b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:59.724721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456be43-87f0-49ff-a54a-93a86d53894b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:59.726545 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456be43-87f0-49ff-a54a-93a86d53894b service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:59.736648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1284/2585] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:59.987165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500575e9-62f6-4e0f-b459-5cc39c5dad4a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:00.085981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500575e9-62f6-4e0f-b459-5cc39c5dad4a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:00.091301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:00.091868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:00.092147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:00.092419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] PATH_INFO: `/v3/users/de8123b8c9e2411c93b23abf30cacf80` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:00.093567 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8123b8c9e2411c93b23abf30cacf80)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:00.095513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:00.349780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:00.370346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8123b8c9e2411c93b23abf30cacf80'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.393526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8123b8c9e2411c93b23abf30cacf80'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.394469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8123b8c9e2411c93b23abf30cacf80'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.395091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8123b8c9e2411c93b23abf30cacf80'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.404173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8123b8c9e2411c93b23abf30cacf80'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.508326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1302/2586] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:59 2022] DELETE /identity/v3/users/de8123b8c9e2411c93b23abf30cacf80 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:00.513903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b760b-8d6b-4d59-ab15-a3481620e424 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:00.514506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b760b-8d6b-4d59-ab15-a3481620e424 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:00.514639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b760b-8d6b-4d59-ab15-a3481620e424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:00.539952 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-df6b760b-8d6b-4d59-ab15-a3481620e424 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:00.549834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-df6b760b-8d6b-4d59-ab15-a3481620e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:00.621072 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1285/2587] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:39:00.631951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:00.633780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:00.698994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d499c-86dc-4ce2-bd93-5534811db99a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:00.704062 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e9e9a-8140-4a82-a2f2-c535914dba5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:00.704836 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e9e9a-8140-4a82-a2f2-c535914dba5a service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:00.705133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e9e9a-8140-4a82-a2f2-c535914dba5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:00.705517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e9e9a-8140-4a82-a2f2-c535914dba5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:00.720284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e9e9a-8140-4a82-a2f2-c535914dba5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:00.722011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e9e9a-8140-4a82-a2f2-c535914dba5a service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:00.735674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1303/2588] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:01.261617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b760b-8d6b-4d59-ab15-a3481620e424 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.263270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-df6b760b-8d6b-4d59-ab15-a3481620e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:01.279021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b760b-8d6b-4d59-ab15-a3481620e424 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:01.284449 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:01.285248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.285561 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.285948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393 admin admin] PATH_INFO: `/v3/projects/bc5251b2e3f3496696a5eb3fe852801b` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.287157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5251b2e3f3496696a5eb3fe852801b)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:01.290471 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:01.442091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5251b2e3f3496696a5eb3fe852801b', 'request_id': 'req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:01.449118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5251b2e3f3496696a5eb3fe852801b', 'request_id': 'req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:01.471308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5251b2e3f3496696a5eb3fe852801b', 'request_id': 'req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:01.478114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:01.580437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393 admin admin] The token cache is being invalidate because project bc5251b2e3f3496696a5eb3fe852801b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:01.581127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:01.581650 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e4f418bd-2bc3-4dfe-96c9-6afb27f53393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:01.583409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1286/2589] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:01 2022] DELETE /identity/v3/projects/bc5251b2e3f3496696a5eb3fe852801b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:01.588531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30222f11-2b3a-4944-ad78-7660b849c006 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.588946 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30222f11-2b3a-4944-ad78-7660b849c006 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.589254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30222f11-2b3a-4944-ad78-7660b849c006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.625847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-30222f11-2b3a-4944-ad78-7660b849c006 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:01.627237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-30222f11-2b3a-4944-ad78-7660b849c006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:01.704015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1304/2590] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:39:01.712488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb5c9-3c15-48fc-b99d-04b30d1aa2d2 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.712771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb5c9-3c15-48fc-b99d-04b30d1aa2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.713071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb5c9-3c15-48fc-b99d-04b30d1aa2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.735322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-84cbb5c9-3c15-48fc-b99d-04b30d1aa2d2 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:01.736553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-84cbb5c9-3c15-48fc-b99d-04b30d1aa2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:01.747530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1287/2591] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:01.756904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30222f11-2b3a-4944-ad78-7660b849c006 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.767625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30222f11-2b3a-4944-ad78-7660b849c006 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:01.778855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04c27d-57d1-4a82-bf1b-d0320e7a6f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:01.779888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04c27d-57d1-4a82-bf1b-d0320e7a6f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.782611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04c27d-57d1-4a82-bf1b-d0320e7a6f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.783079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04c27d-57d1-4a82-bf1b-d0320e7a6f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.783864 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04c27d-57d1-4a82-bf1b-d0320e7a6f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:39:01.784265 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04c27d-57d1-4a82-bf1b-d0320e7a6f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:01.785888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04c27d-57d1-4a82-bf1b-d0320e7a6f6b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:01.816566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1305/2592] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:39:01.821308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb5c9-3c15-48fc-b99d-04b30d1aa2d2 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.831131 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb5c9-3c15-48fc-b99d-04b30d1aa2d2 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:01.836095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd4ece-6a8f-4e9f-80b6-6b92da51b1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:01.836926 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd4ece-6a8f-4e9f-80b6-6b92da51b1ce admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.837211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd4ece-6a8f-4e9f-80b6-6b92da51b1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.837486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd4ece-6a8f-4e9f-80b6-6b92da51b1ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.838134 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd4ece-6a8f-4e9f-80b6-6b92da51b1ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:01.840124 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd4ece-6a8f-4e9f-80b6-6b92da51b1ce admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:01.967799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1288/2593] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:01 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:01.972034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04c27d-57d1-4a82-bf1b-d0320e7a6f6b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.985836 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04c27d-57d1-4a82-bf1b-d0320e7a6f6b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:02.034486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:02.055380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a666725-d2e5-4837-b607-ff46a49f3829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:02.056183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a666725-d2e5-4837-b607-ff46a49f3829 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:02.056494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a666725-d2e5-4837-b607-ff46a49f3829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:02.056768 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a666725-d2e5-4837-b607-ff46a49f3829 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:02.057405 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a666725-d2e5-4837-b607-ff46a49f3829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:02.060076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a666725-d2e5-4837-b607-ff46a49f3829 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:02.153622 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1306/2594] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:01 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:02.157816 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd4ece-6a8f-4e9f-80b6-6b92da51b1ce admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:02.169057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd4ece-6a8f-4e9f-80b6-6b92da51b1ce admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:02.173853 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8820df2-9e16-458f-b5ff-bd079ba6f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:02.174489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8820df2-9e16-458f-b5ff-bd079ba6f262 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:02.174775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8820df2-9e16-458f-b5ff-bd079ba6f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:02.175053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8820df2-9e16-458f-b5ff-bd079ba6f262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:02.175714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8820df2-9e16-458f-b5ff-bd079ba6f262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:02.177325 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8820df2-9e16-458f-b5ff-bd079ba6f262 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:02.189379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1289/2595] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:02.193667 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a666725-d2e5-4837-b607-ff46a49f3829 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:02.205279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a666725-d2e5-4837-b607-ff46a49f3829 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:02.210762 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326783ca-dc62-420f-95f6-dc7176e04430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:02.211591 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326783ca-dc62-420f-95f6-dc7176e04430 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:02.211883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326783ca-dc62-420f-95f6-dc7176e04430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:02.212168 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326783ca-dc62-420f-95f6-dc7176e04430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:02.212822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326783ca-dc62-420f-95f6-dc7176e04430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:02.214478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326783ca-dc62-420f-95f6-dc7176e04430 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:02.225757 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1307/2596] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:02.233864 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8820df2-9e16-458f-b5ff-bd079ba6f262 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:02.248161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8820df2-9e16-458f-b5ff-bd079ba6f262 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:02.253230 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad7747-0a7e-4b38-a2bb-af72b4d3631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:02.254054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad7747-0a7e-4b38-a2bb-af72b4d3631e admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:02.254425 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad7747-0a7e-4b38-a2bb-af72b4d3631e admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:02.258663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad7747-0a7e-4b38-a2bb-af72b4d3631e admin admin] PATH_INFO: `/v3/projects/c22d9a9623d546b8a8fc04681a3cc288/users/8fc3fdcdd0e542e9bf430610d5a077d9/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:02.272825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad7747-0a7e-4b38-a2bb-af72b4d3631e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22d9a9623d546b8a8fc04681a3cc288, user_id=8fc3fdcdd0e542e9bf430610d5a077d9, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:02.276108 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad7747-0a7e-4b38-a2bb-af72b4d3631e admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:02.358744 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1290/2597] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:02 2022] PUT /identity/v3/projects/c22d9a9623d546b8a8fc04681a3cc288/users/8fc3fdcdd0e542e9bf430610d5a077d9/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:02.370208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccaca38-5898-49dd-a3c9-c08f1b7ebff9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:02.370615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccaca38-5898-49dd-a3c9-c08f1b7ebff9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:02.370904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccaca38-5898-49dd-a3c9-c08f1b7ebff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:02.405494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2ccaca38-5898-49dd-a3c9-c08f1b7ebff9 None None] MFA Rules not processed for user `8fc3fdcdd0e542e9bf430610d5a077d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:02.406765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2ccaca38-5898-49dd-a3c9-c08f1b7ebff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:02.479197 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1308/2598] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:02.483742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad7747-0a7e-4b38-a2bb-af72b4d3631e admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:02.565209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad7747-0a7e-4b38-a2bb-af72b4d3631e admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:02.574895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f7012-24b7-43e5-80ec-22e4012e9ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:02.576061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f7012-24b7-43e5-80ec-22e4012e9ced admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:02.576269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f7012-24b7-43e5-80ec-22e4012e9ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:02.576649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f7012-24b7-43e5-80ec-22e4012e9ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:02.577381 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f7012-24b7-43e5-80ec-22e4012e9ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:02.588229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f7012-24b7-43e5-80ec-22e4012e9ced admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:02.684539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1291/2599] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:02 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:02.685637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccaca38-5898-49dd-a3c9-c08f1b7ebff9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:02.699917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccaca38-5898-49dd-a3c9-c08f1b7ebff9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:02.798320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c08342-a0d0-4920-b97d-580c8f52b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:02.799108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08342-a0d0-4920-b97d-580c8f52b7ba admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:02.799436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08342-a0d0-4920-b97d-580c8f52b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:02.799761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08342-a0d0-4920-b97d-580c8f52b7ba admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:02.800401 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c08342-a0d0-4920-b97d-580c8f52b7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:02.802490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c08342-a0d0-4920-b97d-580c8f52b7ba admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:03.404272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1309/2600] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:02 2022] POST /identity/v3/users => generated 296 bytes in 716 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:03.405603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f7012-24b7-43e5-80ec-22e4012e9ced admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:03.421074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f7012-24b7-43e5-80ec-22e4012e9ced admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:03.447645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64431c65-b35c-4249-a9ef-9c4aafa3ba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:03.448857 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64431c65-b35c-4249-a9ef-9c4aafa3ba1a admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:03.449575 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64431c65-b35c-4249-a9ef-9c4aafa3ba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:03.450060 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64431c65-b35c-4249-a9ef-9c4aafa3ba1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:03.452358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64431c65-b35c-4249-a9ef-9c4aafa3ba1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:03.453758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64431c65-b35c-4249-a9ef-9c4aafa3ba1a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:03.467352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1292/2601] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:03.472451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c08342-a0d0-4920-b97d-580c8f52b7ba admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:03.494175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c08342-a0d0-4920-b97d-580c8f52b7ba admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:03.503470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f580ba7-a082-485b-9969-a68caaf5e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:03.504697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f580ba7-a082-485b-9969-a68caaf5e2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:03.505425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f580ba7-a082-485b-9969-a68caaf5e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:03.511406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f580ba7-a082-485b-9969-a68caaf5e2cb admin admin] PATH_INFO: `/v3/projects/643721d7b9ed43768c26b14a7bc146ba/users/e6239282363f432bbd0bfd2f93d2fc5f/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:03.529072 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f580ba7-a082-485b-9969-a68caaf5e2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=643721d7b9ed43768c26b14a7bc146ba, user_id=e6239282363f432bbd0bfd2f93d2fc5f, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:03.534475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f580ba7-a082-485b-9969-a68caaf5e2cb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:04.644295 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1310/2602] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:03 2022] PUT /identity/v3/projects/643721d7b9ed43768c26b14a7bc146ba/users/e6239282363f432bbd0bfd2f93d2fc5f/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 1173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:39:04.648559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64431c65-b35c-4249-a9ef-9c4aafa3ba1a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:04.659145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64431c65-b35c-4249-a9ef-9c4aafa3ba1a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:04.718252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83691425-ad42-4ebf-8456-af3444d99f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:04.718874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83691425-ad42-4ebf-8456-af3444d99f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:04.719155 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83691425-ad42-4ebf-8456-af3444d99f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:04.719447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83691425-ad42-4ebf-8456-af3444d99f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:04.720074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83691425-ad42-4ebf-8456-af3444d99f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:04.721710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83691425-ad42-4ebf-8456-af3444d99f54 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:04.727611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:04.733713 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1293/2603] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:39:04.737589 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f580ba7-a082-485b-9969-a68caaf5e2cb admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:04.749547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f580ba7-a082-485b-9969-a68caaf5e2cb admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:04.754179 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7b302-52d3-48d2-a492-34df83c451b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:04.754879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7b302-52d3-48d2-a492-34df83c451b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:04.755159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7b302-52d3-48d2-a492-34df83c451b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:04.755434 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7b302-52d3-48d2-a492-34df83c451b7 admin admin] PATH_INFO: `/v3/projects/643721d7b9ed43768c26b14a7bc146ba/users/e6239282363f432bbd0bfd2f93d2fc5f/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:04.757342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7b302-52d3-48d2-a492-34df83c451b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=643721d7b9ed43768c26b14a7bc146ba, user_id=e6239282363f432bbd0bfd2f93d2fc5f, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:04.760016 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7b302-52d3-48d2-a492-34df83c451b7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:04.767207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:04.771771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1311/2604] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:04 2022] PUT /identity/v3/projects/643721d7b9ed43768c26b14a7bc146ba/users/e6239282363f432bbd0bfd2f93d2fc5f/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:04.785211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281db64-554f-485d-afd2-06da57be5079 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:04.785489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281db64-554f-485d-afd2-06da57be5079 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:04.785866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281db64-554f-485d-afd2-06da57be5079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:04.815033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-7281db64-554f-485d-afd2-06da57be5079 None None] MFA Rules not processed for user `e6239282363f432bbd0bfd2f93d2fc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:04.822410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7281db64-554f-485d-afd2-06da57be5079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:04.892591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1294/2605] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:04.900471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7b302-52d3-48d2-a492-34df83c451b7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:04.908055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-09c7b302-52d3-48d2-a492-34df83c451b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:04.974253 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7b302-52d3-48d2-a492-34df83c451b7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:04.978176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d627deb-4a82-4e8f-89e7-0aae62ee33d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:04.978831 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d627deb-4a82-4e8f-89e7-0aae62ee33d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:04.979114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d627deb-4a82-4e8f-89e7-0aae62ee33d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:04.979458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d627deb-4a82-4e8f-89e7-0aae62ee33d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:04.989512 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d627deb-4a82-4e8f-89e7-0aae62ee33d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:04.991641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d627deb-4a82-4e8f-89e7-0aae62ee33d6 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:05.003537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1312/2606] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:05.310048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281db64-554f-485d-afd2-06da57be5079 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:05.321146 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281db64-554f-485d-afd2-06da57be5079 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:05.324806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2fa7e-de26-47ec-a505-6770e1371ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:05.325403 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2fa7e-de26-47ec-a505-6770e1371ead service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:05.325678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2fa7e-de26-47ec-a505-6770e1371ead service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:05.325953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2fa7e-de26-47ec-a505-6770e1371ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:05.387559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2fa7e-de26-47ec-a505-6770e1371ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:05.389053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2fa7e-de26-47ec-a505-6770e1371ead service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:05.399424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1295/2607] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:09.567867 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d627deb-4a82-4e8f-89e7-0aae62ee33d6 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:09.569342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6d627deb-4a82-4e8f-89e7-0aae62ee33d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:09.634783 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d627deb-4a82-4e8f-89e7-0aae62ee33d6 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:09.639381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:09.640008 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:09.640286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:09.640565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] PATH_INFO: `/v3/users/9499d0800c204af4ac9a514090ef7843` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:09.641947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9499d0800c204af4ac9a514090ef7843)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:09.643894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:09.932962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9499d0800c204af4ac9a514090ef7843'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:09.950940 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9499d0800c204af4ac9a514090ef7843'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:09.950940 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9499d0800c204af4ac9a514090ef7843'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:09.950940 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9499d0800c204af4ac9a514090ef7843'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:09.957631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9499d0800c204af4ac9a514090ef7843'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:10.083730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1313/2608] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:09 2022] DELETE /identity/v3/users/9499d0800c204af4ac9a514090ef7843 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:10.089355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c51a2-1fce-4545-afa0-ff9d992e3134 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:10.089924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c51a2-1fce-4545-afa0-ff9d992e3134 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:10.089924 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c51a2-1fce-4545-afa0-ff9d992e3134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:10.109422 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f13c51a2-1fce-4545-afa0-ff9d992e3134 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:10.110897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f13c51a2-1fce-4545-afa0-ff9d992e3134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:10.172859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1296/2609] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:10.183981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:10.186307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:10.219743 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:10.256217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aae99-cba9-4a3c-9b25-60457385f412 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:10.261060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6e407-7fe2-4168-891c-a400e61b6315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:10.261477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6e407-7fe2-4168-891c-a400e61b6315 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:10.261855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6e407-7fe2-4168-891c-a400e61b6315 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:10.262207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6e407-7fe2-4168-891c-a400e61b6315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:10.272043 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6e407-7fe2-4168-891c-a400e61b6315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:10.273668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6e407-7fe2-4168-891c-a400e61b6315 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:10.289616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1314/2610] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:10.786366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c51a2-1fce-4545-afa0-ff9d992e3134 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:10.787899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f13c51a2-1fce-4545-afa0-ff9d992e3134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:10.801915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c51a2-1fce-4545-afa0-ff9d992e3134 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:10.808285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:10.809004 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:10.809296 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:10.809567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4 admin admin] PATH_INFO: `/v3/projects/eef0fa501f7e4a74835a04dd580f8611` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:10.810758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef0fa501f7e4a74835a04dd580f8611)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:10.812727 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:10.840097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:10.965680 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef0fa501f7e4a74835a04dd580f8611', 'request_id': 'req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:10.972552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef0fa501f7e4a74835a04dd580f8611', 'request_id': 'req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:10.978880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef0fa501f7e4a74835a04dd580f8611', 'request_id': 'req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:11.147451 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4 admin admin] The token cache is being invalidate because project eef0fa501f7e4a74835a04dd580f8611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:11.148164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:11.148865 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-1a9a654d-0b90-4b3d-9594-4b4f4f4cabc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:11.150508 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1297/2611] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:10 2022] DELETE /identity/v3/projects/eef0fa501f7e4a74835a04dd580f8611 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:11.156218 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ea679-3f37-46c3-a9d4-c478caff2e19 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:11.156727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ea679-3f37-46c3-a9d4-c478caff2e19 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:11.156832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ea679-3f37-46c3-a9d4-c478caff2e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:11.178587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9c3ea679-3f37-46c3-a9d4-c478caff2e19 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:11.180036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9c3ea679-3f37-46c3-a9d4-c478caff2e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:11.252574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1315/2612] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:11.254339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba9c51-f4eb-4ce5-af67-2e20b83b5d93 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:11.254623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba9c51-f4eb-4ce5-af67-2e20b83b5d93 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:11.254919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba9c51-f4eb-4ce5-af67-2e20b83b5d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:11.277849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-d6ba9c51-f4eb-4ce5-af67-2e20b83b5d93 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:11.279300 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d6ba9c51-f4eb-4ce5-af67-2e20b83b5d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:11.289591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1298/2613] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:11.293856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ea679-3f37-46c3-a9d4-c478caff2e19 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:11.306022 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ea679-3f37-46c3-a9d4-c478caff2e19 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:11.311615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6120-ac07-42ae-a226-ad4347c2b9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:11.312170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6120-ac07-42ae-a226-ad4347c2b9be admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:11.312449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6120-ac07-42ae-a226-ad4347c2b9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:11.312730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6120-ac07-42ae-a226-ad4347c2b9be admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:11.313446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a6120-ac07-42ae-a226-ad4347c2b9be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:39:11.313750 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a6120-ac07-42ae-a226-ad4347c2b9be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:11.315464 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a6120-ac07-42ae-a226-ad4347c2b9be admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:11.338752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1316/2614] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:39:11.340307 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba9c51-f4eb-4ce5-af67-2e20b83b5d93 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:11.349961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba9c51-f4eb-4ce5-af67-2e20b83b5d93 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:11.355309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea66cd-8c47-448f-bf58-58b5f96867a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:11.355995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea66cd-8c47-448f-bf58-58b5f96867a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:11.356316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea66cd-8c47-448f-bf58-58b5f96867a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:11.357168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea66cd-8c47-448f-bf58-58b5f96867a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:11.357285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea66cd-8c47-448f-bf58-58b5f96867a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:11.359223 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea66cd-8c47-448f-bf58-58b5f96867a3 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:11.530081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1299/2615] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:11 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:11.534465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6120-ac07-42ae-a226-ad4347c2b9be admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:11.545698 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6120-ac07-42ae-a226-ad4347c2b9be admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:11.606033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a585de-7355-4d21-9f2a-4239534a416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:11.606671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a585de-7355-4d21-9f2a-4239534a416d admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:11.606954 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a585de-7355-4d21-9f2a-4239534a416d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:11.607225 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a585de-7355-4d21-9f2a-4239534a416d admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:11.607865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a585de-7355-4d21-9f2a-4239534a416d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:11.609836 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a585de-7355-4d21-9f2a-4239534a416d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:11.718764 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1317/2616] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:11 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:11.722819 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea66cd-8c47-448f-bf58-58b5f96867a3 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:11.734362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea66cd-8c47-448f-bf58-58b5f96867a3 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:11.744547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a82ea0-e91a-4539-a626-006157d78b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:11.745263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a82ea0-e91a-4539-a626-006157d78b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:11.745551 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a82ea0-e91a-4539-a626-006157d78b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:11.745826 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a82ea0-e91a-4539-a626-006157d78b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:11.746655 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a82ea0-e91a-4539-a626-006157d78b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:11.748331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a82ea0-e91a-4539-a626-006157d78b50 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:11.759980 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1300/2617] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:11.764402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a585de-7355-4d21-9f2a-4239534a416d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:11.776290 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a585de-7355-4d21-9f2a-4239534a416d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:11.781394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cda614-e3e3-4f67-87f9-1abfb037a860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:11.781936 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cda614-e3e3-4f67-87f9-1abfb037a860 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:11.782215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cda614-e3e3-4f67-87f9-1abfb037a860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:11.782515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cda614-e3e3-4f67-87f9-1abfb037a860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:11.783165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cda614-e3e3-4f67-87f9-1abfb037a860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:11.784756 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cda614-e3e3-4f67-87f9-1abfb037a860 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:11.798341 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1318/2618] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:11.805187 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a82ea0-e91a-4539-a626-006157d78b50 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:11.815990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a82ea0-e91a-4539-a626-006157d78b50 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:11.821388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee025f-3d6f-407a-ae12-654c220044cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:11.822185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee025f-3d6f-407a-ae12-654c220044cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:11.822503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee025f-3d6f-407a-ae12-654c220044cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:11.822777 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee025f-3d6f-407a-ae12-654c220044cb admin admin] PATH_INFO: `/v3/projects/19186e16ad89443586f254f9b6b03eff/users/16f1319e28c346869b8c08d91b64e25e/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:11.839287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee025f-3d6f-407a-ae12-654c220044cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=19186e16ad89443586f254f9b6b03eff, user_id=16f1319e28c346869b8c08d91b64e25e, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:11.842401 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee025f-3d6f-407a-ae12-654c220044cb admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:12.010540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1301/2619] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:11 2022] PUT /identity/v3/projects/19186e16ad89443586f254f9b6b03eff/users/16f1319e28c346869b8c08d91b64e25e/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:12.078532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15576da-a25b-435c-84c6-250bfcc1d455 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:12.078921 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15576da-a25b-435c-84c6-250bfcc1d455 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:12.079353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15576da-a25b-435c-84c6-250bfcc1d455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:12.108561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f15576da-a25b-435c-84c6-250bfcc1d455 None None] MFA Rules not processed for user `16f1319e28c346869b8c08d91b64e25e`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:12.109804 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f15576da-a25b-435c-84c6-250bfcc1d455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:12.128353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:12.191143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1319/2620] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:12.199601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee025f-3d6f-407a-ae12-654c220044cb admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:12.201583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-daee025f-3d6f-407a-ae12-654c220044cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:12.260933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee025f-3d6f-407a-ae12-654c220044cb admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:12.264919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c2555-8b21-4eb6-8199-a5a45b4a0a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:12.271883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c2555-8b21-4eb6-8199-a5a45b4a0a19 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:12.271883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c2555-8b21-4eb6-8199-a5a45b4a0a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:12.271883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c2555-8b21-4eb6-8199-a5a45b4a0a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:12.276564 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c2555-8b21-4eb6-8199-a5a45b4a0a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:12.278129 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c2555-8b21-4eb6-8199-a5a45b4a0a19 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:12.288099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1302/2621] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:12.426334 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0d427-d531-4f31-8257-f37880ffd760 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:12.426631 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0d427-d531-4f31-8257-f37880ffd760 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:12.426913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0d427-d531-4f31-8257-f37880ffd760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:12.448505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6dc0d427-d531-4f31-8257-f37880ffd760 None None] MFA Rules not processed for user `2a96ca7980a54be5bee6aae4bb54b664`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:12.449796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6dc0d427-d531-4f31-8257-f37880ffd760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:12.540797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1320/2622] 10.222.0.81 () {58 vars in 967 bytes} [Mon Aug 29 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:39:12.568436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c2555-8b21-4eb6-8199-a5a45b4a0a19 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:12.568436 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d56c2555-8b21-4eb6-8199-a5a45b4a0a19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:12.621435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:12.648424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c2555-8b21-4eb6-8199-a5a45b4a0a19 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:12.655275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb29c9a-2691-468d-bec6-f21f0b2a5184 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829ac711e3d84e018404cf6dabeb3845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:12.674053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb29c9a-2691-468d-bec6-f21f0b2a5184 service swift] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:12.674053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb29c9a-2691-468d-bec6-f21f0b2a5184 service swift] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:12.674053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb29c9a-2691-468d-bec6-f21f0b2a5184 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:12.674053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb29c9a-2691-468d-bec6-f21f0b2a5184 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:12.674053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb29c9a-2691-468d-bec6-f21f0b2a5184 service swift] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:12.676991 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1303/2623] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Aug 29 20:39:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:39:18.196047 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0d427-d531-4f31-8257-f37880ffd760 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:18.198477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6dc0d427-d531-4f31-8257-f37880ffd760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:18.269668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0d427-d531-4f31-8257-f37880ffd760 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:18.275617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:18.276260 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:18.276536 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:18.276808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] PATH_INFO: `/v3/users/8fc3fdcdd0e542e9bf430610d5a077d9` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:18.278002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc3fdcdd0e542e9bf430610d5a077d9)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:18.279960 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:18.481955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc3fdcdd0e542e9bf430610d5a077d9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:18.495535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc3fdcdd0e542e9bf430610d5a077d9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:18.496315 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc3fdcdd0e542e9bf430610d5a077d9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:18.496919 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc3fdcdd0e542e9bf430610d5a077d9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:18.499309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:18.505050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc3fdcdd0e542e9bf430610d5a077d9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:18.615200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1321/2624] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:18 2022] DELETE /identity/v3/users/8fc3fdcdd0e542e9bf430610d5a077d9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:18.620175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a722552-ab65-47f1-bccf-ea1186b07a24 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:18.620667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a722552-ab65-47f1-bccf-ea1186b07a24 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:18.620786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a722552-ab65-47f1-bccf-ea1186b07a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:18.639906 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-5a722552-ab65-47f1-bccf-ea1186b07a24 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:18.641140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5a722552-ab65-47f1-bccf-ea1186b07a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:18.703304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1304/2625] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:18.714779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:18.716326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:18.778914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3b4a0-50c6-4bf2-bd6e-050b42757440 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:18.782607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18d8be-45dd-4149-92c4-4aed92724b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:18.783209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18d8be-45dd-4149-92c4-4aed92724b7d service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:18.783487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18d8be-45dd-4149-92c4-4aed92724b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:18.783751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18d8be-45dd-4149-92c4-4aed92724b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:18.793811 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18d8be-45dd-4149-92c4-4aed92724b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:18.795265 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18d8be-45dd-4149-92c4-4aed92724b7d service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:18.805720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1322/2626] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:19.402763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a722552-ab65-47f1-bccf-ea1186b07a24 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:19.404229 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5a722552-ab65-47f1-bccf-ea1186b07a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:19.430175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a722552-ab65-47f1-bccf-ea1186b07a24 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:19.430175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:19.430175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:19.430175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:19.430538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] PATH_INFO: `/v3/projects/c22d9a9623d546b8a8fc04681a3cc288` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:19.430538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22d9a9623d546b8a8fc04681a3cc288)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:19.430538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:19.624367 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22d9a9623d546b8a8fc04681a3cc288', 'request_id': 'req-42d35ac6-9635-48c6-aaf1-00f3b94ef393'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:19.631963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22d9a9623d546b8a8fc04681a3cc288', 'request_id': 'req-42d35ac6-9635-48c6-aaf1-00f3b94ef393'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:19.638878 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22d9a9623d546b8a8fc04681a3cc288', 'request_id': 'req-42d35ac6-9635-48c6-aaf1-00f3b94ef393'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:19.730823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] The token cache is being invalidate because project c22d9a9623d546b8a8fc04681a3cc288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:19.731122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:19.731880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:19.733901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1305/2627] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:19 2022] DELETE /identity/v3/projects/c22d9a9623d546b8a8fc04681a3cc288 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:19.737785 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18d8be-45dd-4149-92c4-4aed92724b7d service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:19.748320 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18d8be-45dd-4149-92c4-4aed92724b7d service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:19.817139 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3eb4db-b258-48d6-9b20-cde583eb1f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:19.817768 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3eb4db-b258-48d6-9b20-cde583eb1f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:19.818042 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3eb4db-b258-48d6-9b20-cde583eb1f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:19.819037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3eb4db-b258-48d6-9b20-cde583eb1f99 admin admin] PATH_INFO: `/v3/users/e6239282363f432bbd0bfd2f93d2fc5f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:19.820138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3eb4db-b258-48d6-9b20-cde583eb1f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6239282363f432bbd0bfd2f93d2fc5f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:19.822149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3eb4db-b258-48d6-9b20-cde583eb1f99 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:20.040126 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0d3eb4db-b258-48d6-9b20-cde583eb1f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6239282363f432bbd0bfd2f93d2fc5f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:20.052070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0d3eb4db-b258-48d6-9b20-cde583eb1f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6239282363f432bbd0bfd2f93d2fc5f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:20.052774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0d3eb4db-b258-48d6-9b20-cde583eb1f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6239282363f432bbd0bfd2f93d2fc5f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:20.054525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0d3eb4db-b258-48d6-9b20-cde583eb1f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6239282363f432bbd0bfd2f93d2fc5f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:20.089182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0d3eb4db-b258-48d6-9b20-cde583eb1f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6239282363f432bbd0bfd2f93d2fc5f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:20.207697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1323/2628] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:19 2022] DELETE /identity/v3/users/e6239282363f432bbd0bfd2f93d2fc5f => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:20.639818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:20.641591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:20.659003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d35ac6-9635-48c6-aaf1-00f3b94ef393 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:20.726955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b429939-76ec-40a1-83cb-7a64de12312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:20.727775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b429939-76ec-40a1-83cb-7a64de12312a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:20.728056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b429939-76ec-40a1-83cb-7a64de12312a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:20.728325 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b429939-76ec-40a1-83cb-7a64de12312a admin admin] PATH_INFO: `/v3/projects/643721d7b9ed43768c26b14a7bc146ba` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:20.729516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b429939-76ec-40a1-83cb-7a64de12312a admin admin] RBAC: Authorizing `identity:delete_project(project_id=643721d7b9ed43768c26b14a7bc146ba)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:20.731521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b429939-76ec-40a1-83cb-7a64de12312a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:20.733028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:20.862676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8b429939-76ec-40a1-83cb-7a64de12312a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643721d7b9ed43768c26b14a7bc146ba', 'request_id': 'req-8b429939-76ec-40a1-83cb-7a64de12312a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:20.869689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8b429939-76ec-40a1-83cb-7a64de12312a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643721d7b9ed43768c26b14a7bc146ba', 'request_id': 'req-8b429939-76ec-40a1-83cb-7a64de12312a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:20.875419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8b429939-76ec-40a1-83cb-7a64de12312a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643721d7b9ed43768c26b14a7bc146ba', 'request_id': 'req-8b429939-76ec-40a1-83cb-7a64de12312a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:21.032855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8b429939-76ec-40a1-83cb-7a64de12312a admin admin] The token cache is being invalidate because project 643721d7b9ed43768c26b14a7bc146ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:21.033145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8b429939-76ec-40a1-83cb-7a64de12312a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:21.033782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8b429939-76ec-40a1-83cb-7a64de12312a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:21.035529 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1306/2629] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:20 2022] DELETE /identity/v3/projects/643721d7b9ed43768c26b14a7bc146ba => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:21.040564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed32fe-3e15-4dc0-9efd-556c639edca1 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:21.041063 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed32fe-3e15-4dc0-9efd-556c639edca1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:21.041158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed32fe-3e15-4dc0-9efd-556c639edca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:21.056205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:21.062476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-71ed32fe-3e15-4dc0-9efd-556c639edca1 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:21.063692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-71ed32fe-3e15-4dc0-9efd-556c639edca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:21.126077 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1324/2630] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:39:21.135118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c228043-6dcc-42d7-8731-9f100f110c2f None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:21.135477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c228043-6dcc-42d7-8731-9f100f110c2f None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:21.135752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c228043-6dcc-42d7-8731-9f100f110c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:21.160195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-1c228043-6dcc-42d7-8731-9f100f110c2f None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:21.160195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-1c228043-6dcc-42d7-8731-9f100f110c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:21.168038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1307/2631] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:21.172448 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed32fe-3e15-4dc0-9efd-556c639edca1 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:21.183423 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed32fe-3e15-4dc0-9efd-556c639edca1 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:21.189053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6b849-9c87-4fcd-9d75-4417858050ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:21.189674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6b849-9c87-4fcd-9d75-4417858050ae admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:21.189952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6b849-9c87-4fcd-9d75-4417858050ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:21.190295 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6b849-9c87-4fcd-9d75-4417858050ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:21.190974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6b849-9c87-4fcd-9d75-4417858050ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:39:21.191275 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6b849-9c87-4fcd-9d75-4417858050ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:21.192862 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6b849-9c87-4fcd-9d75-4417858050ae admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:21.204977 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1325/2632] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:39:21.209879 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c228043-6dcc-42d7-8731-9f100f110c2f None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:21.220328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c228043-6dcc-42d7-8731-9f100f110c2f None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:21.225717 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae1c0b-c141-4fc0-ada1-d364954f53be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:21.226527 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae1c0b-c141-4fc0-ada1-d364954f53be admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:21.226802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae1c0b-c141-4fc0-ada1-d364954f53be admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:21.227067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae1c0b-c141-4fc0-ada1-d364954f53be admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:21.227700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae1c0b-c141-4fc0-ada1-d364954f53be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:21.229586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae1c0b-c141-4fc0-ada1-d364954f53be admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:21.351622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1308/2633] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:21 2022] POST /identity/v3/projects => generated 357 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:21.353543 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6b849-9c87-4fcd-9d75-4417858050ae admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:21.363478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6b849-9c87-4fcd-9d75-4417858050ae admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:21.429952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d416e-3f7e-42b0-880c-30c34c5bfcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:21.430692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d416e-3f7e-42b0-880c-30c34c5bfcbd admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:21.430897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d416e-3f7e-42b0-880c-30c34c5bfcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:21.431251 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d416e-3f7e-42b0-880c-30c34c5bfcbd admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:21.435538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d416e-3f7e-42b0-880c-30c34c5bfcbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:21.435538 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d416e-3f7e-42b0-880c-30c34c5bfcbd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:21.552592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1326/2634] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:21 2022] POST /identity/v3/users => generated 279 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:21.554087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae1c0b-c141-4fc0-ada1-d364954f53be admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:21.565945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae1c0b-c141-4fc0-ada1-d364954f53be admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:21.572210 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0751a-ca55-46f7-9676-092dbbde10ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:21.572871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0751a-ca55-46f7-9676-092dbbde10ea admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:21.573235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0751a-ca55-46f7-9676-092dbbde10ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:21.573514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0751a-ca55-46f7-9676-092dbbde10ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:21.574176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0751a-ca55-46f7-9676-092dbbde10ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:21.575951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0751a-ca55-46f7-9676-092dbbde10ea admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:21.586645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1309/2635] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:21.590851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d416e-3f7e-42b0-880c-30c34c5bfcbd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:21.601180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d416e-3f7e-42b0-880c-30c34c5bfcbd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:21.605912 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da810d-57bb-4296-97ce-6ad688d8324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:21.606620 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da810d-57bb-4296-97ce-6ad688d8324e admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:21.606967 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da810d-57bb-4296-97ce-6ad688d8324e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:21.607246 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da810d-57bb-4296-97ce-6ad688d8324e admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:21.607890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da810d-57bb-4296-97ce-6ad688d8324e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:21.609469 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da810d-57bb-4296-97ce-6ad688d8324e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:21.621733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1327/2636] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:21.626284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0751a-ca55-46f7-9676-092dbbde10ea admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:21.637787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0751a-ca55-46f7-9676-092dbbde10ea admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:21.644453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21d320-658b-47a0-b5c5-24125b3be059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:21.645140 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21d320-658b-47a0-b5c5-24125b3be059 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:21.645423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21d320-658b-47a0-b5c5-24125b3be059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:21.645701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21d320-658b-47a0-b5c5-24125b3be059 admin admin] PATH_INFO: `/v3/projects/f337bbf45f9e4297a9949243c0ed989e/users/a24fdae894984cdeaee89f6780855ce5/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:21.664269 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21d320-658b-47a0-b5c5-24125b3be059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f337bbf45f9e4297a9949243c0ed989e, user_id=a24fdae894984cdeaee89f6780855ce5, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:21.667121 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21d320-658b-47a0-b5c5-24125b3be059 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:21.748139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1310/2637] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:21 2022] PUT /identity/v3/projects/f337bbf45f9e4297a9949243c0ed989e/users/a24fdae894984cdeaee89f6780855ce5/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:21.759865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23701468-5324-4c2f-a409-825b5aba0573 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:21.760148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23701468-5324-4c2f-a409-825b5aba0573 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:21.760419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23701468-5324-4c2f-a409-825b5aba0573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:21.793847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-23701468-5324-4c2f-a409-825b5aba0573 None None] MFA Rules not processed for user `a24fdae894984cdeaee89f6780855ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:21.795113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-23701468-5324-4c2f-a409-825b5aba0573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:21.877700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1328/2638] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:39:21.883840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21d320-658b-47a0-b5c5-24125b3be059 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:21.964946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21d320-658b-47a0-b5c5-24125b3be059 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:21.969848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdde6f0-1e83-411e-a8a4-fa9ae3b091d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:21.970490 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdde6f0-1e83-411e-a8a4-fa9ae3b091d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:21.970772 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdde6f0-1e83-411e-a8a4-fa9ae3b091d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:21.971042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdde6f0-1e83-411e-a8a4-fa9ae3b091d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:21.971744 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdde6f0-1e83-411e-a8a4-fa9ae3b091d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:21.973676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdde6f0-1e83-411e-a8a4-fa9ae3b091d9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:22.109001 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1311/2639] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:21 2022] POST /identity/v3/projects => generated 357 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:22.113140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23701468-5324-4c2f-a409-825b5aba0573 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:22.120261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:22.126766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23701468-5324-4c2f-a409-825b5aba0573 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:22.197779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6b16f-98a2-47da-b0cc-1b79750373ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:22.198428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6b16f-98a2-47da-b0cc-1b79750373ce admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:22.198708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6b16f-98a2-47da-b0cc-1b79750373ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:22.198981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6b16f-98a2-47da-b0cc-1b79750373ce admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:22.199635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6b16f-98a2-47da-b0cc-1b79750373ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:22.202182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6b16f-98a2-47da-b0cc-1b79750373ce admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:22.405178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1329/2640] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:22 2022] POST /identity/v3/users => generated 285 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:22.409408 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdde6f0-1e83-411e-a8a4-fa9ae3b091d9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:22.423979 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdde6f0-1e83-411e-a8a4-fa9ae3b091d9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:22.431394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04d211-769d-44a7-baec-cd78c16e1fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:22.432583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04d211-769d-44a7-baec-cd78c16e1fae admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:22.432858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04d211-769d-44a7-baec-cd78c16e1fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:22.433347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04d211-769d-44a7-baec-cd78c16e1fae admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:22.434428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04d211-769d-44a7-baec-cd78c16e1fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:22.436245 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04d211-769d-44a7-baec-cd78c16e1fae admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:22.445238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:22.452376 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1312/2641] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:39:22.457148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6b16f-98a2-47da-b0cc-1b79750373ce admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:22.475491 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6b16f-98a2-47da-b0cc-1b79750373ce admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:22.481595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96f0ac-7fb1-497b-a25d-be6faf4574db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:22.487686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96f0ac-7fb1-497b-a25d-be6faf4574db admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:22.487686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96f0ac-7fb1-497b-a25d-be6faf4574db admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:22.487686 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96f0ac-7fb1-497b-a25d-be6faf4574db admin admin] PATH_INFO: `/v3/projects/d36d0bf535ca4fc2878b5c543825a535/users/7281776c04bc40beadfa6a3ceee70ff4/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:22.501202 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96f0ac-7fb1-497b-a25d-be6faf4574db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36d0bf535ca4fc2878b5c543825a535, user_id=7281776c04bc40beadfa6a3ceee70ff4, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:22.505789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96f0ac-7fb1-497b-a25d-be6faf4574db admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:22.599336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1330/2642] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:22 2022] PUT /identity/v3/projects/d36d0bf535ca4fc2878b5c543825a535/users/7281776c04bc40beadfa6a3ceee70ff4/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:22.605257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04d211-769d-44a7-baec-cd78c16e1fae admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:22.617578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04d211-769d-44a7-baec-cd78c16e1fae admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:22.684097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed12c0e-6678-4585-869c-dd33977585a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:22.684749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed12c0e-6678-4585-869c-dd33977585a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:22.684936 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed12c0e-6678-4585-869c-dd33977585a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:22.685220 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed12c0e-6678-4585-869c-dd33977585a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:22.686034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed12c0e-6678-4585-869c-dd33977585a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:22.687580 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed12c0e-6678-4585-869c-dd33977585a9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:22.699238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1313/2643] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:22.703868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96f0ac-7fb1-497b-a25d-be6faf4574db admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:22.716235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96f0ac-7fb1-497b-a25d-be6faf4574db admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:22.724400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3a01a-0415-4a9c-818c-0628c6704b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:22.725089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3a01a-0415-4a9c-818c-0628c6704b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:22.725404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3a01a-0415-4a9c-818c-0628c6704b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:22.725727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3a01a-0415-4a9c-818c-0628c6704b04 admin admin] PATH_INFO: `/v3/projects/d36d0bf535ca4fc2878b5c543825a535/users/7281776c04bc40beadfa6a3ceee70ff4/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:22.727752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3a01a-0415-4a9c-818c-0628c6704b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36d0bf535ca4fc2878b5c543825a535, user_id=7281776c04bc40beadfa6a3ceee70ff4, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:22.730410 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3a01a-0415-4a9c-818c-0628c6704b04 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:22.741115 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1331/2644] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:22 2022] PUT /identity/v3/projects/d36d0bf535ca4fc2878b5c543825a535/users/7281776c04bc40beadfa6a3ceee70ff4/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:22.752770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcf1a4-89dd-493d-8d90-53d5ab0b6eed None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:22.763392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcf1a4-89dd-493d-8d90-53d5ab0b6eed None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:22.763392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcf1a4-89dd-493d-8d90-53d5ab0b6eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:22.784359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-c2dcf1a4-89dd-493d-8d90-53d5ab0b6eed None None] MFA Rules not processed for user `7281776c04bc40beadfa6a3ceee70ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:22.785610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c2dcf1a4-89dd-493d-8d90-53d5ab0b6eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:22.857493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1314/2645] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:22.869377 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3a01a-0415-4a9c-818c-0628c6704b04 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:22.871152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0ab3a01a-0415-4a9c-818c-0628c6704b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:22.931343 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3a01a-0415-4a9c-818c-0628c6704b04 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:22.935187 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399c643-184c-4f1e-a7c9-fcbd8f9ebcf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:22.935744 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399c643-184c-4f1e-a7c9-fcbd8f9ebcf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:22.936024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399c643-184c-4f1e-a7c9-fcbd8f9ebcf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:22.936300 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399c643-184c-4f1e-a7c9-fcbd8f9ebcf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:22.946928 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399c643-184c-4f1e-a7c9-fcbd8f9ebcf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:22.948412 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399c643-184c-4f1e-a7c9-fcbd8f9ebcf4 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:22.958153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1332/2646] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:23.132195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcf1a4-89dd-493d-8d90-53d5ab0b6eed None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:23.142733 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcf1a4-89dd-493d-8d90-53d5ab0b6eed None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:23.146993 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124178c0-4440-45ec-8226-d3da8027a386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:23.147601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124178c0-4440-45ec-8226-d3da8027a386 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:23.147923 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124178c0-4440-45ec-8226-d3da8027a386 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:23.148202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124178c0-4440-45ec-8226-d3da8027a386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:23.212695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124178c0-4440-45ec-8226-d3da8027a386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:23.214046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124178c0-4440-45ec-8226-d3da8027a386 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:23.223198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1315/2647] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:32.953796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=69,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:33.219022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=91 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:42.881844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399c643-184c-4f1e-a7c9-fcbd8f9ebcf4 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:42.947696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399c643-184c-4f1e-a7c9-fcbd8f9ebcf4 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:42.952480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:42.959460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:42.959460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:42.959460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] PATH_INFO: `/v3/users/a24fdae894984cdeaee89f6780855ce5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:42.959460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24fdae894984cdeaee89f6780855ce5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:42.959460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:43.146524 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24fdae894984cdeaee89f6780855ce5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.161285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24fdae894984cdeaee89f6780855ce5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.162141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24fdae894984cdeaee89f6780855ce5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.162818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24fdae894984cdeaee89f6780855ce5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.170571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24fdae894984cdeaee89f6780855ce5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.244376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1333/2648] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:42 2022] DELETE /identity/v3/users/a24fdae894984cdeaee89f6780855ce5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:43.248866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55df9e8-fa23-4f59-a2ca-a4b28bd93447 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:43.249356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55df9e8-fa23-4f59-a2ca-a4b28bd93447 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:43.249462 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55df9e8-fa23-4f59-a2ca-a4b28bd93447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:43.270798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-c55df9e8-fa23-4f59-a2ca-a4b28bd93447 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:43.272034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c55df9e8-fa23-4f59-a2ca-a4b28bd93447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:43.335741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1316/2649] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:43.345975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:43.347456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:43.406898 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f2e3b-c940-4b9b-b26f-f73453bb130f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:43.410549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173230b-200a-4e4e-a13b-ddb99b916524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:43.411441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173230b-200a-4e4e-a13b-ddb99b916524 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:43.411718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173230b-200a-4e4e-a13b-ddb99b916524 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:43.411988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173230b-200a-4e4e-a13b-ddb99b916524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:43.422257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173230b-200a-4e4e-a13b-ddb99b916524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:43.423710 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173230b-200a-4e4e-a13b-ddb99b916524 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:43.434453 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1334/2650] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:43.894892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55df9e8-fa23-4f59-a2ca-a4b28bd93447 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:43.900723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c55df9e8-fa23-4f59-a2ca-a4b28bd93447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:43.909557 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55df9e8-fa23-4f59-a2ca-a4b28bd93447 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:43.914637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:43.915246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:43.915531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:43.915803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] PATH_INFO: `/v3/projects/f337bbf45f9e4297a9949243c0ed989e` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:43.916947 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f337bbf45f9e4297a9949243c0ed989e)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:43.918938 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.068463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f337bbf45f9e4297a9949243c0ed989e', 'request_id': 'req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.076218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f337bbf45f9e4297a9949243c0ed989e', 'request_id': 'req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.082210 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f337bbf45f9e4297a9949243c0ed989e', 'request_id': 'req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.186838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] The token cache is being invalidate because project f337bbf45f9e4297a9949243c0ed989e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:44.187065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.187661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.189195 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1317/2651] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:43 2022] DELETE /identity/v3/projects/f337bbf45f9e4297a9949243c0ed989e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:44.193237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173230b-200a-4e4e-a13b-ddb99b916524 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.204476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173230b-200a-4e4e-a13b-ddb99b916524 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.223357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:44.267216 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06c662-dc6d-4b63-8ad0-97009bd3df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.267889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06c662-dc6d-4b63-8ad0-97009bd3df04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.268173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06c662-dc6d-4b63-8ad0-97009bd3df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.268446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06c662-dc6d-4b63-8ad0-97009bd3df04 admin admin] PATH_INFO: `/v3/users/7281776c04bc40beadfa6a3ceee70ff4` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.269690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06c662-dc6d-4b63-8ad0-97009bd3df04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7281776c04bc40beadfa6a3ceee70ff4)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.271664 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06c662-dc6d-4b63-8ad0-97009bd3df04 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.524643 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ab06c662-dc6d-4b63-8ad0-97009bd3df04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7281776c04bc40beadfa6a3ceee70ff4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.536713 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ab06c662-dc6d-4b63-8ad0-97009bd3df04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7281776c04bc40beadfa6a3ceee70ff4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.539823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ab06c662-dc6d-4b63-8ad0-97009bd3df04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7281776c04bc40beadfa6a3ceee70ff4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.539823 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ab06c662-dc6d-4b63-8ad0-97009bd3df04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7281776c04bc40beadfa6a3ceee70ff4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.545938 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ab06c662-dc6d-4b63-8ad0-97009bd3df04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7281776c04bc40beadfa6a3ceee70ff4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.649164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1335/2652] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:44 2022] DELETE /identity/v3/users/7281776c04bc40beadfa6a3ceee70ff4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:39:45.204708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:45.206170 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:45.219759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5ec17-bfba-4ebb-9bdc-10c4faecc6c5 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:45.286640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:45.287285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:45.287562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:45.287835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f admin admin] PATH_INFO: `/v3/projects/d36d0bf535ca4fc2878b5c543825a535` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:45.288974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36d0bf535ca4fc2878b5c543825a535)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:45.291600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:45.396805 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:45.415629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36d0bf535ca4fc2878b5c543825a535', 'request_id': 'req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:45.423197 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36d0bf535ca4fc2878b5c543825a535', 'request_id': 'req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:45.429502 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36d0bf535ca4fc2878b5c543825a535', 'request_id': 'req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:45.544767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f admin admin] The token cache is being invalidate because project d36d0bf535ca4fc2878b5c543825a535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:45.544767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:45.545460 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-634e57b4-e13d-47ca-8cf1-cd68acca2a7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:45.547037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1318/2653] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:45 2022] DELETE /identity/v3/projects/d36d0bf535ca4fc2878b5c543825a535 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:45.563672 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845e798-71eb-4b76-88a9-668bfb0148c9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:45.564171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845e798-71eb-4b76-88a9-668bfb0148c9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:45.564286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845e798-71eb-4b76-88a9-668bfb0148c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:45.584899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9845e798-71eb-4b76-88a9-668bfb0148c9 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:45.586727 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9845e798-71eb-4b76-88a9-668bfb0148c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:45.650454 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1336/2654] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:45.658292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae68edb-e979-4d19-b457-7fad0b58a8a4 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:45.658583 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae68edb-e979-4d19-b457-7fad0b58a8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:45.658860 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae68edb-e979-4d19-b457-7fad0b58a8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:45.679648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-3ae68edb-e979-4d19-b457-7fad0b58a8a4 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:45.680929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3ae68edb-e979-4d19-b457-7fad0b58a8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:45.688842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1319/2655] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:45.693150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845e798-71eb-4b76-88a9-668bfb0148c9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:45.703082 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845e798-71eb-4b76-88a9-668bfb0148c9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:45.707690 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6b76d-2066-4601-a979-46ea837a50ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:45.708287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6b76d-2066-4601-a979-46ea837a50ea admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:45.708562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6b76d-2066-4601-a979-46ea837a50ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:45.708833 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6b76d-2066-4601-a979-46ea837a50ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:45.709473 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6b76d-2066-4601-a979-46ea837a50ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:39:45.709774 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6b76d-2066-4601-a979-46ea837a50ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:45.712019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6b76d-2066-4601-a979-46ea837a50ea admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:45.723519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1337/2656] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:39:45.728872 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae68edb-e979-4d19-b457-7fad0b58a8a4 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:45.738885 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae68edb-e979-4d19-b457-7fad0b58a8a4 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:45.745760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2c366-e05d-4bb9-9fdb-b316eb903a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:45.746445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2c366-e05d-4bb9-9fdb-b316eb903a34 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:45.746741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2c366-e05d-4bb9-9fdb-b316eb903a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:45.747021 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2c366-e05d-4bb9-9fdb-b316eb903a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:45.748042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2c366-e05d-4bb9-9fdb-b316eb903a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:45.750298 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2c366-e05d-4bb9-9fdb-b316eb903a34 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:45.874070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1320/2657] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:45 2022] POST /identity/v3/projects => generated 401 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:45.878578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6b76d-2066-4601-a979-46ea837a50ea admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:45.889239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6b76d-2066-4601-a979-46ea837a50ea admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:45.918931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:45.952522 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb305f1-fccc-40f5-aa83-ebc47d7fd7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:45.953133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb305f1-fccc-40f5-aa83-ebc47d7fd7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:45.953413 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb305f1-fccc-40f5-aa83-ebc47d7fd7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:45.953681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb305f1-fccc-40f5-aa83-ebc47d7fd7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:45.954414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb305f1-fccc-40f5-aa83-ebc47d7fd7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:45.956428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb305f1-fccc-40f5-aa83-ebc47d7fd7e6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:46.066150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1338/2658] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:45 2022] POST /identity/v3/users => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:46.070786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2c366-e05d-4bb9-9fdb-b316eb903a34 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:46.082257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2c366-e05d-4bb9-9fdb-b316eb903a34 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:46.087314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5c2ea-6b04-4493-afde-42ff91840d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:46.087905 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c2ea-6b04-4493-afde-42ff91840d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:46.088174 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c2ea-6b04-4493-afde-42ff91840d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:46.088442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c2ea-6b04-4493-afde-42ff91840d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:46.089106 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5c2ea-6b04-4493-afde-42ff91840d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:46.090797 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5c2ea-6b04-4493-afde-42ff91840d04 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:46.102328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1321/2659] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:46.106923 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb305f1-fccc-40f5-aa83-ebc47d7fd7e6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:46.116956 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb305f1-fccc-40f5-aa83-ebc47d7fd7e6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:46.122467 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630ee0b-7490-441c-9f5b-2b8cf9970f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:46.123112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ee0b-7490-441c-9f5b-2b8cf9970f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:46.123390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ee0b-7490-441c-9f5b-2b8cf9970f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:46.123658 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ee0b-7490-441c-9f5b-2b8cf9970f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:46.124300 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630ee0b-7490-441c-9f5b-2b8cf9970f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:46.125878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630ee0b-7490-441c-9f5b-2b8cf9970f7f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:46.137858 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1339/2660] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:46.142260 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5c2ea-6b04-4493-afde-42ff91840d04 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:46.152442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5c2ea-6b04-4493-afde-42ff91840d04 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:46.157592 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d44b17-9b33-4297-aac6-c1614739c6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:46.158276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44b17-9b33-4297-aac6-c1614739c6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:46.158561 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44b17-9b33-4297-aac6-c1614739c6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:46.158830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44b17-9b33-4297-aac6-c1614739c6dc admin admin] PATH_INFO: `/v3/projects/99b04f8e98ae4902bc38b7ecf8a0db66/users/c46cbb9c8b744ab38d52f831786e18e7/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:46.174695 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d44b17-9b33-4297-aac6-c1614739c6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b04f8e98ae4902bc38b7ecf8a0db66, user_id=c46cbb9c8b744ab38d52f831786e18e7, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:46.177317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d44b17-9b33-4297-aac6-c1614739c6dc admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:46.267352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1322/2661] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:46 2022] PUT /identity/v3/projects/99b04f8e98ae4902bc38b7ecf8a0db66/users/c46cbb9c8b744ab38d52f831786e18e7/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:46.280409 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbc5ce-7696-4186-aff6-cfac3fdb31c7 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:46.280694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbc5ce-7696-4186-aff6-cfac3fdb31c7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:46.280977 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbc5ce-7696-4186-aff6-cfac3fdb31c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:46.310445 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c1bbc5ce-7696-4186-aff6-cfac3fdb31c7 None None] MFA Rules not processed for user `c46cbb9c8b744ab38d52f831786e18e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:46.311675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c1bbc5ce-7696-4186-aff6-cfac3fdb31c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:46.379655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1340/2662] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:46 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:46.384233 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d44b17-9b33-4297-aac6-c1614739c6dc admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:46.450940 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d44b17-9b33-4297-aac6-c1614739c6dc admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:46.455648 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b82d95-78ca-41da-9499-37b8c7f10df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:46.456252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b82d95-78ca-41da-9499-37b8c7f10df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:46.456553 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b82d95-78ca-41da-9499-37b8c7f10df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:46.456858 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b82d95-78ca-41da-9499-37b8c7f10df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:46.457540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b82d95-78ca-41da-9499-37b8c7f10df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:46.459554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b82d95-78ca-41da-9499-37b8c7f10df7 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:46.594279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1323/2663] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:46 2022] POST /identity/v3/projects => generated 399 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:46.598527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbc5ce-7696-4186-aff6-cfac3fdb31c7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:46.611866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbc5ce-7696-4186-aff6-cfac3fdb31c7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:46.675539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc323c70-d12e-4e8c-8924-21a0554858f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:46.676249 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc323c70-d12e-4e8c-8924-21a0554858f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:46.676529 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc323c70-d12e-4e8c-8924-21a0554858f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:46.676800 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc323c70-d12e-4e8c-8924-21a0554858f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:46.677435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc323c70-d12e-4e8c-8924-21a0554858f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:46.679367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc323c70-d12e-4e8c-8924-21a0554858f6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:46.764337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1341/2664] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:46 2022] POST /identity/v3/users => generated 306 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:46.774879 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b82d95-78ca-41da-9499-37b8c7f10df7 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:46.786099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b82d95-78ca-41da-9499-37b8c7f10df7 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:46.791999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24dc91-1f2b-47a4-be4d-b1a8986523a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:46.792755 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24dc91-1f2b-47a4-be4d-b1a8986523a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:46.793078 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24dc91-1f2b-47a4-be4d-b1a8986523a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:46.793540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24dc91-1f2b-47a4-be4d-b1a8986523a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:46.794349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24dc91-1f2b-47a4-be4d-b1a8986523a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:46.796266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24dc91-1f2b-47a4-be4d-b1a8986523a9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:46.812525 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1324/2665] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:46.816664 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc323c70-d12e-4e8c-8924-21a0554858f6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:46.828288 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc323c70-d12e-4e8c-8924-21a0554858f6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:46.833360 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022a934-9e6e-4dad-ad55-b865f867b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:46.834031 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022a934-9e6e-4dad-ad55-b865f867b80e admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:46.834340 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022a934-9e6e-4dad-ad55-b865f867b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:46.834615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022a934-9e6e-4dad-ad55-b865f867b80e admin admin] PATH_INFO: `/v3/projects/64e4dbda8cf44f239f6063c47ea043e9/users/19137eb6566a4ac4a261e2c24207e6bc/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:46.850481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022a934-9e6e-4dad-ad55-b865f867b80e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e4dbda8cf44f239f6063c47ea043e9, user_id=19137eb6566a4ac4a261e2c24207e6bc, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:46.853108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022a934-9e6e-4dad-ad55-b865f867b80e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:46.967357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1342/2666] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:46 2022] PUT /identity/v3/projects/64e4dbda8cf44f239f6063c47ea043e9/users/19137eb6566a4ac4a261e2c24207e6bc/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:46.971263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24dc91-1f2b-47a4-be4d-b1a8986523a9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:46.983227 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24dc91-1f2b-47a4-be4d-b1a8986523a9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:47.007546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:47.045904 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6d9cc-77b8-4deb-9af0-fe2efbdc68ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:47.046551 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6d9cc-77b8-4deb-9af0-fe2efbdc68ce admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:47.046880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6d9cc-77b8-4deb-9af0-fe2efbdc68ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:47.047154 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6d9cc-77b8-4deb-9af0-fe2efbdc68ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:47.047803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6d9cc-77b8-4deb-9af0-fe2efbdc68ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:47.049541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6d9cc-77b8-4deb-9af0-fe2efbdc68ce admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:47.060828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1325/2667] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:39:47.065237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022a934-9e6e-4dad-ad55-b865f867b80e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:47.070894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:47.076961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022a934-9e6e-4dad-ad55-b865f867b80e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:47.081724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48805181-93b8-4baa-90d4-2c14b758affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:47.082299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48805181-93b8-4baa-90d4-2c14b758affe admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:47.089431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48805181-93b8-4baa-90d4-2c14b758affe admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:47.089431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48805181-93b8-4baa-90d4-2c14b758affe admin admin] PATH_INFO: `/v3/projects/64e4dbda8cf44f239f6063c47ea043e9/users/19137eb6566a4ac4a261e2c24207e6bc/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:47.089431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48805181-93b8-4baa-90d4-2c14b758affe admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e4dbda8cf44f239f6063c47ea043e9, user_id=19137eb6566a4ac4a261e2c24207e6bc, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:47.089431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48805181-93b8-4baa-90d4-2c14b758affe admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:47.098198 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1343/2668] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:47 2022] PUT /identity/v3/projects/64e4dbda8cf44f239f6063c47ea043e9/users/19137eb6566a4ac4a261e2c24207e6bc/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:47.108830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a156fc-e6c2-4064-b6f0-4dff2e14fc23 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:47.109113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a156fc-e6c2-4064-b6f0-4dff2e14fc23 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:47.109640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a156fc-e6c2-4064-b6f0-4dff2e14fc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:47.147185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-56a156fc-e6c2-4064-b6f0-4dff2e14fc23 None None] MFA Rules not processed for user `19137eb6566a4ac4a261e2c24207e6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:47.148392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-56a156fc-e6c2-4064-b6f0-4dff2e14fc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:47.218541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1326/2669] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:47 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:47.229259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48805181-93b8-4baa-90d4-2c14b758affe admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:47.230992 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-48805181-93b8-4baa-90d4-2c14b758affe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:47.296809 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48805181-93b8-4baa-90d4-2c14b758affe admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:47.300980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5371e-757c-41a5-bb1d-52880f5678bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:47.301633 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5371e-757c-41a5-bb1d-52880f5678bf service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:47.301913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5371e-757c-41a5-bb1d-52880f5678bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:47.302186 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5371e-757c-41a5-bb1d-52880f5678bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:47.313055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5371e-757c-41a5-bb1d-52880f5678bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:47.314607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5371e-757c-41a5-bb1d-52880f5678bf service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:47.324297 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1344/2670] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:47 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:47.607778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a156fc-e6c2-4064-b6f0-4dff2e14fc23 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:47.618506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a156fc-e6c2-4064-b6f0-4dff2e14fc23 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:47.628453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33367b0-15b6-4b7b-a532-6170e8c17611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:47.628453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33367b0-15b6-4b7b-a532-6170e8c17611 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:47.628453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33367b0-15b6-4b7b-a532-6170e8c17611 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:47.628453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33367b0-15b6-4b7b-a532-6170e8c17611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:47.689294 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33367b0-15b6-4b7b-a532-6170e8c17611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:47.690796 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33367b0-15b6-4b7b-a532-6170e8c17611 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:47.700872 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1327/2671] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:47 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:39:54.161834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5371e-757c-41a5-bb1d-52880f5678bf service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:54.232765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5371e-757c-41a5-bb1d-52880f5678bf service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:54.237428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:54.238088 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:54.238395 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:54.238665 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] PATH_INFO: `/v3/users/c46cbb9c8b744ab38d52f831786e18e7` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:54.239784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46cbb9c8b744ab38d52f831786e18e7)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:54.241813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:54.355031 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33367b0-15b6-4b7b-a532-6170e8c17611 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:54.355031 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a33367b0-15b6-4b7b-a532-6170e8c17611 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:54.409417 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:54.443715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46cbb9c8b744ab38d52f831786e18e7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:54.456907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33367b0-15b6-4b7b-a532-6170e8c17611 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:54.458546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46cbb9c8b744ab38d52f831786e18e7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:54.459269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46cbb9c8b744ab38d52f831786e18e7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:54.459887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46cbb9c8b744ab38d52f831786e18e7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:54.462825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e6e38-1d93-4801-9cd4-2af1384a28bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:54.463277 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e6e38-1d93-4801-9cd4-2af1384a28bd service placement] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:54.463569 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e6e38-1d93-4801-9cd4-2af1384a28bd service placement] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:54.463840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e6e38-1d93-4801-9cd4-2af1384a28bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:54.465716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-445e6e38-1d93-4801-9cd4-2af1384a28bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:54.467525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46cbb9c8b744ab38d52f831786e18e7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:54.481474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e6e38-1d93-4801-9cd4-2af1384a28bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:54.483144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e6e38-1d93-4801-9cd4-2af1384a28bd service placement] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:54.494512 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1328/2672] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:39:54.608545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1345/2673] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:54 2022] DELETE /identity/v3/users/c46cbb9c8b744ab38d52f831786e18e7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:54.613312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23516b-e520-4314-a650-189d7d5bc7ed None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:54.613610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23516b-e520-4314-a650-189d7d5bc7ed None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:54.613886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23516b-e520-4314-a650-189d7d5bc7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:54.634430 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-cb23516b-e520-4314-a650-189d7d5bc7ed None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:54.636641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-cb23516b-e520-4314-a650-189d7d5bc7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:54.702483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1329/2674] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:54.713425 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:54.716629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:54.738870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:54.925181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d4f4e-78b8-4aa9-9258-5df75943f236 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:54.928818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54687c-fd00-4045-8f28-ae13376e72b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:54.929417 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54687c-fd00-4045-8f28-ae13376e72b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:54.929696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54687c-fd00-4045-8f28-ae13376e72b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:54.929963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54687c-fd00-4045-8f28-ae13376e72b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:54.941207 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54687c-fd00-4045-8f28-ae13376e72b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:54.942655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54687c-fd00-4045-8f28-ae13376e72b5 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:54.954146 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1346/2675] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:55.459630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23516b-e520-4314-a650-189d7d5bc7ed None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:55.464494 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-cb23516b-e520-4314-a650-189d7d5bc7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:55.475601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23516b-e520-4314-a650-189d7d5bc7ed None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:55.481366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:55.482079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:55.482528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:55.482660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] PATH_INFO: `/v3/projects/99b04f8e98ae4902bc38b7ecf8a0db66` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:55.483836 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b04f8e98ae4902bc38b7ecf8a0db66)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:55.485804 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:55.633431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b04f8e98ae4902bc38b7ecf8a0db66', 'request_id': 'req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:55.640623 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b04f8e98ae4902bc38b7ecf8a0db66', 'request_id': 'req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:55.646880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b04f8e98ae4902bc38b7ecf8a0db66', 'request_id': 'req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:55.785767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] The token cache is being invalidate because project 99b04f8e98ae4902bc38b7ecf8a0db66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:55.785994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:55.786641 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:55.788188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1330/2676] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:55 2022] DELETE /identity/v3/projects/99b04f8e98ae4902bc38b7ecf8a0db66 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:55.792428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54687c-fd00-4045-8f28-ae13376e72b5 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:55.801993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54687c-fd00-4045-8f28-ae13376e72b5 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:55.861553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fcf42-164a-48cc-adbe-3b90b349fd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:55.862237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fcf42-164a-48cc-adbe-3b90b349fd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:55.862529 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fcf42-164a-48cc-adbe-3b90b349fd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:55.862801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fcf42-164a-48cc-adbe-3b90b349fd64 admin admin] PATH_INFO: `/v3/users/19137eb6566a4ac4a261e2c24207e6bc` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:55.864124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fcf42-164a-48cc-adbe-3b90b349fd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19137eb6566a4ac4a261e2c24207e6bc)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:55.866006 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fcf42-164a-48cc-adbe-3b90b349fd64 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:56.136222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-867fcf42-164a-48cc-adbe-3b90b349fd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19137eb6566a4ac4a261e2c24207e6bc'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:56.149688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-867fcf42-164a-48cc-adbe-3b90b349fd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19137eb6566a4ac4a261e2c24207e6bc'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:56.150888 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-867fcf42-164a-48cc-adbe-3b90b349fd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19137eb6566a4ac4a261e2c24207e6bc'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:56.151505 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-867fcf42-164a-48cc-adbe-3b90b349fd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19137eb6566a4ac4a261e2c24207e6bc'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:56.159399 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-867fcf42-164a-48cc-adbe-3b90b349fd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19137eb6566a4ac4a261e2c24207e6bc'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:56.272133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1347/2677] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:55 2022] DELETE /identity/v3/users/19137eb6566a4ac4a261e2c24207e6bc => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:39:56.836985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:56.839235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:56.853002 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9369195-d8ce-49b6-ad3f-a8ebf10d7610 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:56.897214 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:56.922713 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9132376-8821-4ca8-b739-0b0708efcd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:56.923348 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9132376-8821-4ca8-b739-0b0708efcd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:56.923632 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9132376-8821-4ca8-b739-0b0708efcd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:56.923901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9132376-8821-4ca8-b739-0b0708efcd3d admin admin] PATH_INFO: `/v3/projects/64e4dbda8cf44f239f6063c47ea043e9` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:56.925061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9132376-8821-4ca8-b739-0b0708efcd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e4dbda8cf44f239f6063c47ea043e9)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:56.926978 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9132376-8821-4ca8-b739-0b0708efcd3d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:57.045278 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f9132376-8821-4ca8-b739-0b0708efcd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e4dbda8cf44f239f6063c47ea043e9', 'request_id': 'req-f9132376-8821-4ca8-b739-0b0708efcd3d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:57.051784 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f9132376-8821-4ca8-b739-0b0708efcd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e4dbda8cf44f239f6063c47ea043e9', 'request_id': 'req-f9132376-8821-4ca8-b739-0b0708efcd3d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:57.057849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f9132376-8821-4ca8-b739-0b0708efcd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e4dbda8cf44f239f6063c47ea043e9', 'request_id': 'req-f9132376-8821-4ca8-b739-0b0708efcd3d'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:57.204037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f9132376-8821-4ca8-b739-0b0708efcd3d admin admin] The token cache is being invalidate because project 64e4dbda8cf44f239f6063c47ea043e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:57.204428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f9132376-8821-4ca8-b739-0b0708efcd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:57.204913 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f9132376-8821-4ca8-b739-0b0708efcd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:57.206463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1331/2678] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:56 2022] DELETE /identity/v3/projects/64e4dbda8cf44f239f6063c47ea043e9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:57.211531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48505-6a09-4a3c-b758-d2ce54721aa7 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:57.212050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48505-6a09-4a3c-b758-d2ce54721aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:57.212050 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48505-6a09-4a3c-b758-d2ce54721aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:57.232875 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c6f48505-6a09-4a3c-b758-d2ce54721aa7 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:57.234087 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c6f48505-6a09-4a3c-b758-d2ce54721aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:57.264308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:57.295361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1348/2679] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:57.304989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0f4f-5bbc-4c7d-b0a0-1de70ab83263 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:57.308409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0f4f-5bbc-4c7d-b0a0-1de70ab83263 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:57.308409 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0f4f-5bbc-4c7d-b0a0-1de70ab83263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:57.328538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-096e0f4f-5bbc-4c7d-b0a0-1de70ab83263 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:57.329823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-096e0f4f-5bbc-4c7d-b0a0-1de70ab83263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:57.338855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1332/2680] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:57.344086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f48505-6a09-4a3c-b758-d2ce54721aa7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:57.354807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f48505-6a09-4a3c-b758-d2ce54721aa7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:57.359671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55bdc5-9396-46e4-ae8c-8b4e6a7f8896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:57.360378 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55bdc5-9396-46e4-ae8c-8b4e6a7f8896 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:57.360735 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55bdc5-9396-46e4-ae8c-8b4e6a7f8896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:57.361124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55bdc5-9396-46e4-ae8c-8b4e6a7f8896 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:57.361794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55bdc5-9396-46e4-ae8c-8b4e6a7f8896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:39:57.362101 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55bdc5-9396-46e4-ae8c-8b4e6a7f8896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:57.363756 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55bdc5-9396-46e4-ae8c-8b4e6a7f8896 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:57.378698 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1349/2681] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:39:57.383157 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e0f4f-5bbc-4c7d-b0a0-1de70ab83263 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:57.393493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e0f4f-5bbc-4c7d-b0a0-1de70ab83263 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:57.401022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6269d9-b161-4603-a101-2e43bdd21ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:57.401974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6269d9-b161-4603-a101-2e43bdd21ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:57.402874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6269d9-b161-4603-a101-2e43bdd21ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:57.402874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6269d9-b161-4603-a101-2e43bdd21ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:57.403505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6269d9-b161-4603-a101-2e43bdd21ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:57.405793 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6269d9-b161-4603-a101-2e43bdd21ae9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:57.515580 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1333/2682] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:57 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:57.517889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55bdc5-9396-46e4-ae8c-8b4e6a7f8896 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:57.529045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55bdc5-9396-46e4-ae8c-8b4e6a7f8896 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:57.589158 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e3fce-938c-4f4d-ae34-40adcf23ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:57.589975 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e3fce-938c-4f4d-ae34-40adcf23ccf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:57.590384 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e3fce-938c-4f4d-ae34-40adcf23ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:57.590659 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e3fce-938c-4f4d-ae34-40adcf23ccf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:57.591365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e3fce-938c-4f4d-ae34-40adcf23ccf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:57.593382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e3fce-938c-4f4d-ae34-40adcf23ccf8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:57.701938 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1350/2683] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:57 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:57.706127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6269d9-b161-4603-a101-2e43bdd21ae9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:57.716982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6269d9-b161-4603-a101-2e43bdd21ae9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:57.721544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c7616-1a57-47b2-835d-d745fc952945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:57.722172 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c7616-1a57-47b2-835d-d745fc952945 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:57.728231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c7616-1a57-47b2-835d-d745fc952945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:57.728231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c7616-1a57-47b2-835d-d745fc952945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:57.728231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c7616-1a57-47b2-835d-d745fc952945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:57.728231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c7616-1a57-47b2-835d-d745fc952945 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:57.735016 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1334/2684] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:57.740246 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e3fce-938c-4f4d-ae34-40adcf23ccf8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:57.751507 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e3fce-938c-4f4d-ae34-40adcf23ccf8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:57.756214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756806a-1c89-45c4-8af6-fa463695ee43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:57.756893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756806a-1c89-45c4-8af6-fa463695ee43 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:57.757166 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756806a-1c89-45c4-8af6-fa463695ee43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:57.757439 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756806a-1c89-45c4-8af6-fa463695ee43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:57.758075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756806a-1c89-45c4-8af6-fa463695ee43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:57.760483 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756806a-1c89-45c4-8af6-fa463695ee43 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:57.771971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1351/2685] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:57.777165 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c7616-1a57-47b2-835d-d745fc952945 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:57.788041 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c7616-1a57-47b2-835d-d745fc952945 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:57.793429 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099953a8-d15d-4ac7-b8a1-518cfe45ae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:57.794193 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099953a8-d15d-4ac7-b8a1-518cfe45ae88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:57.794509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099953a8-d15d-4ac7-b8a1-518cfe45ae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:57.794786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099953a8-d15d-4ac7-b8a1-518cfe45ae88 admin admin] PATH_INFO: `/v3/projects/7ee34a6612b14894aae78b506527ca1d/users/090324ad1a224928ad3ff06b96f44fb5/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:57.810486 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099953a8-d15d-4ac7-b8a1-518cfe45ae88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee34a6612b14894aae78b506527ca1d, user_id=090324ad1a224928ad3ff06b96f44fb5, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:57.813147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099953a8-d15d-4ac7-b8a1-518cfe45ae88 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:57.904556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1335/2686] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:57 2022] PUT /identity/v3/projects/7ee34a6612b14894aae78b506527ca1d/users/090324ad1a224928ad3ff06b96f44fb5/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:57.916365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beae66-ef9e-4dd6-a685-3def166444d6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:57.916641 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beae66-ef9e-4dd6-a685-3def166444d6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:57.917513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beae66-ef9e-4dd6-a685-3def166444d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:57.946660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c2beae66-ef9e-4dd6-a685-3def166444d6 None None] MFA Rules not processed for user `090324ad1a224928ad3ff06b96f44fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:57.948391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c2beae66-ef9e-4dd6-a685-3def166444d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:58.015368 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1352/2687] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:58.020567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099953a8-d15d-4ac7-b8a1-518cfe45ae88 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:58.087210 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099953a8-d15d-4ac7-b8a1-518cfe45ae88 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:58.092832 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506799ab-728e-43cf-9025-b13e643d9180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:58.093465 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506799ab-728e-43cf-9025-b13e643d9180 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:58.101653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506799ab-728e-43cf-9025-b13e643d9180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:58.101653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506799ab-728e-43cf-9025-b13e643d9180 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:58.101653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506799ab-728e-43cf-9025-b13e643d9180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:58.101653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506799ab-728e-43cf-9025-b13e643d9180 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:58.106742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:58.200270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1336/2688] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:58 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:58.204278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2beae66-ef9e-4dd6-a685-3def166444d6 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:58.215392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2beae66-ef9e-4dd6-a685-3def166444d6 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:58.240837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:58.273563 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa3052-a9e3-46ad-b303-a2af4363a403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:58.274165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa3052-a9e3-46ad-b303-a2af4363a403 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:58.274481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa3052-a9e3-46ad-b303-a2af4363a403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:58.274749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa3052-a9e3-46ad-b303-a2af4363a403 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:58.275778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa3052-a9e3-46ad-b303-a2af4363a403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:58.277907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa3052-a9e3-46ad-b303-a2af4363a403 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:58.357061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1353/2689] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:58 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:58.361129 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506799ab-728e-43cf-9025-b13e643d9180 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:58.372473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506799ab-728e-43cf-9025-b13e643d9180 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:58.377182 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414082b5-6ca2-4c7b-98e8-a5a84cdea77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:58.377791 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414082b5-6ca2-4c7b-98e8-a5a84cdea77c admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:58.378160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414082b5-6ca2-4c7b-98e8-a5a84cdea77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:58.378398 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414082b5-6ca2-4c7b-98e8-a5a84cdea77c admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:58.379042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414082b5-6ca2-4c7b-98e8-a5a84cdea77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:58.380640 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414082b5-6ca2-4c7b-98e8-a5a84cdea77c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:58.392487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1337/2690] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:39:58.397312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa3052-a9e3-46ad-b303-a2af4363a403 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:58.408125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa3052-a9e3-46ad-b303-a2af4363a403 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:58.412903 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bafc74-1227-469f-9602-d2c97da845c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:58.413674 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bafc74-1227-469f-9602-d2c97da845c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:58.413953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bafc74-1227-469f-9602-d2c97da845c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:58.414241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bafc74-1227-469f-9602-d2c97da845c5 admin admin] PATH_INFO: `/v3/projects/46484caaf4ee41a58a1e0448b150421c/users/60979bf028a64015ba81bb2d6f65a5bc/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:58.430910 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bafc74-1227-469f-9602-d2c97da845c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46484caaf4ee41a58a1e0448b150421c, user_id=60979bf028a64015ba81bb2d6f65a5bc, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:58.434037 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bafc74-1227-469f-9602-d2c97da845c5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:58.558263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1354/2691] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:58 2022] PUT /identity/v3/projects/46484caaf4ee41a58a1e0448b150421c/users/60979bf028a64015ba81bb2d6f65a5bc/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:58.562206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414082b5-6ca2-4c7b-98e8-a5a84cdea77c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:58.572823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414082b5-6ca2-4c7b-98e8-a5a84cdea77c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:58.634945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3de340-8f25-45a1-bc16-3d2bf77f652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:58.635626 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de340-8f25-45a1-bc16-3d2bf77f652e admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:58.635962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de340-8f25-45a1-bc16-3d2bf77f652e admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:58.636242 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de340-8f25-45a1-bc16-3d2bf77f652e admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:58.636957 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3de340-8f25-45a1-bc16-3d2bf77f652e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:58.638716 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3de340-8f25-45a1-bc16-3d2bf77f652e admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:58.649110 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1338/2692] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:58.653628 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bafc74-1227-469f-9602-d2c97da845c5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:58.664662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bafc74-1227-469f-9602-d2c97da845c5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:58.670210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc8ce4-7735-429c-b1d3-b7a49bcecd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:58.670879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc8ce4-7735-429c-b1d3-b7a49bcecd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:58.671151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc8ce4-7735-429c-b1d3-b7a49bcecd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:58.671430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc8ce4-7735-429c-b1d3-b7a49bcecd08 admin admin] PATH_INFO: `/v3/projects/46484caaf4ee41a58a1e0448b150421c/users/60979bf028a64015ba81bb2d6f65a5bc/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:58.673305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc8ce4-7735-429c-b1d3-b7a49bcecd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46484caaf4ee41a58a1e0448b150421c, user_id=60979bf028a64015ba81bb2d6f65a5bc, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:58.676523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc8ce4-7735-429c-b1d3-b7a49bcecd08 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:58.688312 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1355/2693] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:58 2022] PUT /identity/v3/projects/46484caaf4ee41a58a1e0448b150421c/users/60979bf028a64015ba81bb2d6f65a5bc/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:58.699708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e14ba8-7279-4d2e-bc74-3f8120e0b527 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:58.704227 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e14ba8-7279-4d2e-bc74-3f8120e0b527 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:58.704227 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e14ba8-7279-4d2e-bc74-3f8120e0b527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:58.729175 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-16e14ba8-7279-4d2e-bc74-3f8120e0b527 None None] MFA Rules not processed for user `60979bf028a64015ba81bb2d6f65a5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:58.730472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-16e14ba8-7279-4d2e-bc74-3f8120e0b527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:58.805352 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1339/2694] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:39:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:58.816907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc8ce4-7735-429c-b1d3-b7a49bcecd08 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:58.818937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b6cc8ce4-7735-429c-b1d3-b7a49bcecd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:58.880380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc8ce4-7735-429c-b1d3-b7a49bcecd08 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:58.884434 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91efd0-ade6-47e9-9c16-99b949e73e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:58.885460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91efd0-ade6-47e9-9c16-99b949e73e9c service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:58.885739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91efd0-ade6-47e9-9c16-99b949e73e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:58.886014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91efd0-ade6-47e9-9c16-99b949e73e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:58.895947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91efd0-ade6-47e9-9c16-99b949e73e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:58.897443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91efd0-ade6-47e9-9c16-99b949e73e9c service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:58.907897 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1356/2695] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:59.013123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e14ba8-7279-4d2e-bc74-3f8120e0b527 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:59.023481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e14ba8-7279-4d2e-bc74-3f8120e0b527 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:59.028635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d711a9-873b-4497-a132-2f6c7da1eb47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:59.029289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d711a9-873b-4497-a132-2f6c7da1eb47 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:59.029594 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d711a9-873b-4497-a132-2f6c7da1eb47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:59.029867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d711a9-873b-4497-a132-2f6c7da1eb47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:59.088820 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d711a9-873b-4497-a132-2f6c7da1eb47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:59.090043 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d711a9-873b-4497-a132-2f6c7da1eb47 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:59.093663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:59.099582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1340/2696] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:01.498722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91efd0-ade6-47e9-9c16-99b949e73e9c service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:01.500215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9b91efd0-ade6-47e9-9c16-99b949e73e9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:01.565432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91efd0-ade6-47e9-9c16-99b949e73e9c service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:01.570175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:01.570825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.571184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.571390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] PATH_INFO: `/v3/users/16f1319e28c346869b8c08d91b64e25e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.572576 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f1319e28c346869b8c08d91b64e25e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:01.574872 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:01.693021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:01.807122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f1319e28c346869b8c08d91b64e25e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:01.819171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f1319e28c346869b8c08d91b64e25e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:01.819851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f1319e28c346869b8c08d91b64e25e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:01.820444 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f1319e28c346869b8c08d91b64e25e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:01.827757 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f1319e28c346869b8c08d91b64e25e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:01.903887 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1357/2697] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:01 2022] DELETE /identity/v3/users/16f1319e28c346869b8c08d91b64e25e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:01.908621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7dc6d-9bc1-4edf-adf7-4b4760b2440a None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.909102 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7dc6d-9bc1-4edf-adf7-4b4760b2440a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.909206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7dc6d-9bc1-4edf-adf7-4b4760b2440a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.928365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-84c7dc6d-9bc1-4edf-adf7-4b4760b2440a None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:01.929589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-84c7dc6d-9bc1-4edf-adf7-4b4760b2440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:01.994424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1341/2698] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:02.005028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:02.006490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:02.065468 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5450193-9c92-4e71-ad14-745ca747a879 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:02.069034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e20e49-a0bb-4ecc-ad4b-35f72e94f1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:02.069632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e20e49-a0bb-4ecc-ad4b-35f72e94f1ad service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:02.069907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e20e49-a0bb-4ecc-ad4b-35f72e94f1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:02.070175 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e20e49-a0bb-4ecc-ad4b-35f72e94f1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:02.080391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e20e49-a0bb-4ecc-ad4b-35f72e94f1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:02.081949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e20e49-a0bb-4ecc-ad4b-35f72e94f1ad service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:02.092225 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1358/2699] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:02.312649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7dc6d-9bc1-4edf-adf7-4b4760b2440a None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:02.317271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-84c7dc6d-9bc1-4edf-adf7-4b4760b2440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:02.327219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7dc6d-9bc1-4edf-adf7-4b4760b2440a None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:02.332077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed6dc8-5929-4ba1-9dc9-f3e58eb04943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:02.332908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6dc8-5929-4ba1-9dc9-f3e58eb04943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:02.333279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6dc8-5929-4ba1-9dc9-f3e58eb04943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:02.333587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6dc8-5929-4ba1-9dc9-f3e58eb04943 admin admin] PATH_INFO: `/v3/users/090324ad1a224928ad3ff06b96f44fb5` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:02.334828 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed6dc8-5929-4ba1-9dc9-f3e58eb04943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090324ad1a224928ad3ff06b96f44fb5)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:02.336840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed6dc8-5929-4ba1-9dc9-f3e58eb04943 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:02.507646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e20e49-a0bb-4ecc-ad4b-35f72e94f1ad service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:02.509190 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-37e20e49-a0bb-4ecc-ad4b-35f72e94f1ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:02.524334 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e20e49-a0bb-4ecc-ad4b-35f72e94f1ad service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:02.529906 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:02.530630 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:02.530910 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:02.531190 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] PATH_INFO: `/v3/projects/19186e16ad89443586f254f9b6b03eff` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:02.532364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19186e16ad89443586f254f9b6b03eff)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:02.534326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:02.553308 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bbed6dc8-5929-4ba1-9dc9-f3e58eb04943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090324ad1a224928ad3ff06b96f44fb5'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:02.561251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bbed6dc8-5929-4ba1-9dc9-f3e58eb04943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090324ad1a224928ad3ff06b96f44fb5'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:02.561964 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bbed6dc8-5929-4ba1-9dc9-f3e58eb04943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090324ad1a224928ad3ff06b96f44fb5'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:02.664773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19186e16ad89443586f254f9b6b03eff', 'request_id': 'req-2a10eb78-c215-4d30-978c-e4024dc6def1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:02.671438 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19186e16ad89443586f254f9b6b03eff', 'request_id': 'req-2a10eb78-c215-4d30-978c-e4024dc6def1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:02.675776 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bbed6dc8-5929-4ba1-9dc9-f3e58eb04943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090324ad1a224928ad3ff06b96f44fb5'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:02.689657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-bbed6dc8-5929-4ba1-9dc9-f3e58eb04943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090324ad1a224928ad3ff06b96f44fb5'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:02.695771 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1342/2700] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:02 2022] DELETE /identity/v3/users/090324ad1a224928ad3ff06b96f44fb5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:02.700707 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cfa31-8261-4d0b-bbe7-070a7c550795 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:02.700999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cfa31-8261-4d0b-bbe7-070a7c550795 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:02.701276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cfa31-8261-4d0b-bbe7-070a7c550795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:02.720265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-dc9cfa31-8261-4d0b-bbe7-070a7c550795 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:02.721455 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-dc9cfa31-8261-4d0b-bbe7-070a7c550795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:02.782887 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1343/2701] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:40:02.792625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cfa31-8261-4d0b-bbe7-070a7c550795 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:02.794760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-dc9cfa31-8261-4d0b-bbe7-070a7c550795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:02.794925 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19186e16ad89443586f254f9b6b03eff', 'request_id': 'req-2a10eb78-c215-4d30-978c-e4024dc6def1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:02.806561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] The token cache is being invalidate because project 19186e16ad89443586f254f9b6b03eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:02.806859 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:02.807486 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:02.808164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:02.808999 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1359/2702] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:02 2022] DELETE /identity/v3/projects/19186e16ad89443586f254f9b6b03eff => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:02.861806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cfa31-8261-4d0b-bbe7-070a7c550795 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:02.865639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af137079-35c8-45d4-af65-9be5f6c8c768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:02.866301 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af137079-35c8-45d4-af65-9be5f6c8c768 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:02.866589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af137079-35c8-45d4-af65-9be5f6c8c768 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:02.866861 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af137079-35c8-45d4-af65-9be5f6c8c768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:02.868730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-af137079-35c8-45d4-af65-9be5f6c8c768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:02.883510 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af137079-35c8-45d4-af65-9be5f6c8c768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:02.885028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af137079-35c8-45d4-af65-9be5f6c8c768 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:02.897364 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1344/2703] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:40:03.307546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:03.309116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:03.348054 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:03.386047 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10eb78-c215-4d30-978c-e4024dc6def1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:03.392039 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:03.392708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:03.392983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:03.393278 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] PATH_INFO: `/v3/projects/7ee34a6612b14894aae78b506527ca1d` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:03.394487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee34a6612b14894aae78b506527ca1d)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:03.396485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:03.525416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee34a6612b14894aae78b506527ca1d', 'request_id': 'req-16c080c7-744d-43b3-8b2a-7c74df9848e6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:03.532949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee34a6612b14894aae78b506527ca1d', 'request_id': 'req-16c080c7-744d-43b3-8b2a-7c74df9848e6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:03.618779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee34a6612b14894aae78b506527ca1d', 'request_id': 'req-16c080c7-744d-43b3-8b2a-7c74df9848e6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:03.632778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] The token cache is being invalidate because project 7ee34a6612b14894aae78b506527ca1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:03.633067 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:03.633785 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:03.635361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1360/2704] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:03 2022] DELETE /identity/v3/projects/7ee34a6612b14894aae78b506527ca1d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:03.640647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af137079-35c8-45d4-af65-9be5f6c8c768 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:03.651020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af137079-35c8-45d4-af65-9be5f6c8c768 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:03.715694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a9538-24de-4f76-8c6e-7ad4698b3d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:03.716336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a9538-24de-4f76-8c6e-7ad4698b3d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:03.716810 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a9538-24de-4f76-8c6e-7ad4698b3d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:03.717088 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a9538-24de-4f76-8c6e-7ad4698b3d5e admin admin] PATH_INFO: `/v3/users/60979bf028a64015ba81bb2d6f65a5bc` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:03.718384 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a9538-24de-4f76-8c6e-7ad4698b3d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=60979bf028a64015ba81bb2d6f65a5bc)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:03.720360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a9538-24de-4f76-8c6e-7ad4698b3d5e admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:04.004543 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f46a9538-24de-4f76-8c6e-7ad4698b3d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60979bf028a64015ba81bb2d6f65a5bc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:04.011989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f46a9538-24de-4f76-8c6e-7ad4698b3d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60979bf028a64015ba81bb2d6f65a5bc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:04.012738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f46a9538-24de-4f76-8c6e-7ad4698b3d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60979bf028a64015ba81bb2d6f65a5bc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:04.109252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f46a9538-24de-4f76-8c6e-7ad4698b3d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60979bf028a64015ba81bb2d6f65a5bc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:04.126109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-f46a9538-24de-4f76-8c6e-7ad4698b3d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60979bf028a64015ba81bb2d6f65a5bc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:04.132639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1345/2705] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:03 2022] DELETE /identity/v3/users/60979bf028a64015ba81bb2d6f65a5bc => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:04.585282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:04.592153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:04.601418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c080c7-744d-43b3-8b2a-7c74df9848e6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:04.661224 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44822e-c943-463a-a634-afa6896f73b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:04.661855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44822e-c943-463a-a634-afa6896f73b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:04.662133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44822e-c943-463a-a634-afa6896f73b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:04.662429 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44822e-c943-463a-a634-afa6896f73b2 admin admin] PATH_INFO: `/v3/projects/46484caaf4ee41a58a1e0448b150421c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:04.663542 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44822e-c943-463a-a634-afa6896f73b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46484caaf4ee41a58a1e0448b150421c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:04.665451 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44822e-c943-463a-a634-afa6896f73b2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:04.773645 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8f44822e-c943-463a-a634-afa6896f73b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46484caaf4ee41a58a1e0448b150421c', 'request_id': 'req-8f44822e-c943-463a-a634-afa6896f73b2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:04.780261 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8f44822e-c943-463a-a634-afa6896f73b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46484caaf4ee41a58a1e0448b150421c', 'request_id': 'req-8f44822e-c943-463a-a634-afa6896f73b2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:04.866078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8f44822e-c943-463a-a634-afa6896f73b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46484caaf4ee41a58a1e0448b150421c', 'request_id': 'req-8f44822e-c943-463a-a634-afa6896f73b2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:04.867685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:04.877886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8f44822e-c943-463a-a634-afa6896f73b2 admin admin] The token cache is being invalidate because project 46484caaf4ee41a58a1e0448b150421c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:04.879587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8f44822e-c943-463a-a634-afa6896f73b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:04.879587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8f44822e-c943-463a-a634-afa6896f73b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:04.880329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1361/2706] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:04 2022] DELETE /identity/v3/projects/46484caaf4ee41a58a1e0448b150421c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:04.885198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984fa9a-3316-4cf3-9b4d-c4b3d9ef2b45 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:04.886133 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984fa9a-3316-4cf3-9b4d-c4b3d9ef2b45 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:04.886446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984fa9a-3316-4cf3-9b4d-c4b3d9ef2b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:04.907610 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-0984fa9a-3316-4cf3-9b4d-c4b3d9ef2b45 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:04.908884 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-0984fa9a-3316-4cf3-9b4d-c4b3d9ef2b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:04.940012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:04.970871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1346/2707] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:05.037137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900db87-b8d5-4fcb-b78c-21c525e2a7e7 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:05.037418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900db87-b8d5-4fcb-b78c-21c525e2a7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:05.037721 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900db87-b8d5-4fcb-b78c-21c525e2a7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:05.058452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6900db87-b8d5-4fcb-b78c-21c525e2a7e7 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:05.061153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6900db87-b8d5-4fcb-b78c-21c525e2a7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:05.067558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1362/2708] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:05.071907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984fa9a-3316-4cf3-9b4d-c4b3d9ef2b45 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:05.082084 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984fa9a-3316-4cf3-9b4d-c4b3d9ef2b45 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:05.087238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b32df9-1fc2-4ea0-a640-a18f42b17518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:05.087842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b32df9-1fc2-4ea0-a640-a18f42b17518 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:05.089849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b32df9-1fc2-4ea0-a640-a18f42b17518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:05.089849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b32df9-1fc2-4ea0-a640-a18f42b17518 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:05.089849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b32df9-1fc2-4ea0-a640-a18f42b17518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:40:05.089849 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b32df9-1fc2-4ea0-a640-a18f42b17518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:05.091866 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b32df9-1fc2-4ea0-a640-a18f42b17518 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:05.103917 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1347/2709] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:40:05.110071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900db87-b8d5-4fcb-b78c-21c525e2a7e7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:05.119475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900db87-b8d5-4fcb-b78c-21c525e2a7e7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:05.124300 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ff44a-69b3-4c9e-aa43-478af1149d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:05.125024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ff44a-69b3-4c9e-aa43-478af1149d29 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:05.125264 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ff44a-69b3-4c9e-aa43-478af1149d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:05.125532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ff44a-69b3-4c9e-aa43-478af1149d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:05.126159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ff44a-69b3-4c9e-aa43-478af1149d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:05.128065 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ff44a-69b3-4c9e-aa43-478af1149d29 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:05.213856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1363/2710] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:05 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:05.219946 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b32df9-1fc2-4ea0-a640-a18f42b17518 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:05.232675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b32df9-1fc2-4ea0-a640-a18f42b17518 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:05.293144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603b6c6-f908-45fc-bb94-410ca46c44fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:05.293817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603b6c6-f908-45fc-bb94-410ca46c44fb admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:05.294098 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603b6c6-f908-45fc-bb94-410ca46c44fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:05.294410 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603b6c6-f908-45fc-bb94-410ca46c44fb admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:05.295052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603b6c6-f908-45fc-bb94-410ca46c44fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:05.296982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603b6c6-f908-45fc-bb94-410ca46c44fb admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:05.385925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1348/2711] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:05 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:05.390766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ff44a-69b3-4c9e-aa43-478af1149d29 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:05.402149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ff44a-69b3-4c9e-aa43-478af1149d29 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:05.407566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c3ced-2c03-4800-9b40-38cd5e290e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:05.408183 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c3ced-2c03-4800-9b40-38cd5e290e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:05.408480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c3ced-2c03-4800-9b40-38cd5e290e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:05.408742 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c3ced-2c03-4800-9b40-38cd5e290e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:05.409372 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c3ced-2c03-4800-9b40-38cd5e290e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:05.411061 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c3ced-2c03-4800-9b40-38cd5e290e2c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:05.422125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1364/2712] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:05.426253 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603b6c6-f908-45fc-bb94-410ca46c44fb admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:05.436608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603b6c6-f908-45fc-bb94-410ca46c44fb admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:05.441800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a622315-709d-411d-b47a-92e56b8b7d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:05.442434 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a622315-709d-411d-b47a-92e56b8b7d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:05.442712 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a622315-709d-411d-b47a-92e56b8b7d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:05.442982 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a622315-709d-411d-b47a-92e56b8b7d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:05.443653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a622315-709d-411d-b47a-92e56b8b7d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:05.445225 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a622315-709d-411d-b47a-92e56b8b7d9a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:05.457879 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1349/2713] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:05.461994 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c3ced-2c03-4800-9b40-38cd5e290e2c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:05.473296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c3ced-2c03-4800-9b40-38cd5e290e2c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:05.478195 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32e997-a3d5-4cbf-a250-0c9bec3f5caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:05.478883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32e997-a3d5-4cbf-a250-0c9bec3f5caf admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:05.479165 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32e997-a3d5-4cbf-a250-0c9bec3f5caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:05.479434 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32e997-a3d5-4cbf-a250-0c9bec3f5caf admin admin] PATH_INFO: `/v3/projects/7b2ad14f01b34090bbdd0eb190baf0e1/users/47151632738d4cedbf25b9c44794fefc/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:05.494781 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32e997-a3d5-4cbf-a250-0c9bec3f5caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2ad14f01b34090bbdd0eb190baf0e1, user_id=47151632738d4cedbf25b9c44794fefc, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:05.497462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32e997-a3d5-4cbf-a250-0c9bec3f5caf admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:05.564095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1365/2714] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:05 2022] PUT /identity/v3/projects/7b2ad14f01b34090bbdd0eb190baf0e1/users/47151632738d4cedbf25b9c44794fefc/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:05.576050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8bd3c-5b2d-4f5c-ade6-f00177580464 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:05.576435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8bd3c-5b2d-4f5c-ade6-f00177580464 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:05.576730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8bd3c-5b2d-4f5c-ade6-f00177580464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:05.608566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-77f8bd3c-5b2d-4f5c-ade6-f00177580464 None None] MFA Rules not processed for user `47151632738d4cedbf25b9c44794fefc`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:05.609786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-77f8bd3c-5b2d-4f5c-ade6-f00177580464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:05.682823 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1350/2715] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:05.688689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32e997-a3d5-4cbf-a250-0c9bec3f5caf admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:05.756920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32e997-a3d5-4cbf-a250-0c9bec3f5caf admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:05.762257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016beb2c-2fef-46ca-b076-3f22c6949e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:05.763797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016beb2c-2fef-46ca-b076-3f22c6949e95 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:05.764079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016beb2c-2fef-46ca-b076-3f22c6949e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:05.764478 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016beb2c-2fef-46ca-b076-3f22c6949e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:05.765319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016beb2c-2fef-46ca-b076-3f22c6949e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:05.767841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016beb2c-2fef-46ca-b076-3f22c6949e95 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:05.987052 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1366/2716] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:05 2022] POST /identity/v3/projects => generated 379 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:05.988918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8bd3c-5b2d-4f5c-ade6-f00177580464 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:06.001572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8bd3c-5b2d-4f5c-ade6-f00177580464 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:06.030500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:06.062120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82282fc-c1b6-4127-ba47-68543a124648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:06.062773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82282fc-c1b6-4127-ba47-68543a124648 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:06.063054 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82282fc-c1b6-4127-ba47-68543a124648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:06.063321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82282fc-c1b6-4127-ba47-68543a124648 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:06.063955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82282fc-c1b6-4127-ba47-68543a124648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:06.065892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82282fc-c1b6-4127-ba47-68543a124648 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:06.173603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1351/2717] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:05 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:06.177546 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016beb2c-2fef-46ca-b076-3f22c6949e95 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:06.188778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016beb2c-2fef-46ca-b076-3f22c6949e95 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:06.193427 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e343990-597a-4df4-8695-d4fc3c8b52c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:06.194026 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343990-597a-4df4-8695-d4fc3c8b52c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:06.194344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343990-597a-4df4-8695-d4fc3c8b52c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:06.194618 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343990-597a-4df4-8695-d4fc3c8b52c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:06.195286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e343990-597a-4df4-8695-d4fc3c8b52c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:06.196869 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e343990-597a-4df4-8695-d4fc3c8b52c4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:06.207865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1367/2718] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:06.218339 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82282fc-c1b6-4127-ba47-68543a124648 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:06.229089 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82282fc-c1b6-4127-ba47-68543a124648 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:06.234570 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1d3f5-16e3-43e1-8247-9edec03c0644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:06.235402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1d3f5-16e3-43e1-8247-9edec03c0644 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:06.235758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1d3f5-16e3-43e1-8247-9edec03c0644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:06.236471 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1d3f5-16e3-43e1-8247-9edec03c0644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:06.237116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1d3f5-16e3-43e1-8247-9edec03c0644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:06.238843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1d3f5-16e3-43e1-8247-9edec03c0644 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:06.251091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1352/2719] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:06.255568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e343990-597a-4df4-8695-d4fc3c8b52c4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:06.266012 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e343990-597a-4df4-8695-d4fc3c8b52c4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:06.270932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae15b8-4d99-4bda-af0b-9157a3b5c861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:06.271582 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae15b8-4d99-4bda-af0b-9157a3b5c861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:06.271856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae15b8-4d99-4bda-af0b-9157a3b5c861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:06.272122 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae15b8-4d99-4bda-af0b-9157a3b5c861 admin admin] PATH_INFO: `/v3/projects/4896f59eefbb4cffa1e9deecbcaad63e/users/66478de3abcf45169bbaffeb8117101d/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:06.287766 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae15b8-4d99-4bda-af0b-9157a3b5c861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4896f59eefbb4cffa1e9deecbcaad63e, user_id=66478de3abcf45169bbaffeb8117101d, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:06.290406 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae15b8-4d99-4bda-af0b-9157a3b5c861 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:06.374834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1368/2720] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:06 2022] PUT /identity/v3/projects/4896f59eefbb4cffa1e9deecbcaad63e/users/66478de3abcf45169bbaffeb8117101d/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:06.385825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff8431-7c57-49ed-83e5-e207b31a5c82 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:06.387203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff8431-7c57-49ed-83e5-e207b31a5c82 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:06.387203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff8431-7c57-49ed-83e5-e207b31a5c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:06.417540 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-2aff8431-7c57-49ed-83e5-e207b31a5c82 None None] MFA Rules not processed for user `66478de3abcf45169bbaffeb8117101d`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:06.419454 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2aff8431-7c57-49ed-83e5-e207b31a5c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:06.488526 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1353/2721] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:06.493014 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae15b8-4d99-4bda-af0b-9157a3b5c861 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:06.534131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:06.557531 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae15b8-4d99-4bda-af0b-9157a3b5c861 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:06.562432 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7feca5-80b9-48a3-a5c7-a2cbb8d3e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:06.563041 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7feca5-80b9-48a3-a5c7-a2cbb8d3e2cb admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:06.563326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7feca5-80b9-48a3-a5c7-a2cbb8d3e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:06.563594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7feca5-80b9-48a3-a5c7-a2cbb8d3e2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:06.564239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7feca5-80b9-48a3-a5c7-a2cbb8d3e2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:06.566124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7feca5-80b9-48a3-a5c7-a2cbb8d3e2cb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:06.690685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1369/2722] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:06 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:06.695112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff8431-7c57-49ed-83e5-e207b31a5c82 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:06.707042 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff8431-7c57-49ed-83e5-e207b31a5c82 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:06.771244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fef39-4775-4797-8bdf-e165c41d4bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:06.772212 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fef39-4775-4797-8bdf-e165c41d4bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:06.772654 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fef39-4775-4797-8bdf-e165c41d4bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:06.772922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fef39-4775-4797-8bdf-e165c41d4bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:06.773564 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fef39-4775-4797-8bdf-e165c41d4bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:06.775730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fef39-4775-4797-8bdf-e165c41d4bb2 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:06.862393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1354/2723] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:06 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:06.862506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7feca5-80b9-48a3-a5c7-a2cbb8d3e2cb admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:06.868951 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7feca5-80b9-48a3-a5c7-a2cbb8d3e2cb admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:06.874176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592d995-efc2-4415-9298-73ba30c94b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:06.874885 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592d995-efc2-4415-9298-73ba30c94b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:06.875078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592d995-efc2-4415-9298-73ba30c94b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:06.875351 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592d995-efc2-4415-9298-73ba30c94b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:06.875987 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592d995-efc2-4415-9298-73ba30c94b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:06.877557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592d995-efc2-4415-9298-73ba30c94b65 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:06.889018 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1370/2724] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:06.894742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fef39-4775-4797-8bdf-e165c41d4bb2 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:06.905852 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fef39-4775-4797-8bdf-e165c41d4bb2 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:06.910840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11927441-9c59-4142-b532-a425fcecabb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:06.914285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11927441-9c59-4142-b532-a425fcecabb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:06.914285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11927441-9c59-4142-b532-a425fcecabb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:06.914285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11927441-9c59-4142-b532-a425fcecabb9 admin admin] PATH_INFO: `/v3/projects/4bd3800ddd254166977a4c3dfdd3c898/users/f154e73bd8e54cd8b35b99dd538eab45/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:06.928792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11927441-9c59-4142-b532-a425fcecabb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd3800ddd254166977a4c3dfdd3c898, user_id=f154e73bd8e54cd8b35b99dd538eab45, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:06.931579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11927441-9c59-4142-b532-a425fcecabb9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:06.991968 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1355/2725] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:06 2022] PUT /identity/v3/projects/4bd3800ddd254166977a4c3dfdd3c898/users/f154e73bd8e54cd8b35b99dd538eab45/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:06.995997 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592d995-efc2-4415-9298-73ba30c94b65 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:07.006271 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592d995-efc2-4415-9298-73ba30c94b65 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:07.071819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90545f-afd5-411a-b4ce-3737586b2669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:07.072494 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90545f-afd5-411a-b4ce-3737586b2669 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:07.072772 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90545f-afd5-411a-b4ce-3737586b2669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:07.073044 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90545f-afd5-411a-b4ce-3737586b2669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:07.073682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90545f-afd5-411a-b4ce-3737586b2669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:07.075993 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90545f-afd5-411a-b4ce-3737586b2669 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:07.086901 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1371/2726] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:07.091077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11927441-9c59-4142-b532-a425fcecabb9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:07.096956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:07.102637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11927441-9c59-4142-b532-a425fcecabb9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:07.107710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a94b20-b5f9-4291-bdca-d45b9a70eb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:07.108389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a94b20-b5f9-4291-bdca-d45b9a70eb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:07.108662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a94b20-b5f9-4291-bdca-d45b9a70eb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:07.108939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a94b20-b5f9-4291-bdca-d45b9a70eb38 admin admin] PATH_INFO: `/v3/projects/4bd3800ddd254166977a4c3dfdd3c898/users/f154e73bd8e54cd8b35b99dd538eab45/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:07.111984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a94b20-b5f9-4291-bdca-d45b9a70eb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd3800ddd254166977a4c3dfdd3c898, user_id=f154e73bd8e54cd8b35b99dd538eab45, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:07.113908 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a94b20-b5f9-4291-bdca-d45b9a70eb38 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:07.126822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1356/2727] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:07 2022] PUT /identity/v3/projects/4bd3800ddd254166977a4c3dfdd3c898/users/f154e73bd8e54cd8b35b99dd538eab45/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:07.139138 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5d4bf-138f-4e6e-9ccd-eb18fffc4950 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:07.156364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5d4bf-138f-4e6e-9ccd-eb18fffc4950 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:07.156364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5d4bf-138f-4e6e-9ccd-eb18fffc4950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:07.172325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-51f5d4bf-138f-4e6e-9ccd-eb18fffc4950 None None] MFA Rules not processed for user `f154e73bd8e54cd8b35b99dd538eab45`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:07.173678 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-51f5d4bf-138f-4e6e-9ccd-eb18fffc4950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:07.250517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1372/2728] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:07.262134 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a94b20-b5f9-4291-bdca-d45b9a70eb38 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:07.264639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f6a94b20-b5f9-4291-bdca-d45b9a70eb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:07.327859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a94b20-b5f9-4291-bdca-d45b9a70eb38 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:07.332299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60115c2a-db64-41f7-96ce-3925a9a166a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:07.332922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60115c2a-db64-41f7-96ce-3925a9a166a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:07.333750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60115c2a-db64-41f7-96ce-3925a9a166a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:07.333750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60115c2a-db64-41f7-96ce-3925a9a166a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:07.345558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60115c2a-db64-41f7-96ce-3925a9a166a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:07.349859 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60115c2a-db64-41f7-96ce-3925a9a166a2 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:07.363683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1357/2729] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:07.522751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5d4bf-138f-4e6e-9ccd-eb18fffc4950 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:07.527113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-51f5d4bf-138f-4e6e-9ccd-eb18fffc4950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:07.545682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5d4bf-138f-4e6e-9ccd-eb18fffc4950 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:07.549580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445639e8-cd0f-46db-b1d2-8812f6dcbc63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:07.550209 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445639e8-cd0f-46db-b1d2-8812f6dcbc63 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:07.550524 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445639e8-cd0f-46db-b1d2-8812f6dcbc63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:07.550798 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445639e8-cd0f-46db-b1d2-8812f6dcbc63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:07.587754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:07.624689 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445639e8-cd0f-46db-b1d2-8812f6dcbc63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:07.626891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445639e8-cd0f-46db-b1d2-8812f6dcbc63 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:07.637971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1373/2730] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:12.227164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60115c2a-db64-41f7-96ce-3925a9a166a2 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:12.294079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60115c2a-db64-41f7-96ce-3925a9a166a2 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:12.299815 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:12.311548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:12.311548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:12.311548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] PATH_INFO: `/v3/users/47151632738d4cedbf25b9c44794fefc` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:12.311548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47151632738d4cedbf25b9c44794fefc)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:12.311548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:12.601194 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47151632738d4cedbf25b9c44794fefc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:12.608985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47151632738d4cedbf25b9c44794fefc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:12.609662 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47151632738d4cedbf25b9c44794fefc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:12.705603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47151632738d4cedbf25b9c44794fefc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:12.719049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47151632738d4cedbf25b9c44794fefc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:12.725078 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1358/2731] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:12 2022] DELETE /identity/v3/users/47151632738d4cedbf25b9c44794fefc => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:12.729914 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf60dec-7845-4b6d-af9c-f3dce5a9d27c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:12.730487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf60dec-7845-4b6d-af9c-f3dce5a9d27c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:12.730487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf60dec-7845-4b6d-af9c-f3dce5a9d27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:12.751492 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-bcf60dec-7845-4b6d-af9c-f3dce5a9d27c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:12.752725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bcf60dec-7845-4b6d-af9c-f3dce5a9d27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:12.817629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1374/2732] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:40:12.828318 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:12.829773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:12.844539 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:12.896725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f7ce2-5b2c-4491-b3d8-9d80268c7f28 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:12.900683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdf1ac-da38-4231-92b0-0c5b0046dcef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:12.901530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdf1ac-da38-4231-92b0-0c5b0046dcef service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:12.901934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdf1ac-da38-4231-92b0-0c5b0046dcef service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:12.902211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdf1ac-da38-4231-92b0-0c5b0046dcef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:12.913734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdf1ac-da38-4231-92b0-0c5b0046dcef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:12.915228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdf1ac-da38-4231-92b0-0c5b0046dcef service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:12.925581 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1359/2733] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:40:12.985087 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf60dec-7845-4b6d-af9c-f3dce5a9d27c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:12.986822 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bcf60dec-7845-4b6d-af9c-f3dce5a9d27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:13.000162 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf60dec-7845-4b6d-af9c-f3dce5a9d27c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:13.004020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0a5b5-fa2d-431a-91ec-e8467f3729db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:13.004635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0a5b5-fa2d-431a-91ec-e8467f3729db service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:13.004905 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0a5b5-fa2d-431a-91ec-e8467f3729db service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:13.005173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0a5b5-fa2d-431a-91ec-e8467f3729db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:13.006981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-32a0a5b5-fa2d-431a-91ec-e8467f3729db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:13.020416 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0a5b5-fa2d-431a-91ec-e8467f3729db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:13.021870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0a5b5-fa2d-431a-91ec-e8467f3729db service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:13.031989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1375/2734] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:13.409529 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdf1ac-da38-4231-92b0-0c5b0046dcef service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:13.411428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b6bdf1ac-da38-4231-92b0-0c5b0046dcef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:13.425888 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdf1ac-da38-4231-92b0-0c5b0046dcef service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:13.431560 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:13.432211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:13.432491 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:13.432766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] PATH_INFO: `/v3/projects/7b2ad14f01b34090bbdd0eb190baf0e1` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:13.433922 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2ad14f01b34090bbdd0eb190baf0e1)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:13.436546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:13.580237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2ad14f01b34090bbdd0eb190baf0e1', 'request_id': 'req-35620bab-edc2-4f3a-9bba-8e44476a6644'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:13.588139 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2ad14f01b34090bbdd0eb190baf0e1', 'request_id': 'req-35620bab-edc2-4f3a-9bba-8e44476a6644'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:13.595943 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2ad14f01b34090bbdd0eb190baf0e1', 'request_id': 'req-35620bab-edc2-4f3a-9bba-8e44476a6644'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:13.769507 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] The token cache is being invalidate because project 7b2ad14f01b34090bbdd0eb190baf0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:13.769804 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:13.770632 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:13.772191 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1360/2735] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:13 2022] DELETE /identity/v3/projects/7b2ad14f01b34090bbdd0eb190baf0e1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:13.777588 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0a5b5-fa2d-431a-91ec-e8467f3729db service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:13.788257 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0a5b5-fa2d-431a-91ec-e8467f3729db service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:13.851069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:13.851711 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:13.851990 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:13.852258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] PATH_INFO: `/v3/users/66478de3abcf45169bbaffeb8117101d` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:13.853396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=66478de3abcf45169bbaffeb8117101d)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:13.855363 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:14.176281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66478de3abcf45169bbaffeb8117101d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:14.176281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:14.176281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66478de3abcf45169bbaffeb8117101d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:14.176281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66478de3abcf45169bbaffeb8117101d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:14.176281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66478de3abcf45169bbaffeb8117101d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:14.184831 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66478de3abcf45169bbaffeb8117101d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:14.309242 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1376/2736] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:13 2022] DELETE /identity/v3/users/66478de3abcf45169bbaffeb8117101d => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:14.809572 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:14.811285 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:14.838939 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620bab-edc2-4f3a-9bba-8e44476a6644 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:14.909135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:14.909824 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:14.910121 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:14.910481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] PATH_INFO: `/v3/projects/4896f59eefbb4cffa1e9deecbcaad63e` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:14.911692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4896f59eefbb4cffa1e9deecbcaad63e)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:14.913657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:15.063353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:15.075280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4896f59eefbb4cffa1e9deecbcaad63e', 'request_id': 'req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:15.083941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4896f59eefbb4cffa1e9deecbcaad63e', 'request_id': 'req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:15.092007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4896f59eefbb4cffa1e9deecbcaad63e', 'request_id': 'req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:15.181665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] The token cache is being invalidate because project 4896f59eefbb4cffa1e9deecbcaad63e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:15.182357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:15.183402 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:15.187488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1361/2737] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:14 2022] DELETE /identity/v3/projects/4896f59eefbb4cffa1e9deecbcaad63e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:15.192004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:15.193578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:15.209033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7bcbf-4edd-4e0d-8d03-30d9f13b46ce admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:15.289969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0f03b-237a-41aa-be40-7b9c509b8e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:15.289969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0f03b-237a-41aa-be40-7b9c509b8e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:15.289969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0f03b-237a-41aa-be40-7b9c509b8e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:15.289969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0f03b-237a-41aa-be40-7b9c509b8e1b admin admin] PATH_INFO: `/v3/users/f154e73bd8e54cd8b35b99dd538eab45` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:15.291033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0f03b-237a-41aa-be40-7b9c509b8e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f154e73bd8e54cd8b35b99dd538eab45)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:15.291033 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0f03b-237a-41aa-be40-7b9c509b8e1b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:15.545969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-21b0f03b-237a-41aa-be40-7b9c509b8e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f154e73bd8e54cd8b35b99dd538eab45'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:15.559431 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-21b0f03b-237a-41aa-be40-7b9c509b8e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f154e73bd8e54cd8b35b99dd538eab45'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:15.560270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-21b0f03b-237a-41aa-be40-7b9c509b8e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f154e73bd8e54cd8b35b99dd538eab45'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:15.560899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-21b0f03b-237a-41aa-be40-7b9c509b8e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f154e73bd8e54cd8b35b99dd538eab45'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:15.568957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-21b0f03b-237a-41aa-be40-7b9c509b8e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f154e73bd8e54cd8b35b99dd538eab45'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:15.704335 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1377/2738] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:15 2022] DELETE /identity/v3/users/f154e73bd8e54cd8b35b99dd538eab45 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:16.318846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:16.320463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:16.348231 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc9cdc-6d5b-4576-95b5-5719ed1609a1 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:16.426303 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f20c5c-2643-4df6-9333-3b72f43bd38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:16.427095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f20c5c-2643-4df6-9333-3b72f43bd38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:16.427388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f20c5c-2643-4df6-9333-3b72f43bd38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:16.427837 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f20c5c-2643-4df6-9333-3b72f43bd38a admin admin] PATH_INFO: `/v3/projects/4bd3800ddd254166977a4c3dfdd3c898` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:16.429228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f20c5c-2643-4df6-9333-3b72f43bd38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd3800ddd254166977a4c3dfdd3c898)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:16.431256 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f20c5c-2643-4df6-9333-3b72f43bd38a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:16.556571 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-08f20c5c-2643-4df6-9333-3b72f43bd38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd3800ddd254166977a4c3dfdd3c898', 'request_id': 'req-08f20c5c-2643-4df6-9333-3b72f43bd38a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:16.565344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-08f20c5c-2643-4df6-9333-3b72f43bd38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd3800ddd254166977a4c3dfdd3c898', 'request_id': 'req-08f20c5c-2643-4df6-9333-3b72f43bd38a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:16.574337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-08f20c5c-2643-4df6-9333-3b72f43bd38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd3800ddd254166977a4c3dfdd3c898', 'request_id': 'req-08f20c5c-2643-4df6-9333-3b72f43bd38a'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:16.683209 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-08f20c5c-2643-4df6-9333-3b72f43bd38a admin admin] The token cache is being invalidate because project 4bd3800ddd254166977a4c3dfdd3c898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:16.683818 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-08f20c5c-2643-4df6-9333-3b72f43bd38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:16.685066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-08f20c5c-2643-4df6-9333-3b72f43bd38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:16.689204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1362/2739] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:16 2022] DELETE /identity/v3/projects/4bd3800ddd254166977a4c3dfdd3c898 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:16.698277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970acba-87c5-4502-aca7-cd267eece3b2 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:16.699017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970acba-87c5-4502-aca7-cd267eece3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:16.699017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970acba-87c5-4502-aca7-cd267eece3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:16.721549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a970acba-87c5-4502-aca7-cd267eece3b2 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:16.723258 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a970acba-87c5-4502-aca7-cd267eece3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:16.783742 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:16.795303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1378/2740] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:16.804541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafde4c-35a0-4a1e-897d-62063acfb2ca None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:16.804833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafde4c-35a0-4a1e-897d-62063acfb2ca None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:16.805113 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafde4c-35a0-4a1e-897d-62063acfb2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:16.831534 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-cbafde4c-35a0-4a1e-897d-62063acfb2ca None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:16.833800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-cbafde4c-35a0-4a1e-897d-62063acfb2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:16.848734 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1363/2741] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:16.853882 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970acba-87c5-4502-aca7-cd267eece3b2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:16.875759 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970acba-87c5-4502-aca7-cd267eece3b2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:16.884163 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f07910-15b4-40f2-92c1-37e71eac1c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:16.885274 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f07910-15b4-40f2-92c1-37e71eac1c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:16.886210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f07910-15b4-40f2-92c1-37e71eac1c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:16.886824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f07910-15b4-40f2-92c1-37e71eac1c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:16.888208 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f07910-15b4-40f2-92c1-37e71eac1c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:40:16.888815 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f07910-15b4-40f2-92c1-37e71eac1c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:16.893818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f07910-15b4-40f2-92c1-37e71eac1c4a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:16.930268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1379/2742] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:40:16.932840 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafde4c-35a0-4a1e-897d-62063acfb2ca None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:16.944020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafde4c-35a0-4a1e-897d-62063acfb2ca None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:16.949164 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d50488-d502-4a30-b640-7f66f0a038d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:16.949949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d50488-d502-4a30-b640-7f66f0a038d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:16.950336 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d50488-d502-4a30-b640-7f66f0a038d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:16.950698 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d50488-d502-4a30-b640-7f66f0a038d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:16.951489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d50488-d502-4a30-b640-7f66f0a038d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:16.953587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d50488-d502-4a30-b640-7f66f0a038d6 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:17.102682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1364/2743] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:16 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:17.107458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f07910-15b4-40f2-92c1-37e71eac1c4a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:17.119838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f07910-15b4-40f2-92c1-37e71eac1c4a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:17.179539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4163378-d3df-4072-83df-2b39c21dea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:17.180058 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4163378-d3df-4072-83df-2b39c21dea86 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:17.180441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4163378-d3df-4072-83df-2b39c21dea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:17.180610 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4163378-d3df-4072-83df-2b39c21dea86 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:17.181250 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4163378-d3df-4072-83df-2b39c21dea86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:17.183217 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4163378-d3df-4072-83df-2b39c21dea86 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:17.203519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d50488-d502-4a30-b640-7f66f0a038d6 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:17.205319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-85d50488-d502-4a30-b640-7f66f0a038d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:17.220165 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d50488-d502-4a30-b640-7f66f0a038d6 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:17.225399 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:17.226048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:17.226369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:17.226646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] PATH_INFO: `/v3/users/67a947140e4c4075acd70bbb57022baa` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:17.227862 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67a947140e4c4075acd70bbb57022baa)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:17.229876 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:17.255272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:17.360564 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1380/2744] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:17 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:17.364847 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4163378-d3df-4072-83df-2b39c21dea86 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:17.375171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4163378-d3df-4072-83df-2b39c21dea86 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:17.379747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ed2b8-a1c0-4c68-ac32-dde48e3b4c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:17.380342 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ed2b8-a1c0-4c68-ac32-dde48e3b4c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:17.380629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ed2b8-a1c0-4c68-ac32-dde48e3b4c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:17.380896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ed2b8-a1c0-4c68-ac32-dde48e3b4c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:17.381532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ed2b8-a1c0-4c68-ac32-dde48e3b4c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:17.383145 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ed2b8-a1c0-4c68-ac32-dde48e3b4c2f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:17.395113 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1381/2745] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:40:17.399176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ed2b8-a1c0-4c68-ac32-dde48e3b4c2f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:17.409456 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ed2b8-a1c0-4c68-ac32-dde48e3b4c2f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:17.414248 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100d608-6d57-4078-b478-c6de4f6163cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:17.414838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100d608-6d57-4078-b478-c6de4f6163cf admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:17.415121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100d608-6d57-4078-b478-c6de4f6163cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:17.415391 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100d608-6d57-4078-b478-c6de4f6163cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:17.416017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100d608-6d57-4078-b478-c6de4f6163cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:17.417594 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100d608-6d57-4078-b478-c6de4f6163cf admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:17.429129 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1382/2746] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:17.433508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100d608-6d57-4078-b478-c6de4f6163cf admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:17.440555 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67a947140e4c4075acd70bbb57022baa'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.443983 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100d608-6d57-4078-b478-c6de4f6163cf admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:17.448839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5931c82-1fe0-497e-9333-192827389271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:17.449203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67a947140e4c4075acd70bbb57022baa'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.449399 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5931c82-1fe0-497e-9333-192827389271 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:17.449687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5931c82-1fe0-497e-9333-192827389271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:17.449941 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5931c82-1fe0-497e-9333-192827389271 admin admin] PATH_INFO: `/v3/projects/d0f86b68c1da44889b591da56b9e8fbb/users/e922c5a298434d64a8fe61c446a5eb5a/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:17.450264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67a947140e4c4075acd70bbb57022baa'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.466624 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5931c82-1fe0-497e-9333-192827389271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f86b68c1da44889b591da56b9e8fbb, user_id=e922c5a298434d64a8fe61c446a5eb5a, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:17.470126 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5931c82-1fe0-497e-9333-192827389271 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:17.586604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67a947140e4c4075acd70bbb57022baa'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.593164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1383/2747] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:17 2022] PUT /identity/v3/projects/d0f86b68c1da44889b591da56b9e8fbb/users/e922c5a298434d64a8fe61c446a5eb5a/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:17.601454 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67a947140e4c4075acd70bbb57022baa'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.605583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15725026-b5bf-481c-8dbd-acbcd256be5b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:17.605838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15725026-b5bf-481c-8dbd-acbcd256be5b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:17.606110 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15725026-b5bf-481c-8dbd-acbcd256be5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:17.607557 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1365/2748] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:17 2022] DELETE /identity/v3/users/67a947140e4c4075acd70bbb57022baa => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:17.637015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-15725026-b5bf-481c-8dbd-acbcd256be5b None None] MFA Rules not processed for user `e922c5a298434d64a8fe61c446a5eb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:17.638350 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-15725026-b5bf-481c-8dbd-acbcd256be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:17.708509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1384/2749] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:40:17.712897 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:17.714476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:17.790537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d75592-0fce-464b-bf7c-7f206f557f48 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:17.795432 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cbd45-d91b-4171-8a2f-78f1e8ed0e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:17.796435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cbd45-d91b-4171-8a2f-78f1e8ed0e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:17.796725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cbd45-d91b-4171-8a2f-78f1e8ed0e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:17.796999 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cbd45-d91b-4171-8a2f-78f1e8ed0e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:17.797653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cbd45-d91b-4171-8a2f-78f1e8ed0e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:17.799624 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cbd45-d91b-4171-8a2f-78f1e8ed0e15 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:17.894365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15725026-b5bf-481c-8dbd-acbcd256be5b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:17.896015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-15725026-b5bf-481c-8dbd-acbcd256be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:17.911435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15725026-b5bf-481c-8dbd-acbcd256be5b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:17.912051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1366/2750] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:17 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:17.916173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cbd45-d91b-4171-8a2f-78f1e8ed0e15 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:17.931046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:17.978586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce2b38-bca1-4c46-b008-5613b1688068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:17.979142 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce2b38-bca1-4c46-b008-5613b1688068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:17.979418 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce2b38-bca1-4c46-b008-5613b1688068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:17.979692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce2b38-bca1-4c46-b008-5613b1688068 admin admin] PATH_INFO: `/v3/projects/26fa14650b694f409a61dccc8fb2f667` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:17.980909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce2b38-bca1-4c46-b008-5613b1688068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26fa14650b694f409a61dccc8fb2f667)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:17.983421 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce2b38-bca1-4c46-b008-5613b1688068 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:17.989483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cbd45-d91b-4171-8a2f-78f1e8ed0e15 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:17.994960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc1728-aedf-4a50-90f7-6f72a3e52b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:17.995727 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc1728-aedf-4a50-90f7-6f72a3e52b5e admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:17.995850 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc1728-aedf-4a50-90f7-6f72a3e52b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:17.996116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc1728-aedf-4a50-90f7-6f72a3e52b5e admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:17.998074 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc1728-aedf-4a50-90f7-6f72a3e52b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:17.999457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc1728-aedf-4a50-90f7-6f72a3e52b5e admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.162637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-85ce2b38-bca1-4c46-b008-5613b1688068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26fa14650b694f409a61dccc8fb2f667', 'request_id': 'req-85ce2b38-bca1-4c46-b008-5613b1688068'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:18.172104 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-85ce2b38-bca1-4c46-b008-5613b1688068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26fa14650b694f409a61dccc8fb2f667', 'request_id': 'req-85ce2b38-bca1-4c46-b008-5613b1688068'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:18.187977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1367/2751] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:17 2022] POST /identity/v3/users => generated 299 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:18.191942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc1728-aedf-4a50-90f7-6f72a3e52b5e admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.202872 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc1728-aedf-4a50-90f7-6f72a3e52b5e admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.215178 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:18.257438 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-85ce2b38-bca1-4c46-b008-5613b1688068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26fa14650b694f409a61dccc8fb2f667', 'request_id': 'req-85ce2b38-bca1-4c46-b008-5613b1688068'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:18.261505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd41fc2-66ec-4f02-82f1-8b25a7d3c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.262125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd41fc2-66ec-4f02-82f1-8b25a7d3c09c admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.262439 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd41fc2-66ec-4f02-82f1-8b25a7d3c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.262719 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd41fc2-66ec-4f02-82f1-8b25a7d3c09c admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.263371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd41fc2-66ec-4f02-82f1-8b25a7d3c09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.265009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd41fc2-66ec-4f02-82f1-8b25a7d3c09c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.269506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-85ce2b38-bca1-4c46-b008-5613b1688068 admin admin] The token cache is being invalidate because project 26fa14650b694f409a61dccc8fb2f667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:18.269799 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-85ce2b38-bca1-4c46-b008-5613b1688068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:18.270488 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-85ce2b38-bca1-4c46-b008-5613b1688068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:18.272490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1385/2752] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:17 2022] DELETE /identity/v3/projects/26fa14650b694f409a61dccc8fb2f667 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:18.276033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1368/2753] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:40:18.277449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b01f73-b57d-4d68-b44f-a8a7f62dd4fb None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.277734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b01f73-b57d-4d68-b44f-a8a7f62dd4fb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.278007 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b01f73-b57d-4d68-b44f-a8a7f62dd4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.279496 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd41fc2-66ec-4f02-82f1-8b25a7d3c09c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.281915 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-acd41fc2-66ec-4f02-82f1-8b25a7d3c09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:18.296994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd41fc2-66ec-4f02-82f1-8b25a7d3c09c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.299633 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-26b01f73-b57d-4d68-b44f-a8a7f62dd4fb None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:18.301828 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-26b01f73-b57d-4d68-b44f-a8a7f62dd4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:18.301942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c8b11-649f-49d0-b912-1464779eed2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.302483 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c8b11-649f-49d0-b912-1464779eed2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.302765 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c8b11-649f-49d0-b912-1464779eed2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.303040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c8b11-649f-49d0-b912-1464779eed2e admin admin] PATH_INFO: `/v3/projects/d54d4c9e431e4d8b92f9090f0c526feb/users/50820e68a1864d69b6b9e7866919b6e2/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.309460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1386/2754] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:40:18.318177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc419dcd-b503-4914-8cef-48699c85bdef None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.318506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc419dcd-b503-4914-8cef-48699c85bdef None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.318804 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc419dcd-b503-4914-8cef-48699c85bdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.321843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c8b11-649f-49d0-b912-1464779eed2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54d4c9e431e4d8b92f9090f0c526feb, user_id=50820e68a1864d69b6b9e7866919b6e2, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.325674 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c8b11-649f-49d0-b912-1464779eed2e admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.338835 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-bc419dcd-b503-4914-8cef-48699c85bdef None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:18.340057 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bc419dcd-b503-4914-8cef-48699c85bdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:18.349626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1387/2755] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:40:18.354048 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc419dcd-b503-4914-8cef-48699c85bdef None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.364466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc419dcd-b503-4914-8cef-48699c85bdef None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.374697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a58e0-a575-4ae9-8655-3784225c284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.374697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a58e0-a575-4ae9-8655-3784225c284a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.374697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a58e0-a575-4ae9-8655-3784225c284a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.374697 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a58e0-a575-4ae9-8655-3784225c284a admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.375095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a58e0-a575-4ae9-8655-3784225c284a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:40:18.375095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a58e0-a575-4ae9-8655-3784225c284a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.375095 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a58e0-a575-4ae9-8655-3784225c284a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.385971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1388/2756] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:40:18.390693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a58e0-a575-4ae9-8655-3784225c284a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.400981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a58e0-a575-4ae9-8655-3784225c284a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.406541 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacc8f8-8c2c-4bd0-b370-9d7f8f5d84a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.407129 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacc8f8-8c2c-4bd0-b370-9d7f8f5d84a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.407404 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacc8f8-8c2c-4bd0-b370-9d7f8f5d84a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.407670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacc8f8-8c2c-4bd0-b370-9d7f8f5d84a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.408294 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacc8f8-8c2c-4bd0-b370-9d7f8f5d84a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.410457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacc8f8-8c2c-4bd0-b370-9d7f8f5d84a6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.446603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1369/2757] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:18 2022] PUT /identity/v3/projects/d54d4c9e431e4d8b92f9090f0c526feb/users/50820e68a1864d69b6b9e7866919b6e2/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:18.451030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c8b11-649f-49d0-b912-1464779eed2e admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.517882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c8b11-649f-49d0-b912-1464779eed2e admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.522718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39b160-508c-4dee-8157-b91eda30cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.523328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39b160-508c-4dee-8157-b91eda30cb54 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.523608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39b160-508c-4dee-8157-b91eda30cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.523881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39b160-508c-4dee-8157-b91eda30cb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.524531 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39b160-508c-4dee-8157-b91eda30cb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.526123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39b160-508c-4dee-8157-b91eda30cb54 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.536524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1370/2758] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:18.540661 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39b160-508c-4dee-8157-b91eda30cb54 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.550806 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1389/2759] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:18 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:18.551457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39b160-508c-4dee-8157-b91eda30cb54 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.551802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacc8f8-8c2c-4bd0-b370-9d7f8f5d84a6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.613744 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea89288-e5a8-4ce1-af97-d0f97ffcb70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.614445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea89288-e5a8-4ce1-af97-d0f97ffcb70a admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.614851 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea89288-e5a8-4ce1-af97-d0f97ffcb70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.615138 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea89288-e5a8-4ce1-af97-d0f97ffcb70a admin admin] PATH_INFO: `/v3/projects/d54d4c9e431e4d8b92f9090f0c526feb/users/50820e68a1864d69b6b9e7866919b6e2/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.615329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:18.617100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea89288-e5a8-4ce1-af97-d0f97ffcb70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54d4c9e431e4d8b92f9090f0c526feb, user_id=50820e68a1864d69b6b9e7866919b6e2, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.619309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacc8f8-8c2c-4bd0-b370-9d7f8f5d84a6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.619786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea89288-e5a8-4ce1-af97-d0f97ffcb70a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.625003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18726b-7720-4e50-a54d-6c3008646f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.625731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18726b-7720-4e50-a54d-6c3008646f9e admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.627810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18726b-7720-4e50-a54d-6c3008646f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.627810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18726b-7720-4e50-a54d-6c3008646f9e admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.627810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18726b-7720-4e50-a54d-6c3008646f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.628909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18726b-7720-4e50-a54d-6c3008646f9e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.631353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1371/2760] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:18 2022] PUT /identity/v3/projects/d54d4c9e431e4d8b92f9090f0c526feb/users/50820e68a1864d69b6b9e7866919b6e2/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:18.642363 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb6d63-6e2b-4dff-9936-ae26848e6ec4 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.642646 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb6d63-6e2b-4dff-9936-ae26848e6ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.642942 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb6d63-6e2b-4dff-9936-ae26848e6ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.671839 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-7ceb6d63-6e2b-4dff-9936-ae26848e6ec4 None None] MFA Rules not processed for user `50820e68a1864d69b6b9e7866919b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:18.673114 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7ceb6d63-6e2b-4dff-9936-ae26848e6ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:18.678473 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:18.718809 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1390/2761] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:18 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:18.719864 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18726b-7720-4e50-a54d-6c3008646f9e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.730865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18726b-7720-4e50-a54d-6c3008646f9e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.746683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1372/2762] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:40:18.764959 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb6d63-6e2b-4dff-9936-ae26848e6ec4 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.766468 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-7ceb6d63-6e2b-4dff-9936-ae26848e6ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:18.794277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8175c-9652-44b4-aaa5-95354ea2ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.794277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8175c-9652-44b4-aaa5-95354ea2ac03 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.794277 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8175c-9652-44b4-aaa5-95354ea2ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.794787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8175c-9652-44b4-aaa5-95354ea2ac03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.795019 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8175c-9652-44b4-aaa5-95354ea2ac03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.797450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8175c-9652-44b4-aaa5-95354ea2ac03 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.807382 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1391/2763] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:40:18.811780 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8175c-9652-44b4-aaa5-95354ea2ac03 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.822655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8175c-9652-44b4-aaa5-95354ea2ac03 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.828210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc18eb0-6631-4489-ac2e-b8f620122e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.828802 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc18eb0-6631-4489-ac2e-b8f620122e51 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.829114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc18eb0-6631-4489-ac2e-b8f620122e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.829275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb6d63-6e2b-4dff-9936-ae26848e6ec4 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.829435 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc18eb0-6631-4489-ac2e-b8f620122e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.830073 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc18eb0-6631-4489-ac2e-b8f620122e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.831693 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc18eb0-6631-4489-ac2e-b8f620122e51 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.833142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdce721-c04f-4d3d-aec6-443a3192295b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.833756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdce721-c04f-4d3d-aec6-443a3192295b service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.834041 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdce721-c04f-4d3d-aec6-443a3192295b service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.834337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdce721-c04f-4d3d-aec6-443a3192295b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.836211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-dfdce721-c04f-4d3d-aec6-443a3192295b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:18.843638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1392/2764] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:40:18.847738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc18eb0-6631-4489-ac2e-b8f620122e51 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.857807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc18eb0-6631-4489-ac2e-b8f620122e51 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.863086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fdfce-88b4-4b85-a241-7ddd9b16327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.863749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fdfce-88b4-4b85-a241-7ddd9b16327b admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.864028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fdfce-88b4-4b85-a241-7ddd9b16327b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.864304 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fdfce-88b4-4b85-a241-7ddd9b16327b admin admin] PATH_INFO: `/v3/projects/8067e04cc7674308b83a38df8b19a149/users/54076085c70b41268575b6b1906fe8bb/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.879981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fdfce-88b4-4b85-a241-7ddd9b16327b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8067e04cc7674308b83a38df8b19a149, user_id=54076085c70b41268575b6b1906fe8bb, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.882789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fdfce-88b4-4b85-a241-7ddd9b16327b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.907264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdce721-c04f-4d3d-aec6-443a3192295b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.908722 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdce721-c04f-4d3d-aec6-443a3192295b service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.917882 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1373/2765] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:40:18.986211 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1393/2766] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:18 2022] PUT /identity/v3/projects/8067e04cc7674308b83a38df8b19a149/users/54076085c70b41268575b6b1906fe8bb/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:18.991294 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92e7f-513f-49f2-a68b-2e46d0be7857 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.991669 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92e7f-513f-49f2-a68b-2e46d0be7857 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.991955 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92e7f-513f-49f2-a68b-2e46d0be7857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.012224 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-92f92e7f-513f-49f2-a68b-2e46d0be7857 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:19.013431 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-92f92e7f-513f-49f2-a68b-2e46d0be7857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:19.067873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:19.078611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1374/2767] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:19.089171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fdfce-88b4-4b85-a241-7ddd9b16327b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:19.090988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-170fdfce-88b4-4b85-a241-7ddd9b16327b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:19.151574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fdfce-88b4-4b85-a241-7ddd9b16327b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:19.155702 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65d12-3f02-4504-b461-e85122778e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:19.156317 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65d12-3f02-4504-b461-e85122778e49 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.156593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65d12-3f02-4504-b461-e85122778e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.156861 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65d12-3f02-4504-b461-e85122778e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.166669 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e65d12-3f02-4504-b461-e85122778e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:19.168086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e65d12-3f02-4504-b461-e85122778e49 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:19.178509 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1394/2768] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:25.187349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f92e7f-513f-49f2-a68b-2e46d0be7857 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:25.189007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-92f92e7f-513f-49f2-a68b-2e46d0be7857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:25.271500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f92e7f-513f-49f2-a68b-2e46d0be7857 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:25.275122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b67d21-5218-4811-90e5-631eaa1f8d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:25.275730 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b67d21-5218-4811-90e5-631eaa1f8d93 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:25.276009 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b67d21-5218-4811-90e5-631eaa1f8d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:25.276280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b67d21-5218-4811-90e5-631eaa1f8d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:25.371045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b67d21-5218-4811-90e5-631eaa1f8d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:25.374369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b67d21-5218-4811-90e5-631eaa1f8d93 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:25.405433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1375/2769] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:25.545681 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97a961-25f6-4085-87eb-d227c9630759 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:25.546485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97a961-25f6-4085-87eb-d227c9630759 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:25.546485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97a961-25f6-4085-87eb-d227c9630759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:25.583286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ac97a961-25f6-4085-87eb-d227c9630759 None None] MFA Rules not processed for user `54076085c70b41268575b6b1906fe8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:25.584738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ac97a961-25f6-4085-87eb-d227c9630759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:25.629692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:25.658100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1395/2770] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:25.675795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b67d21-5218-4811-90e5-631eaa1f8d93 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:25.677275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-91b67d21-5218-4811-90e5-631eaa1f8d93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:25.763611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b67d21-5218-4811-90e5-631eaa1f8d93 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:25.770830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb5775-ee97-49a0-92f3-ddc942c82949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:25.771464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb5775-ee97-49a0-92f3-ddc942c82949 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:25.771743 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb5775-ee97-49a0-92f3-ddc942c82949 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:25.772015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb5775-ee97-49a0-92f3-ddc942c82949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:25.781657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb5775-ee97-49a0-92f3-ddc942c82949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:25.783472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb5775-ee97-49a0-92f3-ddc942c82949 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:25.793366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1376/2771] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:28.489190 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c215b-e262-4513-b23d-e64e3e49fbeb None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:28.491728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c215b-e262-4513-b23d-e64e3e49fbeb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:28.491728 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c215b-e262-4513-b23d-e64e3e49fbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:28.511957 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-331c215b-e262-4513-b23d-e64e3e49fbeb None None] MFA Rules not processed for user `54076085c70b41268575b6b1906fe8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:28.513210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-331c215b-e262-4513-b23d-e64e3e49fbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:28.523153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1396/2772] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:28.883692 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb5775-ee97-49a0-92f3-ddc942c82949 service nova] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:28.890935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb5775-ee97-49a0-92f3-ddc942c82949 service nova] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:28.895435 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d110a19-a0df-4c6c-9ae4-fa146e5dd8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:28.896204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d110a19-a0df-4c6c-9ae4-fa146e5dd8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:28.896495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d110a19-a0df-4c6c-9ae4-fa146e5dd8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:28.896768 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d110a19-a0df-4c6c-9ae4-fa146e5dd8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:28.904284 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3d110a19-a0df-4c6c-9ae4-fa146e5dd8a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:28.917448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d110a19-a0df-4c6c-9ae4-fa146e5dd8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:28.918945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d110a19-a0df-4c6c-9ae4-fa146e5dd8a1 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:28.929806 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1377/2773] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:31.675437 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c215b-e262-4513-b23d-e64e3e49fbeb None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:31.686133 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c215b-e262-4513-b23d-e64e3e49fbeb None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:31.690622 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:31.691241 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:31.691515 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:31.691778 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] PATH_INFO: `/v3/users/e922c5a298434d64a8fe61c446a5eb5a` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:31.693474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e922c5a298434d64a8fe61c446a5eb5a)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:31.694856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:31.903947 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e922c5a298434d64a8fe61c446a5eb5a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:31.915865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e922c5a298434d64a8fe61c446a5eb5a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:31.916579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e922c5a298434d64a8fe61c446a5eb5a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:31.917194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e922c5a298434d64a8fe61c446a5eb5a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:31.924260 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e922c5a298434d64a8fe61c446a5eb5a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:31.996878 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1397/2774] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:31 2022] DELETE /identity/v3/users/e922c5a298434d64a8fe61c446a5eb5a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:32.002315 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1962b-2a44-451b-aede-3884205bed57 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:32.002758 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1962b-2a44-451b-aede-3884205bed57 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:32.002855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1962b-2a44-451b-aede-3884205bed57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:32.024472 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-20e1962b-2a44-451b-aede-3884205bed57 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:32.025676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-20e1962b-2a44-451b-aede-3884205bed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:32.040535 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:32.099985 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1378/2775] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:32.110874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:32.112392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:32.180076 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add21285-8f1f-4940-b5a2-1fb6cef94443 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:32.183737 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4382c-7ad1-4acc-aca5-cc93b7aab6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:32.187107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4382c-7ad1-4acc-aca5-cc93b7aab6ac service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:32.187107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4382c-7ad1-4acc-aca5-cc93b7aab6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:32.187107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4382c-7ad1-4acc-aca5-cc93b7aab6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:32.194886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4382c-7ad1-4acc-aca5-cc93b7aab6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:32.196328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4382c-7ad1-4acc-aca5-cc93b7aab6ac service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:32.207729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1398/2776] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:32.798723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1962b-2a44-451b-aede-3884205bed57 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:32.800116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-20e1962b-2a44-451b-aede-3884205bed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:32.819092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1962b-2a44-451b-aede-3884205bed57 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:32.823601 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:32.824251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:32.824536 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:32.824813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] PATH_INFO: `/v3/projects/d0f86b68c1da44889b591da56b9e8fbb` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:32.826007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f86b68c1da44889b591da56b9e8fbb)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:32.828600 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:32.958492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f86b68c1da44889b591da56b9e8fbb', 'request_id': 'req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:32.964895 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f86b68c1da44889b591da56b9e8fbb', 'request_id': 'req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:32.971278 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f86b68c1da44889b591da56b9e8fbb', 'request_id': 'req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:33.080006 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] The token cache is being invalidate because project d0f86b68c1da44889b591da56b9e8fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:33.080709 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:33.080909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:33.082447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1379/2777] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:32 2022] DELETE /identity/v3/projects/d0f86b68c1da44889b591da56b9e8fbb => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:33.086574 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4382c-7ad1-4acc-aca5-cc93b7aab6ac service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:33.096367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4382c-7ad1-4acc-aca5-cc93b7aab6ac service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:33.143747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:33.157588 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:33.159970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:33.159970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:33.159970 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] PATH_INFO: `/v3/users/50820e68a1864d69b6b9e7866919b6e2` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:33.160364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50820e68a1864d69b6b9e7866919b6e2)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:33.162390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:33.380508 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50820e68a1864d69b6b9e7866919b6e2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:33.393660 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50820e68a1864d69b6b9e7866919b6e2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:33.394414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50820e68a1864d69b6b9e7866919b6e2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:33.395063 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50820e68a1864d69b6b9e7866919b6e2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:33.401754 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50820e68a1864d69b6b9e7866919b6e2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:33.474327 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1399/2778] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:33 2022] DELETE /identity/v3/users/50820e68a1864d69b6b9e7866919b6e2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:33.929066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:33.930935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:33.947213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06210fb0-f479-43c7-9e86-2ea60bfe9ddc admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:34.016833 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:34.017346 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:34.017647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:34.017907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea admin admin] PATH_INFO: `/v3/projects/d54d4c9e431e4d8b92f9090f0c526feb` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:34.019116 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54d4c9e431e4d8b92f9090f0c526feb)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:34.021258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:34.146653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:34.149786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54d4c9e431e4d8b92f9090f0c526feb', 'request_id': 'req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:34.156535 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54d4c9e431e4d8b92f9090f0c526feb', 'request_id': 'req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:34.162305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54d4c9e431e4d8b92f9090f0c526feb', 'request_id': 'req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:34.260394 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea admin admin] The token cache is being invalidate because project d54d4c9e431e4d8b92f9090f0c526feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:34.260958 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:34.262421 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-c7a95f63-2ef1-4b5b-9288-60fad1b9ceea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:34.264100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1380/2779] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:33 2022] DELETE /identity/v3/projects/d54d4c9e431e4d8b92f9090f0c526feb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:43.465913 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:44.710883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:28.418907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:28.420308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:28.478308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81722e23-8885-4ffd-8849-0025b37da473 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:28.525874 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db49f3-ca18-4f95-a2ff-da649f39349f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:28.526514 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db49f3-ca18-4f95-a2ff-da649f39349f service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:28.526793 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db49f3-ca18-4f95-a2ff-da649f39349f service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:28.527064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db49f3-ca18-4f95-a2ff-da649f39349f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:28.528829 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d6db49f3-ca18-4f95-a2ff-da649f39349f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:28.600932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db49f3-ca18-4f95-a2ff-da649f39349f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:28.602308 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db49f3-ca18-4f95-a2ff-da649f39349f service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:28.613929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1400/2780] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:41:34.273660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0defadd-d165-488b-9411-6a50aa01aacf None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:34.275502 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0defadd-d165-488b-9411-6a50aa01aacf None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:34.275502 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0defadd-d165-488b-9411-6a50aa01aacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:34.295556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-f0defadd-d165-488b-9411-6a50aa01aacf None None] MFA Rules not processed for user `54076085c70b41268575b6b1906fe8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:34.296802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f0defadd-d165-488b-9411-6a50aa01aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:34.358374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1381/2781] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:41:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:35.228091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db49f3-ca18-4f95-a2ff-da649f39349f service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:35.238299 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d6db49f3-ca18-4f95-a2ff-da649f39349f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:35.309337 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db49f3-ca18-4f95-a2ff-da649f39349f service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:35.313441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be14fc-36bc-4f09-817c-b64552775133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:35.314096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be14fc-36bc-4f09-817c-b64552775133 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:35.314410 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be14fc-36bc-4f09-817c-b64552775133 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:35.314700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be14fc-36bc-4f09-817c-b64552775133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:35.317228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a9be14fc-36bc-4f09-817c-b64552775133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:35.332345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be14fc-36bc-4f09-817c-b64552775133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:35.333837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be14fc-36bc-4f09-817c-b64552775133 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:35.340237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:35.346576 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1401/2782] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:41:39.022824 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0defadd-d165-488b-9411-6a50aa01aacf None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:39.033250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0defadd-d165-488b-9411-6a50aa01aacf None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:39.037566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef92705-8069-471d-910d-6a0d358d5c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:39.038188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef92705-8069-471d-910d-6a0d358d5c1d service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:39.038516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef92705-8069-471d-910d-6a0d358d5c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:39.038792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef92705-8069-471d-910d-6a0d358d5c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:39.040619 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3ef92705-8069-471d-910d-6a0d358d5c1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:39.051404 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef92705-8069-471d-910d-6a0d358d5c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:39.052862 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef92705-8069-471d-910d-6a0d358d5c1d service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:39.061590 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1382/2783] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:41:49.057687 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=31 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:37.356245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be14fc-36bc-4f09-817c-b64552775133 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:37.357849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a9be14fc-36bc-4f09-817c-b64552775133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:37.373121 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be14fc-36bc-4f09-817c-b64552775133 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:37.379549 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc438-b6dd-4daa-a20c-3b628818186d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:37.380248 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc438-b6dd-4daa-a20c-3b628818186d service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:37.380607 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc438-b6dd-4daa-a20c-3b628818186d service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:37.380969 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc438-b6dd-4daa-a20c-3b628818186d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:37.382839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-73ccc438-b6dd-4daa-a20c-3b628818186d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:37.405392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccc438-b6dd-4daa-a20c-3b628818186d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:37.405392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccc438-b6dd-4daa-a20c-3b628818186d service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:37.414623 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1402/2784] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:42:47.409268 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=6 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:52.101593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660445-bfab-43b8-8723-77344cbc7db8 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:52.102103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660445-bfab-43b8-8723-77344cbc7db8 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:52.102204 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660445-bfab-43b8-8723-77344cbc7db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:52.123061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-4f660445-bfab-43b8-8723-77344cbc7db8 None None] MFA Rules not processed for user `54076085c70b41268575b6b1906fe8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:42:52.124305 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4f660445-bfab-43b8-8723-77344cbc7db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:52.132271 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1383/2785] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:42:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:42:53.860281 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc438-b6dd-4daa-a20c-3b628818186d service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:53.861718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-73ccc438-b6dd-4daa-a20c-3b628818186d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:53.935259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc438-b6dd-4daa-a20c-3b628818186d service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:53.940972 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771005b6-7a82-463c-942a-f1efd1877a21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:53.941596 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771005b6-7a82-463c-942a-f1efd1877a21 service placement] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:53.942049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771005b6-7a82-463c-942a-f1efd1877a21 service placement] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:53.942332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771005b6-7a82-463c-942a-f1efd1877a21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:53.944318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-771005b6-7a82-463c-942a-f1efd1877a21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:53.957429 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771005b6-7a82-463c-942a-f1efd1877a21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:53.959294 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771005b6-7a82-463c-942a-f1efd1877a21 service placement] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:53.970855 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1403/2786] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:43:02.117679 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:03.965597 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=32 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:07.621874 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f660445-bfab-43b8-8723-77344cbc7db8 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:43:07.623629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4f660445-bfab-43b8-8723-77344cbc7db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:43:07.640635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f660445-bfab-43b8-8723-77344cbc7db8 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:43:07.647179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998e9b-ba66-4d81-b8d9-c3b519d24d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:43:07.647842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998e9b-ba66-4d81-b8d9-c3b519d24d20 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:43:07.648174 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998e9b-ba66-4d81-b8d9-c3b519d24d20 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:43:07.648450 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998e9b-ba66-4d81-b8d9-c3b519d24d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:43:07.650332 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-de998e9b-ba66-4d81-b8d9-c3b519d24d20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:43:07.663830 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de998e9b-ba66-4d81-b8d9-c3b519d24d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:43:07.665811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de998e9b-ba66-4d81-b8d9-c3b519d24d20 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:43:07.677099 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1384/2787] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:43:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:43:17.672322 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=6 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:44:24.540086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430055be-05e8-4100-a5f3-8c2034949607 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:44:24.540642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430055be-05e8-4100-a5f3-8c2034949607 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:44:24.540642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430055be-05e8-4100-a5f3-8c2034949607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:44:24.559837 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-430055be-05e8-4100-a5f3-8c2034949607 None None] MFA Rules not processed for user `54076085c70b41268575b6b1906fe8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:44:24.561060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-430055be-05e8-4100-a5f3-8c2034949607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:44:24.568510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1404/2788] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:44:24.905639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998e9b-ba66-4d81-b8d9-c3b519d24d20 service nova] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:44:24.916226 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998e9b-ba66-4d81-b8d9-c3b519d24d20 service nova] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:44:24.919909 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e79e79-3a18-4763-b318-53f77f6191d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:44:24.920503 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e79e79-3a18-4763-b318-53f77f6191d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:44:24.920782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e79e79-3a18-4763-b318-53f77f6191d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:44:24.921048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e79e79-3a18-4763-b318-53f77f6191d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:44:24.922926 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-27e79e79-3a18-4763-b318-53f77f6191d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:44:24.933725 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e79e79-3a18-4763-b318-53f77f6191d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:44:24.935252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e79e79-3a18-4763-b318-53f77f6191d5 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:44:24.943749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1385/2789] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:44:34.554094 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:44:34.939967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=6 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:44:58.314664 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430055be-05e8-4100-a5f3-8c2034949607 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:44:58.316579 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-430055be-05e8-4100-a5f3-8c2034949607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:44:58.332226 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430055be-05e8-4100-a5f3-8c2034949607 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:44:58.338324 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c9b1-be47-4805-be1a-f055f893d1ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:44:58.338952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c9b1-be47-4805-be1a-f055f893d1ac service placement] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:44:58.339223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c9b1-be47-4805-be1a-f055f893d1ac service placement] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:44:58.339491 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c9b1-be47-4805-be1a-f055f893d1ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:44:58.341194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-78b0c9b1-be47-4805-be1a-f055f893d1ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:44:58.353648 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c9b1-be47-4805-be1a-f055f893d1ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:44:58.355325 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c9b1-be47-4805-be1a-f055f893d1ac service placement] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:44:58.366830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1405/2790] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:44:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:45:08.361857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=6 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:26.165478 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e79e79-3a18-4763-b318-53f77f6191d5 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:26.174534 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-27e79e79-3a18-4763-b318-53f77f6191d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:26.179244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e79e79-3a18-4763-b318-53f77f6191d5 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:26.183883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f18fde-eed5-4da3-9bf1-c5a259dd50cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:26.184497 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f18fde-eed5-4da3-9bf1-c5a259dd50cf service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:26.184767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f18fde-eed5-4da3-9bf1-c5a259dd50cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:26.185038 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f18fde-eed5-4da3-9bf1-c5a259dd50cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:26.186827 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-90f18fde-eed5-4da3-9bf1-c5a259dd50cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:26.199347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f18fde-eed5-4da3-9bf1-c5a259dd50cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:26.200700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f18fde-eed5-4da3-9bf1-c5a259dd50cf service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:26.210365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1386/2791] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:45:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:45:36.205951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=6 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:45.832233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c9b1-be47-4805-be1a-f055f893d1ac service placement] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:45.833647 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-78b0c9b1-be47-4805-be1a-f055f893d1ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:45.846003 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c9b1-be47-4805-be1a-f055f893d1ac service placement] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:45.849991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea933e70-9e7c-423b-bb73-393042d61136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:45.851306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea933e70-9e7c-423b-bb73-393042d61136 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:45.851575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea933e70-9e7c-423b-bb73-393042d61136 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:45.851844 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea933e70-9e7c-423b-bb73-393042d61136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:45.853571 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ea933e70-9e7c-423b-bb73-393042d61136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:45.926195 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea933e70-9e7c-423b-bb73-393042d61136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:45.927705 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea933e70-9e7c-423b-bb73-393042d61136 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:45.938952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1406/2792] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:45:49.873325 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f18fde-eed5-4da3-9bf1-c5a259dd50cf service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:49.885945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f18fde-eed5-4da3-9bf1-c5a259dd50cf service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:49.891660 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a096b2-c95e-4c78-9f92-87c35dc22e9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:49.892265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a096b2-c95e-4c78-9f92-87c35dc22e9d service placement] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:49.892549 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a096b2-c95e-4c78-9f92-87c35dc22e9d service placement] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:49.892822 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a096b2-c95e-4c78-9f92-87c35dc22e9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:49.894628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e5a096b2-c95e-4c78-9f92-87c35dc22e9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:49.907847 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a096b2-c95e-4c78-9f92-87c35dc22e9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:49.909424 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a096b2-c95e-4c78-9f92-87c35dc22e9d service placement] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:49.920990 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1387/2793] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:45:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:45:50.025786 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea933e70-9e7c-423b-bb73-393042d61136 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:50.027326 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ea933e70-9e7c-423b-bb73-393042d61136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:50.039917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea933e70-9e7c-423b-bb73-393042d61136 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:50.044476 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d015602-cb5f-442d-8de4-8522364e01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:50.045108 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d015602-cb5f-442d-8de4-8522364e01a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:50.045384 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d015602-cb5f-442d-8de4-8522364e01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:50.045652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d015602-cb5f-442d-8de4-8522364e01a2 admin admin] PATH_INFO: `/v3/users/54076085c70b41268575b6b1906fe8bb` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:50.046792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d015602-cb5f-442d-8de4-8522364e01a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54076085c70b41268575b6b1906fe8bb)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:50.048677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d015602-cb5f-442d-8de4-8522364e01a2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:50.228768 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1d015602-cb5f-442d-8de4-8522364e01a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54076085c70b41268575b6b1906fe8bb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:50.242449 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1d015602-cb5f-442d-8de4-8522364e01a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54076085c70b41268575b6b1906fe8bb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:50.243191 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1d015602-cb5f-442d-8de4-8522364e01a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54076085c70b41268575b6b1906fe8bb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:50.243790 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1d015602-cb5f-442d-8de4-8522364e01a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54076085c70b41268575b6b1906fe8bb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:50.251109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1d015602-cb5f-442d-8de4-8522364e01a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54076085c70b41268575b6b1906fe8bb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:50.336687 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1407/2794] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:45:50 2022] DELETE /identity/v3/users/54076085c70b41268575b6b1906fe8bb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:45:50.611335 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a096b2-c95e-4c78-9f92-87c35dc22e9d service placement] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:50.622741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a096b2-c95e-4c78-9f92-87c35dc22e9d service placement] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:50.683077 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781df96a-de53-489e-94de-64f30b2d8242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:50.683718 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781df96a-de53-489e-94de-64f30b2d8242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:50.684005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781df96a-de53-489e-94de-64f30b2d8242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:50.684279 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781df96a-de53-489e-94de-64f30b2d8242 admin admin] PATH_INFO: `/v3/projects/8067e04cc7674308b83a38df8b19a149` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:50.685485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781df96a-de53-489e-94de-64f30b2d8242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8067e04cc7674308b83a38df8b19a149)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:50.687380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781df96a-de53-489e-94de-64f30b2d8242 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:50.824557 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-781df96a-de53-489e-94de-64f30b2d8242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8067e04cc7674308b83a38df8b19a149', 'request_id': 'req-781df96a-de53-489e-94de-64f30b2d8242'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:50.831144 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-781df96a-de53-489e-94de-64f30b2d8242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8067e04cc7674308b83a38df8b19a149', 'request_id': 'req-781df96a-de53-489e-94de-64f30b2d8242'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:50.838272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-781df96a-de53-489e-94de-64f30b2d8242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8067e04cc7674308b83a38df8b19a149', 'request_id': 'req-781df96a-de53-489e-94de-64f30b2d8242'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:50.944900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-781df96a-de53-489e-94de-64f30b2d8242 admin admin] The token cache is being invalidate because project 8067e04cc7674308b83a38df8b19a149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:45:50.945682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-781df96a-de53-489e-94de-64f30b2d8242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:50.946046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-781df96a-de53-489e-94de-64f30b2d8242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:50.947665 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1388/2795] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:45:50 2022] DELETE /identity/v3/projects/8067e04cc7674308b83a38df8b19a149 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:45:50.952717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d811-782d-4bef-8bd1-8970cb159a76 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:50.953023 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d811-782d-4bef-8bd1-8970cb159a76 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:50.953296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d811-782d-4bef-8bd1-8970cb159a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:50.973201 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7475d811-782d-4bef-8bd1-8970cb159a76 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:45:50.979083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7475d811-782d-4bef-8bd1-8970cb159a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:51.037587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1408/2796] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:45:51.046514 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f4ed-08a2-4959-909e-4711ec7bf533 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:51.046775 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f4ed-08a2-4959-909e-4711ec7bf533 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:51.055760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f4ed-08a2-4959-909e-4711ec7bf533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:51.069104 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-4c18f4ed-08a2-4959-909e-4711ec7bf533 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:45:51.071368 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4c18f4ed-08a2-4959-909e-4711ec7bf533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:51.079867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1389/2797] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:45:51.084362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475d811-782d-4bef-8bd1-8970cb159a76 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:51.094477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475d811-782d-4bef-8bd1-8970cb159a76 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:51.099671 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd31e1-828d-46af-8f9d-738e708fc65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:51.100415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd31e1-828d-46af-8f9d-738e708fc65a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:51.100783 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd31e1-828d-46af-8f9d-738e708fc65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:51.101173 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd31e1-828d-46af-8f9d-738e708fc65a admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:51.102157 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd31e1-828d-46af-8f9d-738e708fc65a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:45:51.102592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd31e1-828d-46af-8f9d-738e708fc65a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:51.104408 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd31e1-828d-46af-8f9d-738e708fc65a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:51.106023 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:51.117586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1409/2798] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:45:51.137515 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f4ed-08a2-4959-909e-4711ec7bf533 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:51.147337 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f4ed-08a2-4959-909e-4711ec7bf533 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:51.153276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a12ec-ecbe-4d01-b284-b4064c46b9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:51.153937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a12ec-ecbe-4d01-b284-b4064c46b9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:51.154312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a12ec-ecbe-4d01-b284-b4064c46b9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:51.154593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a12ec-ecbe-4d01-b284-b4064c46b9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:51.155264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a12ec-ecbe-4d01-b284-b4064c46b9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:51.157232 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a12ec-ecbe-4d01-b284-b4064c46b9d6 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:51.306607 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1390/2799] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:45:51 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:45:51.310821 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd31e1-828d-46af-8f9d-738e708fc65a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:51.321649 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd31e1-828d-46af-8f9d-738e708fc65a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:51.387723 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9aa205-97e6-4151-9fe6-1e29aae14bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:51.388560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9aa205-97e6-4151-9fe6-1e29aae14bad admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:51.388870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9aa205-97e6-4151-9fe6-1e29aae14bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:51.389177 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9aa205-97e6-4151-9fe6-1e29aae14bad admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:51.389752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9aa205-97e6-4151-9fe6-1e29aae14bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:51.391893 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9aa205-97e6-4151-9fe6-1e29aae14bad admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:51.511551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1410/2800] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:45:51 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:45:51.516356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a12ec-ecbe-4d01-b284-b4064c46b9d6 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:51.528255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a12ec-ecbe-4d01-b284-b4064c46b9d6 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:51.532960 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c291a04-29d0-436a-937b-3d005e5c4f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:51.533701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c291a04-29d0-436a-937b-3d005e5c4f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:51.533964 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c291a04-29d0-436a-937b-3d005e5c4f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:51.534276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c291a04-29d0-436a-937b-3d005e5c4f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:51.534925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c291a04-29d0-436a-937b-3d005e5c4f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:51.536556 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c291a04-29d0-436a-937b-3d005e5c4f89 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:51.547584 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1391/2801] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:45:51.551979 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9aa205-97e6-4151-9fe6-1e29aae14bad admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:51.562706 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9aa205-97e6-4151-9fe6-1e29aae14bad admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:51.567224 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26928ea-8b99-4950-a4fe-55f8c5e5239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:51.567896 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26928ea-8b99-4950-a4fe-55f8c5e5239f admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:51.568176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26928ea-8b99-4950-a4fe-55f8c5e5239f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:51.568440 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26928ea-8b99-4950-a4fe-55f8c5e5239f admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:51.569068 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26928ea-8b99-4950-a4fe-55f8c5e5239f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:51.571316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26928ea-8b99-4950-a4fe-55f8c5e5239f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:51.582034 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1411/2802] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:45:51.587412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c291a04-29d0-436a-937b-3d005e5c4f89 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:51.597270 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c291a04-29d0-436a-937b-3d005e5c4f89 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:51.602086 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d30fa1-371e-4255-9fe4-2b2e226b5f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:51.602761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d30fa1-371e-4255-9fe4-2b2e226b5f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:51.603037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d30fa1-371e-4255-9fe4-2b2e226b5f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:51.603304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d30fa1-371e-4255-9fe4-2b2e226b5f5f admin admin] PATH_INFO: `/v3/projects/31ebae92544e4ea5beaa5d6b39718325/users/be0faefe401c4ac2bed0c4375c7f639f/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:51.618541 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d30fa1-371e-4255-9fe4-2b2e226b5f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ebae92544e4ea5beaa5d6b39718325, user_id=be0faefe401c4ac2bed0c4375c7f639f, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:51.621201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d30fa1-371e-4255-9fe4-2b2e226b5f5f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:51.701729 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1392/2803] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:45:51 2022] PUT /identity/v3/projects/31ebae92544e4ea5beaa5d6b39718325/users/be0faefe401c4ac2bed0c4375c7f639f/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:45:51.714346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45fe53-31f2-41b6-a7cf-7e6f538fbdd8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:51.714636 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45fe53-31f2-41b6-a7cf-7e6f538fbdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:51.714926 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45fe53-31f2-41b6-a7cf-7e6f538fbdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:51.744726 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9e45fe53-31f2-41b6-a7cf-7e6f538fbdd8 None None] MFA Rules not processed for user `be0faefe401c4ac2bed0c4375c7f639f`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:45:51.745963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9e45fe53-31f2-41b6-a7cf-7e6f538fbdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:51.812393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1412/2804] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:45:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:45:51.817448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d30fa1-371e-4255-9fe4-2b2e226b5f5f admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:51.831481 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:51.885361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d30fa1-371e-4255-9fe4-2b2e226b5f5f admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:51.891095 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dda747-a7d2-4279-bd90-47b9e07219a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:51.892767 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dda747-a7d2-4279-bd90-47b9e07219a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:51.893055 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dda747-a7d2-4279-bd90-47b9e07219a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:51.893324 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dda747-a7d2-4279-bd90-47b9e07219a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:51.893975 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dda747-a7d2-4279-bd90-47b9e07219a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:51.895956 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dda747-a7d2-4279-bd90-47b9e07219a1 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:52.060324 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1393/2805] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:45:51 2022] POST /identity/v3/projects => generated 367 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:45:52.062310 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45fe53-31f2-41b6-a7cf-7e6f538fbdd8 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:52.074181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45fe53-31f2-41b6-a7cf-7e6f538fbdd8 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:52.138028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d01588-b73b-4c3a-873c-aa34c0d884e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:52.138673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01588-b73b-4c3a-873c-aa34c0d884e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:52.138955 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01588-b73b-4c3a-873c-aa34c0d884e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:52.139228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01588-b73b-4c3a-873c-aa34c0d884e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:52.139879 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d01588-b73b-4c3a-873c-aa34c0d884e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:52.142071 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d01588-b73b-4c3a-873c-aa34c0d884e3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:52.151222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:52.284617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1413/2806] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:45:52 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:45:52.293463 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dda747-a7d2-4279-bd90-47b9e07219a1 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:52.303812 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dda747-a7d2-4279-bd90-47b9e07219a1 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:52.309127 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913f9b8-4f0e-406b-bb52-2be4ba90214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:52.309721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f9b8-4f0e-406b-bb52-2be4ba90214b admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:52.310003 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f9b8-4f0e-406b-bb52-2be4ba90214b admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:52.310289 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f9b8-4f0e-406b-bb52-2be4ba90214b admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:52.310974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913f9b8-4f0e-406b-bb52-2be4ba90214b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:52.312566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913f9b8-4f0e-406b-bb52-2be4ba90214b admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:52.325023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1394/2807] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:45:52.329147 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d01588-b73b-4c3a-873c-aa34c0d884e3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:52.339880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d01588-b73b-4c3a-873c-aa34c0d884e3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:52.345195 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1a148-7aa4-4f76-95e6-92058683c7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:52.345873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1a148-7aa4-4f76-95e6-92058683c7ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:52.346149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1a148-7aa4-4f76-95e6-92058683c7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:52.346465 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1a148-7aa4-4f76-95e6-92058683c7ef admin admin] PATH_INFO: `/v3/projects/8eeea4bf18684750b9405acb550c5ebf/users/d1b8202ef3674de2bfff49ce66869599/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:52.361895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1a148-7aa4-4f76-95e6-92058683c7ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eeea4bf18684750b9405acb550c5ebf, user_id=d1b8202ef3674de2bfff49ce66869599, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:52.364602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1a148-7aa4-4f76-95e6-92058683c7ef admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:52.477009 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1414/2808] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:45:52 2022] PUT /identity/v3/projects/8eeea4bf18684750b9405acb550c5ebf/users/d1b8202ef3674de2bfff49ce66869599/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:45:52.481061 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913f9b8-4f0e-406b-bb52-2be4ba90214b admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:52.491502 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913f9b8-4f0e-406b-bb52-2be4ba90214b admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:52.671301 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85700ec-c37e-4ab5-979b-83da9ed2db2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:52.671903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85700ec-c37e-4ab5-979b-83da9ed2db2e admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:52.672179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85700ec-c37e-4ab5-979b-83da9ed2db2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:52.672443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85700ec-c37e-4ab5-979b-83da9ed2db2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:52.673080 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85700ec-c37e-4ab5-979b-83da9ed2db2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:52.674685 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85700ec-c37e-4ab5-979b-83da9ed2db2e admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:52.685292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1395/2809] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:45:52.689506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1a148-7aa4-4f76-95e6-92058683c7ef admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:52.700656 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1a148-7aa4-4f76-95e6-92058683c7ef admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:52.705078 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290f8fd-17cd-4fe8-b088-0de316795c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:52.705720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290f8fd-17cd-4fe8-b088-0de316795c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:52.705995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290f8fd-17cd-4fe8-b088-0de316795c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:52.706296 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290f8fd-17cd-4fe8-b088-0de316795c37 admin admin] PATH_INFO: `/v3/projects/8eeea4bf18684750b9405acb550c5ebf/users/d1b8202ef3674de2bfff49ce66869599/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:52.708195 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290f8fd-17cd-4fe8-b088-0de316795c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eeea4bf18684750b9405acb550c5ebf, user_id=d1b8202ef3674de2bfff49ce66869599, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:52.710990 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290f8fd-17cd-4fe8-b088-0de316795c37 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:52.720952 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1415/2810] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:45:52 2022] PUT /identity/v3/projects/8eeea4bf18684750b9405acb550c5ebf/users/d1b8202ef3674de2bfff49ce66869599/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:45:52.731517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08dc58-7783-4e86-bd3a-6afd751ef9b2 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:52.731798 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08dc58-7783-4e86-bd3a-6afd751ef9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:52.732066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08dc58-7783-4e86-bd3a-6afd751ef9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:52.761633 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-fa08dc58-7783-4e86-bd3a-6afd751ef9b2 None None] MFA Rules not processed for user `d1b8202ef3674de2bfff49ce66869599`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:45:52.762894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-fa08dc58-7783-4e86-bd3a-6afd751ef9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:52.833045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1396/2811] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:45:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:45:52.844012 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290f8fd-17cd-4fe8-b088-0de316795c37 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:52.845696 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e290f8fd-17cd-4fe8-b088-0de316795c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:52.903765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290f8fd-17cd-4fe8-b088-0de316795c37 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:52.907430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc67d6-11c0-456d-9383-6a6112a86c72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:52.908027 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc67d6-11c0-456d-9383-6a6112a86c72 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:52.908318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc67d6-11c0-456d-9383-6a6112a86c72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:52.908566 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc67d6-11c0-456d-9383-6a6112a86c72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:52.918652 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc67d6-11c0-456d-9383-6a6112a86c72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:52.920075 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc67d6-11c0-456d-9383-6a6112a86c72 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:52.930707 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1416/2812] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:45:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:45:56.072023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08dc58-7783-4e86-bd3a-6afd751ef9b2 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:56.082593 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:56.143293 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08dc58-7783-4e86-bd3a-6afd751ef9b2 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:56.148334 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:56.148997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:56.149263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:56.149532 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] PATH_INFO: `/v3/users/be0faefe401c4ac2bed0c4375c7f639f` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:56.150763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0faefe401c4ac2bed0c4375c7f639f)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:56.152799 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:56.374445 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0faefe401c4ac2bed0c4375c7f639f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:56.382187 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0faefe401c4ac2bed0c4375c7f639f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:56.383026 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0faefe401c4ac2bed0c4375c7f639f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:56.478720 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0faefe401c4ac2bed0c4375c7f639f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:56.493693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0faefe401c4ac2bed0c4375c7f639f'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:56.504442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1397/2813] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:45:56 2022] DELETE /identity/v3/users/be0faefe401c4ac2bed0c4375c7f639f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:45:56.510466 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8a592-46e9-47c3-979c-606e1eb74ede None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:56.510999 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8a592-46e9-47c3-979c-606e1eb74ede None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:56.511096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8a592-46e9-47c3-979c-606e1eb74ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:56.533528 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-25b8a592-46e9-47c3-979c-606e1eb74ede None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:45:56.534791 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-25b8a592-46e9-47c3-979c-606e1eb74ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:56.601205 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1417/2814] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:45:56.611287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:56.612728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:56.672916 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddbb95-2cc0-4883-bb08-2b4d21b8ec45 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:56.676443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6f4e1-a613-4100-9370-613e5e6347ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:56.677046 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6f4e1-a613-4100-9370-613e5e6347ff service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:56.677321 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6f4e1-a613-4100-9370-613e5e6347ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:56.677587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6f4e1-a613-4100-9370-613e5e6347ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:56.690883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6f4e1-a613-4100-9370-613e5e6347ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:56.692413 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6f4e1-a613-4100-9370-613e5e6347ff service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:56.704123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1398/2815] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:45:57.207196 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8a592-46e9-47c3-979c-606e1eb74ede None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:57.208864 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-25b8a592-46e9-47c3-979c-606e1eb74ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:57.224714 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8a592-46e9-47c3-979c-606e1eb74ede None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:57.229849 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:57.230530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:57.230810 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:57.232682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] PATH_INFO: `/v3/projects/31ebae92544e4ea5beaa5d6b39718325` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:57.232682 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31ebae92544e4ea5beaa5d6b39718325)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:57.234245 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:57.360738 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ebae92544e4ea5beaa5d6b39718325', 'request_id': 'req-3118c6bf-ddae-4d03-af37-089f3dd9ab60'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:57.363306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:57.370060 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ebae92544e4ea5beaa5d6b39718325', 'request_id': 'req-3118c6bf-ddae-4d03-af37-089f3dd9ab60'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:57.504306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ebae92544e4ea5beaa5d6b39718325', 'request_id': 'req-3118c6bf-ddae-4d03-af37-089f3dd9ab60'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:57.517248 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] The token cache is being invalidate because project 31ebae92544e4ea5beaa5d6b39718325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:45:57.517900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:57.518463 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:57.519995 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1418/2816] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:45:57 2022] DELETE /identity/v3/projects/31ebae92544e4ea5beaa5d6b39718325 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:45:57.525081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6f4e1-a613-4100-9370-613e5e6347ff service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:57.534786 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6f4e1-a613-4100-9370-613e5e6347ff service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:57.563405 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:57.591669 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d8c1c-b8af-4b68-8702-8e166c3efcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:57.592292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d8c1c-b8af-4b68-8702-8e166c3efcec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:57.592568 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d8c1c-b8af-4b68-8702-8e166c3efcec admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:57.592837 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d8c1c-b8af-4b68-8702-8e166c3efcec admin admin] PATH_INFO: `/v3/users/d1b8202ef3674de2bfff49ce66869599` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:57.593998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d8c1c-b8af-4b68-8702-8e166c3efcec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1b8202ef3674de2bfff49ce66869599)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:57.595970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d8c1c-b8af-4b68-8702-8e166c3efcec admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:57.808686 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4e7d8c1c-b8af-4b68-8702-8e166c3efcec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1b8202ef3674de2bfff49ce66869599'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:57.815489 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4e7d8c1c-b8af-4b68-8702-8e166c3efcec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1b8202ef3674de2bfff49ce66869599'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:57.816171 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4e7d8c1c-b8af-4b68-8702-8e166c3efcec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1b8202ef3674de2bfff49ce66869599'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:57.921588 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4e7d8c1c-b8af-4b68-8702-8e166c3efcec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1b8202ef3674de2bfff49ce66869599'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:57.936380 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4e7d8c1c-b8af-4b68-8702-8e166c3efcec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1b8202ef3674de2bfff49ce66869599'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:57.942792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1399/2817] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:45:57 2022] DELETE /identity/v3/users/d1b8202ef3674de2bfff49ce66869599 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:45:58.429613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:58.431242 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:58.445457 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118c6bf-ddae-4d03-af37-089f3dd9ab60 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:58.515383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:58.516295 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:58.516570 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:58.516839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a admin admin] PATH_INFO: `/v3/projects/8eeea4bf18684750b9405acb550c5ebf` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:58.518022 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eeea4bf18684750b9405acb550c5ebf)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:58.520137 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:58.675873 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eeea4bf18684750b9405acb550c5ebf', 'request_id': 'req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:58.683527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eeea4bf18684750b9405acb550c5ebf', 'request_id': 'req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:58.778517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eeea4bf18684750b9405acb550c5ebf', 'request_id': 'req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:58.790645 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a admin admin] The token cache is being invalidate because project 8eeea4bf18684750b9405acb550c5ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:45:58.790932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:58.791593 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4b0b01d2-21c3-4cc8-ad6b-cafafa35488a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:45:58.793083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1419/2818] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:45:58 2022] DELETE /identity/v3/projects/8eeea4bf18684750b9405acb550c5ebf => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:45:58.798241 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a13126-9362-46ac-84c2-ff1ebc19e2d8 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:58.798738 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a13126-9362-46ac-84c2-ff1ebc19e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:58.798838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a13126-9362-46ac-84c2-ff1ebc19e2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:58.821020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-41a13126-9362-46ac-84c2-ff1ebc19e2d8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:45:58.822282 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-41a13126-9362-46ac-84c2-ff1ebc19e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:58.883890 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1400/2819] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:45:58.893600 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9d04d-2538-42f0-88b8-355416a91769 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:58.893902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9d04d-2538-42f0-88b8-355416a91769 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:58.894174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9d04d-2538-42f0-88b8-355416a91769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:58.915718 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-fed9d04d-2538-42f0-88b8-355416a91769 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:45:58.916937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fed9d04d-2538-42f0-88b8-355416a91769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:58.925021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1420/2820] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:45:58.929629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a13126-9362-46ac-84c2-ff1ebc19e2d8 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:58.940103 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a13126-9362-46ac-84c2-ff1ebc19e2d8 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:58.947052 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14734c5e-1565-4ab2-8009-fda627b560e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:58.947622 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14734c5e-1565-4ab2-8009-fda627b560e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:58.947819 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14734c5e-1565-4ab2-8009-fda627b560e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:58.948087 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14734c5e-1565-4ab2-8009-fda627b560e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:58.948742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14734c5e-1565-4ab2-8009-fda627b560e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:45:58.949044 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14734c5e-1565-4ab2-8009-fda627b560e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:58.950683 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14734c5e-1565-4ab2-8009-fda627b560e2 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:58.963928 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1401/2821] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:45:58.968380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9d04d-2538-42f0-88b8-355416a91769 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:58.977610 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9d04d-2538-42f0-88b8-355416a91769 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:58.982352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530eacd-4b8f-477c-94a8-29b304f8b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:58.982961 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530eacd-4b8f-477c-94a8-29b304f8b7aa admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:58.983235 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530eacd-4b8f-477c-94a8-29b304f8b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:58.983503 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530eacd-4b8f-477c-94a8-29b304f8b7aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:58.984242 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530eacd-4b8f-477c-94a8-29b304f8b7aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:58.986055 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530eacd-4b8f-477c-94a8-29b304f8b7aa admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:59.096936 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1421/2822] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:45:58 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:45:59.101206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14734c5e-1565-4ab2-8009-fda627b560e2 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:59.111675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14734c5e-1565-4ab2-8009-fda627b560e2 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:59.145735 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:59.174079 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d7999-21d5-4bf1-a5eb-e79ba6c34415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:59.174759 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d7999-21d5-4bf1-a5eb-e79ba6c34415 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:59.175034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d7999-21d5-4bf1-a5eb-e79ba6c34415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:59.175299 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d7999-21d5-4bf1-a5eb-e79ba6c34415 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:59.175935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d7999-21d5-4bf1-a5eb-e79ba6c34415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:59.177834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d7999-21d5-4bf1-a5eb-e79ba6c34415 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:59.341811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1402/2823] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:45:59 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:45:59.346171 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530eacd-4b8f-477c-94a8-29b304f8b7aa admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:59.356982 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530eacd-4b8f-477c-94a8-29b304f8b7aa admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:59.364134 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ffdd8-c4bd-4400-8bd6-163b4f20e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:59.364745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ffdd8-c4bd-4400-8bd6-163b4f20e350 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:59.365020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ffdd8-c4bd-4400-8bd6-163b4f20e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:59.365287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ffdd8-c4bd-4400-8bd6-163b4f20e350 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:59.366017 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ffdd8-c4bd-4400-8bd6-163b4f20e350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:59.368604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ffdd8-c4bd-4400-8bd6-163b4f20e350 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:59.380396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1422/2824] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:45:59.397920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d7999-21d5-4bf1-a5eb-e79ba6c34415 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:59.408452 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d7999-21d5-4bf1-a5eb-e79ba6c34415 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:59.413244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660e2a7-a539-4ada-8b26-2ef3c8693b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:59.413867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660e2a7-a539-4ada-8b26-2ef3c8693b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:59.414142 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660e2a7-a539-4ada-8b26-2ef3c8693b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:59.414634 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660e2a7-a539-4ada-8b26-2ef3c8693b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:59.415222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660e2a7-a539-4ada-8b26-2ef3c8693b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:59.416825 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660e2a7-a539-4ada-8b26-2ef3c8693b06 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:59.427393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1403/2825] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:45:59.432724 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ffdd8-c4bd-4400-8bd6-163b4f20e350 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:59.443260 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ffdd8-c4bd-4400-8bd6-163b4f20e350 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:59.449029 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f46db-3f0e-4d3c-9041-680965c99ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:59.449731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f46db-3f0e-4d3c-9041-680965c99ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:59.450010 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f46db-3f0e-4d3c-9041-680965c99ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:59.450532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f46db-3f0e-4d3c-9041-680965c99ebb admin admin] PATH_INFO: `/v3/projects/3ec8882e4cc940738fe13d1b54a6b5aa/users/554ee045add04568acc1fe2a1efc1854/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:59.466485 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f46db-3f0e-4d3c-9041-680965c99ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec8882e4cc940738fe13d1b54a6b5aa, user_id=554ee045add04568acc1fe2a1efc1854, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:59.472004 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f46db-3f0e-4d3c-9041-680965c99ebb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:59.613553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1423/2826] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:45:59 2022] PUT /identity/v3/projects/3ec8882e4cc940738fe13d1b54a6b5aa/users/554ee045add04568acc1fe2a1efc1854/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:45:59.625027 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fc48d-4c92-481b-b0bc-2b36d59bf141 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:59.625307 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fc48d-4c92-481b-b0bc-2b36d59bf141 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:59.625603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fc48d-4c92-481b-b0bc-2b36d59bf141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:59.655477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-5b6fc48d-4c92-481b-b0bc-2b36d59bf141 None None] MFA Rules not processed for user `554ee045add04568acc1fe2a1efc1854`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:45:59.656808 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-5b6fc48d-4c92-481b-b0bc-2b36d59bf141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:59.725248 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1404/2827] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:45:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:45:59.730610 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f46db-3f0e-4d3c-9041-680965c99ebb admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:59.740059 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:59.799013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f46db-3f0e-4d3c-9041-680965c99ebb admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:59.804267 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827670f-70ac-44ee-b144-5383fc5da582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:59.805150 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827670f-70ac-44ee-b144-5383fc5da582 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:59.805430 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827670f-70ac-44ee-b144-5383fc5da582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:59.805730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827670f-70ac-44ee-b144-5383fc5da582 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:59.806568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827670f-70ac-44ee-b144-5383fc5da582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:59.808633 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827670f-70ac-44ee-b144-5383fc5da582 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:59.906167 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1424/2828] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:45:59 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:45:59.910015 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fc48d-4c92-481b-b0bc-2b36d59bf141 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:59.920992 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fc48d-4c92-481b-b0bc-2b36d59bf141 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:59.979558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ed87f-4221-4e29-94e4-a8cf74a588e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:59.980326 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ed87f-4221-4e29-94e4-a8cf74a588e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:59.980783 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ed87f-4221-4e29-94e4-a8cf74a588e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:59.981147 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ed87f-4221-4e29-94e4-a8cf74a588e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:59.981870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ed87f-4221-4e29-94e4-a8cf74a588e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:59.984615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ed87f-4221-4e29-94e4-a8cf74a588e9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:00.110485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1405/2829] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:45:59 2022] POST /identity/v3/users => generated 295 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:00.114845 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827670f-70ac-44ee-b144-5383fc5da582 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:00.126578 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827670f-70ac-44ee-b144-5383fc5da582 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:00.131184 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3356a89-d49c-4611-9f9b-0cf39a1b8734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:00.131782 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356a89-d49c-4611-9f9b-0cf39a1b8734 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:00.133333 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356a89-d49c-4611-9f9b-0cf39a1b8734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:00.133615 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356a89-d49c-4611-9f9b-0cf39a1b8734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:00.134332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3356a89-d49c-4611-9f9b-0cf39a1b8734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:00.135931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3356a89-d49c-4611-9f9b-0cf39a1b8734 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:00.147223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1425/2830] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:00.151949 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ed87f-4221-4e29-94e4-a8cf74a588e9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:00.162530 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ed87f-4221-4e29-94e4-a8cf74a588e9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:00.167534 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d7a81-b5bf-47cc-90c9-2231656d8701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:00.168238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d7a81-b5bf-47cc-90c9-2231656d8701 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:00.168521 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d7a81-b5bf-47cc-90c9-2231656d8701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:00.168817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d7a81-b5bf-47cc-90c9-2231656d8701 admin admin] PATH_INFO: `/v3/projects/c2a4a89b6d194c85874ac4b7b15963d1/users/7b7edae031384c2d827856daa5cc6519/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:00.184932 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d7a81-b5bf-47cc-90c9-2231656d8701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a4a89b6d194c85874ac4b7b15963d1, user_id=7b7edae031384c2d827856daa5cc6519, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:00.187604 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d7a81-b5bf-47cc-90c9-2231656d8701 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:00.267266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1406/2831] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:00 2022] PUT /identity/v3/projects/c2a4a89b6d194c85874ac4b7b15963d1/users/7b7edae031384c2d827856daa5cc6519/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:00.271471 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3356a89-d49c-4611-9f9b-0cf39a1b8734 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:00.284105 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3356a89-d49c-4611-9f9b-0cf39a1b8734 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:00.343642 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915c845-1139-4762-8bdc-be371d8a4b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:00.344246 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915c845-1139-4762-8bdc-be371d8a4b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:00.344523 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915c845-1139-4762-8bdc-be371d8a4b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:00.344792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915c845-1139-4762-8bdc-be371d8a4b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:00.345436 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915c845-1139-4762-8bdc-be371d8a4b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:00.347064 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915c845-1139-4762-8bdc-be371d8a4b04 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:00.358035 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1426/2832] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:00.362276 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d7a81-b5bf-47cc-90c9-2231656d8701 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:00.373568 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d7a81-b5bf-47cc-90c9-2231656d8701 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:00.378251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a469f-4d3f-4718-9b64-9843e3f88798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:00.378903 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a469f-4d3f-4718-9b64-9843e3f88798 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:00.379185 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a469f-4d3f-4718-9b64-9843e3f88798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:00.379448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a469f-4d3f-4718-9b64-9843e3f88798 admin admin] PATH_INFO: `/v3/projects/c2a4a89b6d194c85874ac4b7b15963d1/users/7b7edae031384c2d827856daa5cc6519/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:00.381371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a469f-4d3f-4718-9b64-9843e3f88798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a4a89b6d194c85874ac4b7b15963d1, user_id=7b7edae031384c2d827856daa5cc6519, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:00.384834 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a469f-4d3f-4718-9b64-9843e3f88798 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:00.391062 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:00.398477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1407/2833] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:00 2022] PUT /identity/v3/projects/c2a4a89b6d194c85874ac4b7b15963d1/users/7b7edae031384c2d827856daa5cc6519/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:46:00.410535 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69116b-366d-4dbd-b681-878ccbc7203b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:00.410820 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69116b-366d-4dbd-b681-878ccbc7203b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:00.411086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69116b-366d-4dbd-b681-878ccbc7203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:00.440746 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0a69116b-366d-4dbd-b681-878ccbc7203b None None] MFA Rules not processed for user `7b7edae031384c2d827856daa5cc6519`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:00.441959 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0a69116b-366d-4dbd-b681-878ccbc7203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:00.511646 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1427/2834] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:00.523334 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a469f-4d3f-4718-9b64-9843e3f88798 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:00.525315 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8e6a469f-4d3f-4718-9b64-9843e3f88798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:00.581811 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a469f-4d3f-4718-9b64-9843e3f88798 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:00.586752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb04d2-b66f-400d-8f42-1902e0524344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:00.598517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb04d2-b66f-400d-8f42-1902e0524344 service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:00.598838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb04d2-b66f-400d-8f42-1902e0524344 service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:00.599112 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb04d2-b66f-400d-8f42-1902e0524344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:00.663713 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb04d2-b66f-400d-8f42-1902e0524344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:00.665131 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb04d2-b66f-400d-8f42-1902e0524344 service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:00.674302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1408/2835] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:46:03.999584 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69116b-366d-4dbd-b681-878ccbc7203b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:04.004301 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:04.011083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69116b-366d-4dbd-b681-878ccbc7203b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:04.014664 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba10f24-b7da-4924-985c-28ca01df3768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:04.015266 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10f24-b7da-4924-985c-28ca01df3768 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:04.015539 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10f24-b7da-4924-985c-28ca01df3768 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:04.023480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10f24-b7da-4924-985c-28ca01df3768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:04.025949 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba10f24-b7da-4924-985c-28ca01df3768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:04.027428 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba10f24-b7da-4924-985c-28ca01df3768 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:04.037373 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1428/2836] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:46:10.670206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=49 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:14.083237 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:19.580869 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb04d2-b66f-400d-8f42-1902e0524344 service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:19.646933 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb04d2-b66f-400d-8f42-1902e0524344 service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:19.652083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:19.652717 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:19.652994 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:19.653267 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] PATH_INFO: `/v3/users/554ee045add04568acc1fe2a1efc1854` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:19.654426 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554ee045add04568acc1fe2a1efc1854)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:19.656357 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:19.863174 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554ee045add04568acc1fe2a1efc1854'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:19.870358 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554ee045add04568acc1fe2a1efc1854'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:19.871065 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554ee045add04568acc1fe2a1efc1854'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:20.014498 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554ee045add04568acc1fe2a1efc1854'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:20.029226 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554ee045add04568acc1fe2a1efc1854'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:20.035331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1409/2837] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:46:19 2022] DELETE /identity/v3/users/554ee045add04568acc1fe2a1efc1854 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:20.039991 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821f55-941d-4adc-961f-b0d56f17096b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:20.040491 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821f55-941d-4adc-961f-b0d56f17096b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:20.040599 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821f55-941d-4adc-961f-b0d56f17096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:20.060926 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3d821f55-941d-4adc-961f-b0d56f17096b None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:20.062151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3d821f55-941d-4adc-961f-b0d56f17096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:20.124704 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1429/2838] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:20.141589 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:20.143030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:20.203749 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4bc51-32fc-430e-8ad8-4ff07b3d1b51 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:20.207443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c0e50-3ac5-4609-bda0-5a5f7f31360c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:20.208040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c0e50-3ac5-4609-bda0-5a5f7f31360c service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:20.208313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c0e50-3ac5-4609-bda0-5a5f7f31360c service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:20.208579 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c0e50-3ac5-4609-bda0-5a5f7f31360c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:20.219719 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c0e50-3ac5-4609-bda0-5a5f7f31360c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:20.221251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c0e50-3ac5-4609-bda0-5a5f7f31360c service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:20.231920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1410/2839] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:46:20.705397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d821f55-941d-4adc-961f-b0d56f17096b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:20.706890 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3d821f55-941d-4adc-961f-b0d56f17096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:20.727223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d821f55-941d-4adc-961f-b0d56f17096b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:20.727223 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:20.727583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:20.727868 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:20.728143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] PATH_INFO: `/v3/projects/3ec8882e4cc940738fe13d1b54a6b5aa` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:20.729474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec8882e4cc940738fe13d1b54a6b5aa)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:20.731717 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:20.862123 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec8882e4cc940738fe13d1b54a6b5aa', 'request_id': 'req-57a384bf-87b5-42b9-9962-0cd19add5157'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:20.868606 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec8882e4cc940738fe13d1b54a6b5aa', 'request_id': 'req-57a384bf-87b5-42b9-9962-0cd19add5157'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:20.940111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec8882e4cc940738fe13d1b54a6b5aa', 'request_id': 'req-57a384bf-87b5-42b9-9962-0cd19add5157'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:20.951680 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] The token cache is being invalidate because project 3ec8882e4cc940738fe13d1b54a6b5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:46:20.951891 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:20.952554 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:20.954080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1430/2840] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:46:20 2022] DELETE /identity/v3/projects/3ec8882e4cc940738fe13d1b54a6b5aa => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:20.958344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c0e50-3ac5-4609-bda0-5a5f7f31360c service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:20.969280 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c0e50-3ac5-4609-bda0-5a5f7f31360c service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:20.991097 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:21.036304 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5a84a-f937-406e-a0ee-dc4ace723371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:21.037066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5a84a-f937-406e-a0ee-dc4ace723371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:21.037355 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5a84a-f937-406e-a0ee-dc4ace723371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:21.037628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5a84a-f937-406e-a0ee-dc4ace723371 admin admin] PATH_INFO: `/v3/users/7b7edae031384c2d827856daa5cc6519` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:21.039317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5a84a-f937-406e-a0ee-dc4ace723371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7edae031384c2d827856daa5cc6519)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:21.041120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5a84a-f937-406e-a0ee-dc4ace723371 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:21.271778 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-40e5a84a-f937-406e-a0ee-dc4ace723371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7edae031384c2d827856daa5cc6519'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:21.278794 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-40e5a84a-f937-406e-a0ee-dc4ace723371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7edae031384c2d827856daa5cc6519'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:21.279505 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-40e5a84a-f937-406e-a0ee-dc4ace723371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7edae031384c2d827856daa5cc6519'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:21.389235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-40e5a84a-f937-406e-a0ee-dc4ace723371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7edae031384c2d827856daa5cc6519'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:21.403161 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-40e5a84a-f937-406e-a0ee-dc4ace723371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7edae031384c2d827856daa5cc6519'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:21.409567 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1411/2841] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:46:20 2022] DELETE /identity/v3/users/7b7edae031384c2d827856daa5cc6519 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:21.891904 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:21.893392 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:21.907816 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a384bf-87b5-42b9-9962-0cd19add5157 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:21.967720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc500d-0d25-417e-be90-4500eedc8e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:21.968349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc500d-0d25-417e-be90-4500eedc8e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:21.968622 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc500d-0d25-417e-be90-4500eedc8e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:21.968889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc500d-0d25-417e-be90-4500eedc8e34 admin admin] PATH_INFO: `/v3/projects/c2a4a89b6d194c85874ac4b7b15963d1` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:21.969998 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc500d-0d25-417e-be90-4500eedc8e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a4a89b6d194c85874ac4b7b15963d1)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:21.971942 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc500d-0d25-417e-be90-4500eedc8e34 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:22.065462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:22.082695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-61bc500d-0d25-417e-be90-4500eedc8e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a4a89b6d194c85874ac4b7b15963d1', 'request_id': 'req-61bc500d-0d25-417e-be90-4500eedc8e34'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:22.090935 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-61bc500d-0d25-417e-be90-4500eedc8e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a4a89b6d194c85874ac4b7b15963d1', 'request_id': 'req-61bc500d-0d25-417e-be90-4500eedc8e34'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:22.179829 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-61bc500d-0d25-417e-be90-4500eedc8e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a4a89b6d194c85874ac4b7b15963d1', 'request_id': 'req-61bc500d-0d25-417e-be90-4500eedc8e34'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:22.191467 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-61bc500d-0d25-417e-be90-4500eedc8e34 admin admin] The token cache is being invalidate because project c2a4a89b6d194c85874ac4b7b15963d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:46:22.191761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-61bc500d-0d25-417e-be90-4500eedc8e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:22.192409 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-61bc500d-0d25-417e-be90-4500eedc8e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:22.193971 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1431/2842] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:46:21 2022] DELETE /identity/v3/projects/c2a4a89b6d194c85874ac4b7b15963d1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:22.199953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038244-30ac-4834-ac8a-f3d2015d3d09 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:22.200466 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038244-30ac-4834-ac8a-f3d2015d3d09 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:22.200588 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038244-30ac-4834-ac8a-f3d2015d3d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:22.221591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-39038244-30ac-4834-ac8a-f3d2015d3d09 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:22.222863 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-39038244-30ac-4834-ac8a-f3d2015d3d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:22.287179 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1412/2843] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:22.295551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c0daa-95f1-492a-ae5d-800b5b2f0e02 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:22.295834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c0daa-95f1-492a-ae5d-800b5b2f0e02 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:22.296107 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c0daa-95f1-492a-ae5d-800b5b2f0e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:22.317131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-227c0daa-95f1-492a-ae5d-800b5b2f0e02 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:22.318387 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-227c0daa-95f1-492a-ae5d-800b5b2f0e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:22.326900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1432/2844] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:22.331252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39038244-30ac-4834-ac8a-f3d2015d3d09 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:22.342582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39038244-30ac-4834-ac8a-f3d2015d3d09 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:22.347558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf4127-d107-4e42-b489-82ebd8abdca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:22.348187 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf4127-d107-4e42-b489-82ebd8abdca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:22.348500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf4127-d107-4e42-b489-82ebd8abdca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:22.348774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf4127-d107-4e42-b489-82ebd8abdca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:22.349440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf4127-d107-4e42-b489-82ebd8abdca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:46:22.349743 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf4127-d107-4e42-b489-82ebd8abdca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:22.351899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf4127-d107-4e42-b489-82ebd8abdca9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:22.365328 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1413/2845] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:46:22.370930 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c0daa-95f1-492a-ae5d-800b5b2f0e02 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:22.381125 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c0daa-95f1-492a-ae5d-800b5b2f0e02 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:22.396156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575094d8-866a-4e17-be00-6825e1d55ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:22.396156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575094d8-866a-4e17-be00-6825e1d55ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:22.396156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575094d8-866a-4e17-be00-6825e1d55ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:22.396156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575094d8-866a-4e17-be00-6825e1d55ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:22.396637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575094d8-866a-4e17-be00-6825e1d55ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:22.396637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575094d8-866a-4e17-be00-6825e1d55ef2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:22.605131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1433/2846] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:46:22 2022] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:22.609457 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf4127-d107-4e42-b489-82ebd8abdca9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:22.620629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf4127-d107-4e42-b489-82ebd8abdca9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:22.647817 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:22.677307 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5df8d-3a45-4882-9106-f207bb872e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:22.677907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5df8d-3a45-4882-9106-f207bb872e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:22.678186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5df8d-3a45-4882-9106-f207bb872e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:22.678490 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5df8d-3a45-4882-9106-f207bb872e47 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:22.679130 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5df8d-3a45-4882-9106-f207bb872e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:22.681736 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5df8d-3a45-4882-9106-f207bb872e47 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:22.786492 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1414/2847] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:46:22 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:22.791916 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575094d8-866a-4e17-be00-6825e1d55ef2 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:22.802453 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575094d8-866a-4e17-be00-6825e1d55ef2 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:22.807708 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acef266-62d0-493b-aa92-2e18525a646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:22.808336 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acef266-62d0-493b-aa92-2e18525a646e admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:22.808613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acef266-62d0-493b-aa92-2e18525a646e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:22.808886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acef266-62d0-493b-aa92-2e18525a646e admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:22.809533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acef266-62d0-493b-aa92-2e18525a646e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:22.811170 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acef266-62d0-493b-aa92-2e18525a646e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:22.821986 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1434/2848] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:22.826616 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5df8d-3a45-4882-9106-f207bb872e47 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:22.838043 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5df8d-3a45-4882-9106-f207bb872e47 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:22.842774 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87d3ff-3999-4700-b70f-bc4436a303c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:22.843379 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87d3ff-3999-4700-b70f-bc4436a303c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:22.843656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87d3ff-3999-4700-b70f-bc4436a303c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:22.843925 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87d3ff-3999-4700-b70f-bc4436a303c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:22.844570 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87d3ff-3999-4700-b70f-bc4436a303c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:22.846155 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87d3ff-3999-4700-b70f-bc4436a303c7 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:22.858309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1415/2849] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:22.862500 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acef266-62d0-493b-aa92-2e18525a646e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:22.874099 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acef266-62d0-493b-aa92-2e18525a646e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:22.882279 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da5f90-76e5-414c-9f6f-4b91e8e19125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:22.883180 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da5f90-76e5-414c-9f6f-4b91e8e19125 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:22.883525 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da5f90-76e5-414c-9f6f-4b91e8e19125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:22.884002 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da5f90-76e5-414c-9f6f-4b91e8e19125 admin admin] PATH_INFO: `/v3/projects/f729beb83a3d42cbabdb2cc92e37a265/users/cdf566b916004ec6a29b2695c2397c19/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:22.902447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da5f90-76e5-414c-9f6f-4b91e8e19125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f729beb83a3d42cbabdb2cc92e37a265, user_id=cdf566b916004ec6a29b2695c2397c19, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:22.906159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da5f90-76e5-414c-9f6f-4b91e8e19125 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:23.018402 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1435/2850] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:22 2022] PUT /identity/v3/projects/f729beb83a3d42cbabdb2cc92e37a265/users/cdf566b916004ec6a29b2695c2397c19/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:23.028766 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cac08e-6afd-4a98-8502-a0cfa1f64c8a None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:23.033091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cac08e-6afd-4a98-8502-a0cfa1f64c8a None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:23.033091 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cac08e-6afd-4a98-8502-a0cfa1f64c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:23.060222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a0cac08e-6afd-4a98-8502-a0cfa1f64c8a None None] MFA Rules not processed for user `cdf566b916004ec6a29b2695c2397c19`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:23.061442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a0cac08e-6afd-4a98-8502-a0cfa1f64c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:23.131167 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1416/2851] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:23.136070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da5f90-76e5-414c-9f6f-4b91e8e19125 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:23.202013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da5f90-76e5-414c-9f6f-4b91e8e19125 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:23.206863 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac18035-bd15-4beb-b868-5e652e53e0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:23.207396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac18035-bd15-4beb-b868-5e652e53e0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:23.207675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac18035-bd15-4beb-b868-5e652e53e0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:23.207943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac18035-bd15-4beb-b868-5e652e53e0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:23.208584 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac18035-bd15-4beb-b868-5e652e53e0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:23.210519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac18035-bd15-4beb-b868-5e652e53e0c6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:23.329617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1436/2852] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:46:23 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:23.333974 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cac08e-6afd-4a98-8502-a0cfa1f64c8a None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:23.346658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cac08e-6afd-4a98-8502-a0cfa1f64c8a None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:23.411509 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846975-2239-40fe-b8c4-b45b00377c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:23.412089 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846975-2239-40fe-b8c4-b45b00377c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:23.412414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846975-2239-40fe-b8c4-b45b00377c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:23.413051 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846975-2239-40fe-b8c4-b45b00377c94 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:23.413611 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21846975-2239-40fe-b8c4-b45b00377c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:23.416564 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21846975-2239-40fe-b8c4-b45b00377c94 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:23.518443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1417/2853] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:46:23 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:23.522419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac18035-bd15-4beb-b868-5e652e53e0c6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:23.534128 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac18035-bd15-4beb-b868-5e652e53e0c6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:23.540053 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca7df5-b6e6-41ef-98ac-0bfb08be11a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:23.540767 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca7df5-b6e6-41ef-98ac-0bfb08be11a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:23.541049 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca7df5-b6e6-41ef-98ac-0bfb08be11a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:23.541377 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca7df5-b6e6-41ef-98ac-0bfb08be11a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:23.542059 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca7df5-b6e6-41ef-98ac-0bfb08be11a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:23.543819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca7df5-b6e6-41ef-98ac-0bfb08be11a8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:23.556182 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1437/2854] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:23.560340 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846975-2239-40fe-b8c4-b45b00377c94 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:23.571211 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846975-2239-40fe-b8c4-b45b00377c94 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:23.575916 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884ed6c-6e6e-43cd-b93d-8c16a8278081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:23.576542 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884ed6c-6e6e-43cd-b93d-8c16a8278081 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:23.576803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884ed6c-6e6e-43cd-b93d-8c16a8278081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:23.577071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884ed6c-6e6e-43cd-b93d-8c16a8278081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:23.577714 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884ed6c-6e6e-43cd-b93d-8c16a8278081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:23.579360 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884ed6c-6e6e-43cd-b93d-8c16a8278081 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:23.590252 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1418/2855] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:23.600190 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca7df5-b6e6-41ef-98ac-0bfb08be11a8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:23.615654 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca7df5-b6e6-41ef-98ac-0bfb08be11a8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:23.622089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337707b-ebfa-4acf-9d33-3ce76f895363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:23.622796 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337707b-ebfa-4acf-9d33-3ce76f895363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:23.623079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337707b-ebfa-4acf-9d33-3ce76f895363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:23.623400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337707b-ebfa-4acf-9d33-3ce76f895363 admin admin] PATH_INFO: `/v3/projects/55d9566621164dc38c674c966170ecad/users/b8131ce661594858a76b5ac9975dfc13/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:23.644400 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337707b-ebfa-4acf-9d33-3ce76f895363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d9566621164dc38c674c966170ecad, user_id=b8131ce661594858a76b5ac9975dfc13, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:23.648782 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337707b-ebfa-4acf-9d33-3ce76f895363 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:23.770532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:23.775537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1438/2856] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:23 2022] PUT /identity/v3/projects/55d9566621164dc38c674c966170ecad/users/b8131ce661594858a76b5ac9975dfc13/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:23.787297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb39dbd-d87f-4f03-b77c-599293e20e84 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:23.787603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb39dbd-d87f-4f03-b77c-599293e20e84 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:23.787880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb39dbd-d87f-4f03-b77c-599293e20e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:23.817780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-8cb39dbd-d87f-4f03-b77c-599293e20e84 None None] MFA Rules not processed for user `b8131ce661594858a76b5ac9975dfc13`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:23.819030 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8cb39dbd-d87f-4f03-b77c-599293e20e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:23.823219 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:23.886554 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1419/2857] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:23.891499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337707b-ebfa-4acf-9d33-3ce76f895363 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:23.959866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337707b-ebfa-4acf-9d33-3ce76f895363 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:23.965753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94ccd6-d2b7-4842-bc09-e69d4947c933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:23.966415 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ccd6-d2b7-4842-bc09-e69d4947c933 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:23.966700 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ccd6-d2b7-4842-bc09-e69d4947c933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:23.966974 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ccd6-d2b7-4842-bc09-e69d4947c933 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:23.967632 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94ccd6-d2b7-4842-bc09-e69d4947c933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:23.969553 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94ccd6-d2b7-4842-bc09-e69d4947c933 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:24.074506 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1439/2858] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:46:23 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:46:24.077792 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb39dbd-d87f-4f03-b77c-599293e20e84 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:24.093448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb39dbd-d87f-4f03-b77c-599293e20e84 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:24.160892 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea04e0-7dd0-4a1c-a729-37de933c8ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:24.161504 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea04e0-7dd0-4a1c-a729-37de933c8ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:24.161780 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea04e0-7dd0-4a1c-a729-37de933c8ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:24.162050 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea04e0-7dd0-4a1c-a729-37de933c8ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:24.162728 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea04e0-7dd0-4a1c-a729-37de933c8ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:24.164682 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea04e0-7dd0-4a1c-a729-37de933c8ef0 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:24.284048 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1420/2859] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:46:24 2022] POST /identity/v3/users => generated 300 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:24.293937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94ccd6-d2b7-4842-bc09-e69d4947c933 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:24.311344 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94ccd6-d2b7-4842-bc09-e69d4947c933 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:24.316247 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd0fbc-eda9-4b60-aa0f-9d922a1230a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:24.316866 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd0fbc-eda9-4b60-aa0f-9d922a1230a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:24.317148 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd0fbc-eda9-4b60-aa0f-9d922a1230a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:24.317447 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd0fbc-eda9-4b60-aa0f-9d922a1230a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:24.318096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd0fbc-eda9-4b60-aa0f-9d922a1230a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:24.319734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd0fbc-eda9-4b60-aa0f-9d922a1230a9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:24.332966 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1440/2860] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:24.338007 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea04e0-7dd0-4a1c-a729-37de933c8ef0 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:24.348651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea04e0-7dd0-4a1c-a729-37de933c8ef0 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:24.353867 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9b8b7-91b5-4076-aa8c-08c8e9ce2114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:24.354573 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9b8b7-91b5-4076-aa8c-08c8e9ce2114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:24.354856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9b8b7-91b5-4076-aa8c-08c8e9ce2114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:24.355125 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9b8b7-91b5-4076-aa8c-08c8e9ce2114 admin admin] PATH_INFO: `/v3/projects/217a6d56380845b891733a6dc4933712/users/e30aaca9482d45428637b74da41d2a88/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:24.371524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9b8b7-91b5-4076-aa8c-08c8e9ce2114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217a6d56380845b891733a6dc4933712, user_id=e30aaca9482d45428637b74da41d2a88, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:24.374354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9b8b7-91b5-4076-aa8c-08c8e9ce2114 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:24.500831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1421/2861] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:24 2022] PUT /identity/v3/projects/217a6d56380845b891733a6dc4933712/users/e30aaca9482d45428637b74da41d2a88/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:46:24.505216 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd0fbc-eda9-4b60-aa0f-9d922a1230a9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:24.516460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd0fbc-eda9-4b60-aa0f-9d922a1230a9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:24.573695 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70d4cc-79be-4f5e-9221-6d9f31e876e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:24.574256 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70d4cc-79be-4f5e-9221-6d9f31e876e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:24.574526 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70d4cc-79be-4f5e-9221-6d9f31e876e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:24.574794 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70d4cc-79be-4f5e-9221-6d9f31e876e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:24.575459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70d4cc-79be-4f5e-9221-6d9f31e876e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:24.577051 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70d4cc-79be-4f5e-9221-6d9f31e876e7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:24.587805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1441/2862] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:46:24.592361 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9b8b7-91b5-4076-aa8c-08c8e9ce2114 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:24.602855 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9b8b7-91b5-4076-aa8c-08c8e9ce2114 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:24.607548 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f3567-ae32-412e-9268-2874746407c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:24.608200 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f3567-ae32-412e-9268-2874746407c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:24.608480 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f3567-ae32-412e-9268-2874746407c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:24.608750 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f3567-ae32-412e-9268-2874746407c3 admin admin] PATH_INFO: `/v3/projects/217a6d56380845b891733a6dc4933712/users/e30aaca9482d45428637b74da41d2a88/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:24.610710 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f3567-ae32-412e-9268-2874746407c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217a6d56380845b891733a6dc4933712, user_id=e30aaca9482d45428637b74da41d2a88, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:24.613316 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f3567-ae32-412e-9268-2874746407c3 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:24.625162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1422/2863] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:24 2022] PUT /identity/v3/projects/217a6d56380845b891733a6dc4933712/users/e30aaca9482d45428637b74da41d2a88/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:24.636159 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887b91b-6256-4120-a847-7a6377421443 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:24.636626 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887b91b-6256-4120-a847-7a6377421443 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:24.636911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887b91b-6256-4120-a847-7a6377421443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:24.665352 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6887b91b-6256-4120-a847-7a6377421443 None None] MFA Rules not processed for user `e30aaca9482d45428637b74da41d2a88`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:24.666685 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6887b91b-6256-4120-a847-7a6377421443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:24.727856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:24.736499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1442/2864] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:24.752314 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f3567-ae32-412e-9268-2874746407c3 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:24.754070 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-666f3567-ae32-412e-9268-2874746407c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:24.815471 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f3567-ae32-412e-9268-2874746407c3 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:24.819188 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63b7a1-e13e-4686-9ba2-6ab33392efef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:24.819802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63b7a1-e13e-4686-9ba2-6ab33392efef service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:24.820109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63b7a1-e13e-4686-9ba2-6ab33392efef service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:24.820440 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63b7a1-e13e-4686-9ba2-6ab33392efef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:24.830040 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63b7a1-e13e-4686-9ba2-6ab33392efef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:24.831442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63b7a1-e13e-4686-9ba2-6ab33392efef service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:24.837393 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:24.843384 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1423/2865] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:46:26.059366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887b91b-6256-4120-a847-7a6377421443 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:26.060739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6887b91b-6256-4120-a847-7a6377421443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:26.073305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887b91b-6256-4120-a847-7a6377421443 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:26.076861 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e599121-322a-4fd3-8556-99288c619a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:26.077446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e599121-322a-4fd3-8556-99288c619a8c service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:26.077715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e599121-322a-4fd3-8556-99288c619a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:26.077979 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e599121-322a-4fd3-8556-99288c619a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:26.137176 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e599121-322a-4fd3-8556-99288c619a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:26.138653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e599121-322a-4fd3-8556-99288c619a8c service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:26.147627 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1443/2866] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:46:31.297126 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63b7a1-e13e-4686-9ba2-6ab33392efef service cinder] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:31.307329 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63b7a1-e13e-4686-9ba2-6ab33392efef service cinder] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:31.311173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4174-a709-49f5-9bd5-261a44dd188d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:31.311752 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4174-a709-49f5-9bd5-261a44dd188d service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:31.312033 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4174-a709-49f5-9bd5-261a44dd188d service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:31.312302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4174-a709-49f5-9bd5-261a44dd188d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:31.375369 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4174-a709-49f5-9bd5-261a44dd188d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:31.377678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4174-a709-49f5-9bd5-261a44dd188d service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:31.387067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1424/2867] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:46:35.847773 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e599121-322a-4fd3-8556-99288c619a8c service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:35.910792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e599121-322a-4fd3-8556-99288c619a8c service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:35.915358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:35.916146 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:35.916655 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:35.916963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] PATH_INFO: `/v3/users/cdf566b916004ec6a29b2695c2397c19` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:35.918106 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf566b916004ec6a29b2695c2397c19)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:35.920045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:36.120442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf566b916004ec6a29b2695c2397c19'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:36.132595 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf566b916004ec6a29b2695c2397c19'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:36.133298 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf566b916004ec6a29b2695c2397c19'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:36.133920 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf566b916004ec6a29b2695c2397c19'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:36.141988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf566b916004ec6a29b2695c2397c19'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:36.232346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1444/2868] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:46:35 2022] DELETE /identity/v3/users/cdf566b916004ec6a29b2695c2397c19 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:36.245586 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a919f-fa43-493a-824c-418653db14e6 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:36.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a919f-fa43-493a-824c-418653db14e6 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:36.246152 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a919f-fa43-493a-824c-418653db14e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:36.267132 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-118a919f-fa43-493a-824c-418653db14e6 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:36.268371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-118a919f-fa43-493a-824c-418653db14e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:36.332989 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1425/2869] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:46:36.348251 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:36.350390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:36.368353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:36.416346 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774101e-a01e-4171-928f-c1b58da92969 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:36.420270 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddda5b-d140-48f6-af77-f536ed58f31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:36.420870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddda5b-d140-48f6-af77-f536ed58f31b service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:36.421221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddda5b-d140-48f6-af77-f536ed58f31b service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:36.421487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddda5b-d140-48f6-af77-f536ed58f31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:36.433533 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddda5b-d140-48f6-af77-f536ed58f31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:36.438462 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddda5b-d140-48f6-af77-f536ed58f31b service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:36.445938 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1445/2870] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:46:36.906664 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a919f-fa43-493a-824c-418653db14e6 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:36.908934 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-118a919f-fa43-493a-824c-418653db14e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:36.923997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a919f-fa43-493a-824c-418653db14e6 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:36.929159 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:36.929902 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:36.930186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:36.930678 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] PATH_INFO: `/v3/projects/f729beb83a3d42cbabdb2cc92e37a265` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:36.932477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f729beb83a3d42cbabdb2cc92e37a265)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:36.936723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:37.070577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f729beb83a3d42cbabdb2cc92e37a265', 'request_id': 'req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:37.077474 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f729beb83a3d42cbabdb2cc92e37a265', 'request_id': 'req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:37.084017 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f729beb83a3d42cbabdb2cc92e37a265', 'request_id': 'req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:37.172500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] The token cache is being invalidate because project f729beb83a3d42cbabdb2cc92e37a265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:46:37.172931 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:37.173608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:37.175176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1426/2871] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:46:36 2022] DELETE /identity/v3/projects/f729beb83a3d42cbabdb2cc92e37a265 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:37.179389 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddda5b-d140-48f6-af77-f536ed58f31b service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:37.190383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddda5b-d140-48f6-af77-f536ed58f31b service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:37.254280 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:37.254929 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:37.255206 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:37.255477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] PATH_INFO: `/v3/users/b8131ce661594858a76b5ac9975dfc13` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:37.256638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8131ce661594858a76b5ac9975dfc13)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:37.258759 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:37.442446 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8131ce661594858a76b5ac9975dfc13'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:37.457229 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8131ce661594858a76b5ac9975dfc13'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:37.458156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8131ce661594858a76b5ac9975dfc13'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:37.458948 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8131ce661594858a76b5ac9975dfc13'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:37.467287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8131ce661594858a76b5ac9975dfc13'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:37.558091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1446/2872] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:46:37 2022] DELETE /identity/v3/users/b8131ce661594858a76b5ac9975dfc13 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:46:38.003186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:38.004739 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:38.021517 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3d5af-9c6e-4b9b-870a-b62d24a6ea12 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:38.049997 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:38.094703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:38.095349 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:38.095663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:38.095937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] PATH_INFO: `/v3/projects/55d9566621164dc38c674c966170ecad` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:38.097083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d9566621164dc38c674c966170ecad)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:38.099181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:38.241331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d9566621164dc38c674c966170ecad', 'request_id': 'req-8a0565f5-5974-44cc-8aa9-5748a822129b'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:38.252582 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d9566621164dc38c674c966170ecad', 'request_id': 'req-8a0565f5-5974-44cc-8aa9-5748a822129b'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:38.258991 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d9566621164dc38c674c966170ecad', 'request_id': 'req-8a0565f5-5974-44cc-8aa9-5748a822129b'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:38.340117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] The token cache is being invalidate because project 55d9566621164dc38c674c966170ecad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:46:38.340414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:38.341078 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:38.342647 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1427/2873] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:46:38 2022] DELETE /identity/v3/projects/55d9566621164dc38c674c966170ecad => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:38.347169 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:38.348792 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:38.363204 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e17ced-be39-4521-9a96-e8943a95458d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:38.401319 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:38.427377 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41dc97-944f-49d8-9b43-fa2255cf1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:38.428114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41dc97-944f-49d8-9b43-fa2255cf1cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:38.428393 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41dc97-944f-49d8-9b43-fa2255cf1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:38.428678 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41dc97-944f-49d8-9b43-fa2255cf1cd1 admin admin] PATH_INFO: `/v3/users/e30aaca9482d45428637b74da41d2a88` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:38.429899 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41dc97-944f-49d8-9b43-fa2255cf1cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e30aaca9482d45428637b74da41d2a88)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:38.432629 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41dc97-944f-49d8-9b43-fa2255cf1cd1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:38.644748 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ee41dc97-944f-49d8-9b43-fa2255cf1cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e30aaca9482d45428637b74da41d2a88'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:38.658909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ee41dc97-944f-49d8-9b43-fa2255cf1cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e30aaca9482d45428637b74da41d2a88'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:38.659741 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ee41dc97-944f-49d8-9b43-fa2255cf1cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e30aaca9482d45428637b74da41d2a88'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:38.660380 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ee41dc97-944f-49d8-9b43-fa2255cf1cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e30aaca9482d45428637b74da41d2a88'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:38.672026 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ee41dc97-944f-49d8-9b43-fa2255cf1cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e30aaca9482d45428637b74da41d2a88'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:38.851797 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1447/2874] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:46:38 2022] DELETE /identity/v3/users/e30aaca9482d45428637b74da41d2a88 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:39.337671 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:39.340173 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:39.359843 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0565f5-5974-44cc-8aa9-5748a822129b admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:39.440546 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952edac0-60bd-4171-8462-c969abdae917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:39.441656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952edac0-60bd-4171-8462-c969abdae917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:39.441656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952edac0-60bd-4171-8462-c969abdae917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:39.441953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952edac0-60bd-4171-8462-c969abdae917 admin admin] PATH_INFO: `/v3/projects/217a6d56380845b891733a6dc4933712` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:39.443250 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952edac0-60bd-4171-8462-c969abdae917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217a6d56380845b891733a6dc4933712)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:39.445198 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952edac0-60bd-4171-8462-c969abdae917 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:39.605288 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-952edac0-60bd-4171-8462-c969abdae917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217a6d56380845b891733a6dc4933712', 'request_id': 'req-952edac0-60bd-4171-8462-c969abdae917'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:39.611902 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-952edac0-60bd-4171-8462-c969abdae917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217a6d56380845b891733a6dc4933712', 'request_id': 'req-952edac0-60bd-4171-8462-c969abdae917'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:39.613300 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:39.618608 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-952edac0-60bd-4171-8462-c969abdae917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217a6d56380845b891733a6dc4933712', 'request_id': 'req-952edac0-60bd-4171-8462-c969abdae917'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:39.722807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-952edac0-60bd-4171-8462-c969abdae917 admin admin] The token cache is being invalidate because project 217a6d56380845b891733a6dc4933712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:46:39.723377 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-952edac0-60bd-4171-8462-c969abdae917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:39.724251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-952edac0-60bd-4171-8462-c969abdae917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:39.726170 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1428/2875] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:46:39 2022] DELETE /identity/v3/projects/217a6d56380845b891733a6dc4933712 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:46:39.733143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904a225-5b82-416a-bf50-6c346a2353df None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:39.733725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904a225-5b82-416a-bf50-6c346a2353df None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:39.733725 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904a225-5b82-416a-bf50-6c346a2353df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:39.756811 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5904a225-5b82-416a-bf50-6c346a2353df None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:39.758083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5904a225-5b82-416a-bf50-6c346a2353df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:39.823638 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1448/2876] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:39.832422 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f18a5-f08e-4b47-9027-388ead4393b8 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:39.832693 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f18a5-f08e-4b47-9027-388ead4393b8 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:39.832970 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f18a5-f08e-4b47-9027-388ead4393b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:39.858286 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-b73f18a5-f08e-4b47-9027-388ead4393b8 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:39.859428 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-b73f18a5-f08e-4b47-9027-388ead4393b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:39.868244 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1429/2877] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:46:39.872996 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904a225-5b82-416a-bf50-6c346a2353df None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:39.882934 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904a225-5b82-416a-bf50-6c346a2353df None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:39.888200 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab41f6b-5b11-4d6c-879a-5455420d19ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:39.888813 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab41f6b-5b11-4d6c-879a-5455420d19ff admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:39.889089 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab41f6b-5b11-4d6c-879a-5455420d19ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:39.889358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab41f6b-5b11-4d6c-879a-5455420d19ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:39.890011 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab41f6b-5b11-4d6c-879a-5455420d19ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:46:39.890609 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab41f6b-5b11-4d6c-879a-5455420d19ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:39.892239 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab41f6b-5b11-4d6c-879a-5455420d19ff admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:39.906079 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1449/2878] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:46:39.911266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f18a5-f08e-4b47-9027-388ead4393b8 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:39.921023 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f18a5-f08e-4b47-9027-388ead4393b8 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:39.925721 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea5a81-b107-48ec-bfa1-1625e0012691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:39.926359 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5a81-b107-48ec-bfa1-1625e0012691 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:39.926645 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5a81-b107-48ec-bfa1-1625e0012691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:39.926918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5a81-b107-48ec-bfa1-1625e0012691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:39.927564 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea5a81-b107-48ec-bfa1-1625e0012691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:39.929506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea5a81-b107-48ec-bfa1-1625e0012691 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:40.069371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1430/2879] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:46:39 2022] POST /identity/v3/projects => generated 407 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:40.074542 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab41f6b-5b11-4d6c-879a-5455420d19ff admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:40.085953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab41f6b-5b11-4d6c-879a-5455420d19ff admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:40.133470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:40.156963 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4112a6-7717-4249-a925-9d491f0a42dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:40.157981 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4112a6-7717-4249-a925-9d491f0a42dd admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:40.158501 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4112a6-7717-4249-a925-9d491f0a42dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:40.158988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4112a6-7717-4249-a925-9d491f0a42dd admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:40.160116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4112a6-7717-4249-a925-9d491f0a42dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:40.163233 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4112a6-7717-4249-a925-9d491f0a42dd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:40.309358 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1450/2880] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:46:40 2022] POST /identity/v3/users => generated 304 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:40.314870 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea5a81-b107-48ec-bfa1-1625e0012691 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:40.326680 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea5a81-b107-48ec-bfa1-1625e0012691 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:40.331617 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fe896-42ac-4975-9472-eb0e24741905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:40.332117 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe896-42ac-4975-9472-eb0e24741905 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:40.332362 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe896-42ac-4975-9472-eb0e24741905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:40.332838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe896-42ac-4975-9472-eb0e24741905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:40.333500 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fe896-42ac-4975-9472-eb0e24741905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:40.335264 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fe896-42ac-4975-9472-eb0e24741905 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:40.347032 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1431/2881] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:46:40.351329 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4112a6-7717-4249-a925-9d491f0a42dd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:40.362688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4112a6-7717-4249-a925-9d491f0a42dd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:40.367495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a53c89-f207-4c2a-8549-85678fe5d712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:40.368114 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a53c89-f207-4c2a-8549-85678fe5d712 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:40.368397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a53c89-f207-4c2a-8549-85678fe5d712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:40.368715 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a53c89-f207-4c2a-8549-85678fe5d712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:40.369592 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a53c89-f207-4c2a-8549-85678fe5d712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:40.371244 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a53c89-f207-4c2a-8549-85678fe5d712 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:40.382907 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1451/2882] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:40.393365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fe896-42ac-4975-9472-eb0e24741905 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:40.404795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fe896-42ac-4975-9472-eb0e24741905 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:40.410585 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a890b72-8f75-439e-b77a-1821ae7e7338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:40.411447 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890b72-8f75-439e-b77a-1821ae7e7338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:40.411920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890b72-8f75-439e-b77a-1821ae7e7338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:40.412302 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890b72-8f75-439e-b77a-1821ae7e7338 admin admin] PATH_INFO: `/v3/projects/26357a29aa244c08a10097914ff1fd8c/users/a7f8c355aec44011af86dba5cd869f75/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:40.432246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a890b72-8f75-439e-b77a-1821ae7e7338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26357a29aa244c08a10097914ff1fd8c, user_id=a7f8c355aec44011af86dba5cd869f75, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:40.435001 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a890b72-8f75-439e-b77a-1821ae7e7338 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:40.513093 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1432/2883] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:40 2022] PUT /identity/v3/projects/26357a29aa244c08a10097914ff1fd8c/users/a7f8c355aec44011af86dba5cd869f75/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:40.526763 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ab01-1203-4784-9dbf-dc970bd3371c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:40.527028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ab01-1203-4784-9dbf-dc970bd3371c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:40.527300 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ab01-1203-4784-9dbf-dc970bd3371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:40.559364 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a616ab01-1203-4784-9dbf-dc970bd3371c None None] MFA Rules not processed for user `a7f8c355aec44011af86dba5cd869f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:40.560604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a616ab01-1203-4784-9dbf-dc970bd3371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:40.635747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1452/2884] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:40 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:46:40.641002 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a890b72-8f75-439e-b77a-1821ae7e7338 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:40.717292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a890b72-8f75-439e-b77a-1821ae7e7338 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:40.722246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4dd61-513d-4457-b7c8-28b1e3b5a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:40.728552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4dd61-513d-4457-b7c8-28b1e3b5a4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:40.728552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4dd61-513d-4457-b7c8-28b1e3b5a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:40.728552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4dd61-513d-4457-b7c8-28b1e3b5a4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:40.728552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4dd61-513d-4457-b7c8-28b1e3b5a4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:40.728552 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4dd61-513d-4457-b7c8-28b1e3b5a4b8 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:40.814795 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1433/2885] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:46:40 2022] POST /identity/v3/projects => generated 407 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:40.819807 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616ab01-1203-4784-9dbf-dc970bd3371c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:40.838349 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616ab01-1203-4784-9dbf-dc970bd3371c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:40.921950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f769d65-6e66-43a7-9f85-6f32f0e6ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:40.922620 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f769d65-6e66-43a7-9f85-6f32f0e6ce80 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:40.922900 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f769d65-6e66-43a7-9f85-6f32f0e6ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:40.923174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f769d65-6e66-43a7-9f85-6f32f0e6ce80 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:40.923834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f769d65-6e66-43a7-9f85-6f32f0e6ce80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:40.925857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f769d65-6e66-43a7-9f85-6f32f0e6ce80 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:41.050070 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1453/2886] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:46:40 2022] POST /identity/v3/users => generated 310 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:41.054331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4dd61-513d-4457-b7c8-28b1e3b5a4b8 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:41.065898 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4dd61-513d-4457-b7c8-28b1e3b5a4b8 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:41.071022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831ff64-562e-4876-9deb-f45093192e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:41.071651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831ff64-562e-4876-9deb-f45093192e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:41.072676 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831ff64-562e-4876-9deb-f45093192e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:41.073035 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831ff64-562e-4876-9deb-f45093192e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:41.073745 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831ff64-562e-4876-9deb-f45093192e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:41.075427 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831ff64-562e-4876-9deb-f45093192e4c admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:41.091238 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1434/2887] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:41.096477 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f769d65-6e66-43a7-9f85-6f32f0e6ce80 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:41.113729 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f769d65-6e66-43a7-9f85-6f32f0e6ce80 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:41.119519 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76386ed9-4927-4f66-8b83-67e8d913f20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:41.120499 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76386ed9-4927-4f66-8b83-67e8d913f20b admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:41.120779 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76386ed9-4927-4f66-8b83-67e8d913f20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:41.121069 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76386ed9-4927-4f66-8b83-67e8d913f20b admin admin] PATH_INFO: `/v3/projects/9736723f780e42648b72419b409eb2ce/users/67377ae3ee7a49d88503686655a7d7ef/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:41.139789 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76386ed9-4927-4f66-8b83-67e8d913f20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9736723f780e42648b72419b409eb2ce, user_id=67377ae3ee7a49d88503686655a7d7ef, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:41.143027 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76386ed9-4927-4f66-8b83-67e8d913f20b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:41.247419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1454/2888] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:41 2022] PUT /identity/v3/projects/9736723f780e42648b72419b409eb2ce/users/67377ae3ee7a49d88503686655a7d7ef/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:41.252025 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831ff64-562e-4876-9deb-f45093192e4c admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:41.264615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831ff64-562e-4876-9deb-f45093192e4c admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:41.345350 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:41.363625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e885a2a-64ca-4de8-8984-7613d1539bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:41.363625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e885a2a-64ca-4de8-8984-7613d1539bab admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:41.363625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e885a2a-64ca-4de8-8984-7613d1539bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:41.363625 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e885a2a-64ca-4de8-8984-7613d1539bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:41.364485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e885a2a-64ca-4de8-8984-7613d1539bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:41.364485 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e885a2a-64ca-4de8-8984-7613d1539bab admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:41.374951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1435/2889] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:41.379365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76386ed9-4927-4f66-8b83-67e8d913f20b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:41.392032 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76386ed9-4927-4f66-8b83-67e8d913f20b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:41.398841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727827f-314b-45cc-be3a-96c270c05a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:41.398841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727827f-314b-45cc-be3a-96c270c05a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:41.398841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727827f-314b-45cc-be3a-96c270c05a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:41.398841 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727827f-314b-45cc-be3a-96c270c05a09 admin admin] PATH_INFO: `/v3/projects/9736723f780e42648b72419b409eb2ce/users/67377ae3ee7a49d88503686655a7d7ef/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:41.401066 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727827f-314b-45cc-be3a-96c270c05a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9736723f780e42648b72419b409eb2ce, user_id=67377ae3ee7a49d88503686655a7d7ef, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:41.403787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727827f-314b-45cc-be3a-96c270c05a09 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:41.415314 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1455/2890] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:41 2022] PUT /identity/v3/projects/9736723f780e42648b72419b409eb2ce/users/67377ae3ee7a49d88503686655a7d7ef/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:46:41.427493 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c6aa5-095b-40c5-8a7e-794a3e0aaebf None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:41.427782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c6aa5-095b-40c5-8a7e-794a3e0aaebf None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:41.428063 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c6aa5-095b-40c5-8a7e-794a3e0aaebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:41.460391 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-944c6aa5-095b-40c5-8a7e-794a3e0aaebf None None] MFA Rules not processed for user `67377ae3ee7a49d88503686655a7d7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:41.461629 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-944c6aa5-095b-40c5-8a7e-794a3e0aaebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:41.538145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1436/2891] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:41 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:46:41.550545 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727827f-314b-45cc-be3a-96c270c05a09 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:41.552316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b727827f-314b-45cc-be3a-96c270c05a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:41.559124 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:41.618099 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727827f-314b-45cc-be3a-96c270c05a09 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:41.623062 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5a85e-f8ce-45c3-a649-6f58613dfe80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:41.623670 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5a85e-f8ce-45c3-a649-6f58613dfe80 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:41.623980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5a85e-f8ce-45c3-a649-6f58613dfe80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:41.624254 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5a85e-f8ce-45c3-a649-6f58613dfe80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:41.634585 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5a85e-f8ce-45c3-a649-6f58613dfe80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:41.636219 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5a85e-f8ce-45c3-a649-6f58613dfe80 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:41.647513 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1456/2892] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:41 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:46:42.061223 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c6aa5-095b-40c5-8a7e-794a3e0aaebf None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:42.070961 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c6aa5-095b-40c5-8a7e-794a3e0aaebf None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:42.074613 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c06050-6955-4b10-ab0e-213a8de9466e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:42.075247 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c06050-6955-4b10-ab0e-213a8de9466e service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:42.075487 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c06050-6955-4b10-ab0e-213a8de9466e service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:42.075757 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c06050-6955-4b10-ab0e-213a8de9466e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:42.138290 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c06050-6955-4b10-ab0e-213a8de9466e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:42.139773 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c06050-6955-4b10-ab0e-213a8de9466e service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:42.149371 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1437/2893] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:42 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:46:49.674894 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5a85e-f8ce-45c3-a649-6f58613dfe80 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:49.738215 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5a85e-f8ce-45c3-a649-6f58613dfe80 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:49.742733 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:49.744379 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:49.744379 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:49.744379 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] PATH_INFO: `/v3/users/a7f8c355aec44011af86dba5cd869f75` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:49.745240 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f8c355aec44011af86dba5cd869f75)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:49.747481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:49.946287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f8c355aec44011af86dba5cd869f75'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:49.959366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f8c355aec44011af86dba5cd869f75'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:49.960143 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f8c355aec44011af86dba5cd869f75'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:49.960749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f8c355aec44011af86dba5cd869f75'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:49.968915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f8c355aec44011af86dba5cd869f75'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:50.051459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1457/2894] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:46:49 2022] DELETE /identity/v3/users/a7f8c355aec44011af86dba5cd869f75 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:50.056744 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d2b1-eea5-4aa3-ac0e-835550d89cb1 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:50.057297 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d2b1-eea5-4aa3-ac0e-835550d89cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:50.057412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d2b1-eea5-4aa3-ac0e-835550d89cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:50.086309 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-acd3d2b1-eea5-4aa3-ac0e-835550d89cb1 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:50.087690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-acd3d2b1-eea5-4aa3-ac0e-835550d89cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:50.143384 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:50.171331 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1438/2895] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:50.182073 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:50.183562 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:50.213912 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:50.262747 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6673b-aa42-4893-b4d1-7c537cb34ee8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:50.266782 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033bff8-6d3e-431e-87c8-6454366bbf52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:50.267390 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033bff8-6d3e-431e-87c8-6454366bbf52 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:50.267668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033bff8-6d3e-431e-87c8-6454366bbf52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:50.267937 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033bff8-6d3e-431e-87c8-6454366bbf52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:50.277487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033bff8-6d3e-431e-87c8-6454366bbf52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:50.279015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033bff8-6d3e-431e-87c8-6454366bbf52 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:50.288826 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1458/2896] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:46:50.748045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3d2b1-eea5-4aa3-ac0e-835550d89cb1 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:50.749519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-acd3d2b1-eea5-4aa3-ac0e-835550d89cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:50.763218 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3d2b1-eea5-4aa3-ac0e-835550d89cb1 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:50.768274 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:50.768918 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:50.769203 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:50.769501 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] PATH_INFO: `/v3/projects/26357a29aa244c08a10097914ff1fd8c` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:50.770886 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26357a29aa244c08a10097914ff1fd8c)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:50.772873 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:50.865258 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26357a29aa244c08a10097914ff1fd8c', 'request_id': 'req-a1b7a6aa-125c-4e82-999f-dc606a987990'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:50.872860 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26357a29aa244c08a10097914ff1fd8c', 'request_id': 'req-a1b7a6aa-125c-4e82-999f-dc606a987990'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:50.878670 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26357a29aa244c08a10097914ff1fd8c', 'request_id': 'req-a1b7a6aa-125c-4e82-999f-dc606a987990'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:50.944591 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] The token cache is being invalidate because project 26357a29aa244c08a10097914ff1fd8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:46:50.944877 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:50.945525 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:50.948037 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1439/2897] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:46:50 2022] DELETE /identity/v3/projects/26357a29aa244c08a10097914ff1fd8c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:50.952030 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033bff8-6d3e-431e-87c8-6454366bbf52 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:50.961912 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033bff8-6d3e-431e-87c8-6454366bbf52 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:51.023832 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af88bd-fb03-40c8-951a-f4a0f9af6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:51.024419 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af88bd-fb03-40c8-951a-f4a0f9af6d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:51.024938 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af88bd-fb03-40c8-951a-f4a0f9af6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:51.025228 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af88bd-fb03-40c8-951a-f4a0f9af6d8b admin admin] PATH_INFO: `/v3/users/67377ae3ee7a49d88503686655a7d7ef` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:51.026399 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af88bd-fb03-40c8-951a-f4a0f9af6d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=67377ae3ee7a49d88503686655a7d7ef)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:51.028318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af88bd-fb03-40c8-951a-f4a0f9af6d8b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:51.243013 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-85af88bd-fb03-40c8-951a-f4a0f9af6d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67377ae3ee7a49d88503686655a7d7ef'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:51.255675 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-85af88bd-fb03-40c8-951a-f4a0f9af6d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67377ae3ee7a49d88503686655a7d7ef'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:51.256374 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-85af88bd-fb03-40c8-951a-f4a0f9af6d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67377ae3ee7a49d88503686655a7d7ef'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:51.256988 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-85af88bd-fb03-40c8-951a-f4a0f9af6d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67377ae3ee7a49d88503686655a7d7ef'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:51.265023 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-85af88bd-fb03-40c8-951a-f4a0f9af6d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67377ae3ee7a49d88503686655a7d7ef'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:51.362151 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1459/2898] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:46:50 2022] DELETE /identity/v3/users/67377ae3ee7a49d88503686655a7d7ef => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:51.799201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:51.800787 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:51.814081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7a6aa-125c-4e82-999f-dc606a987990 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:51.876635 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ac450-fd80-4874-b659-2bb4be07e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:51.877266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ac450-fd80-4874-b659-2bb4be07e259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:51.877547 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ac450-fd80-4874-b659-2bb4be07e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:51.877819 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ac450-fd80-4874-b659-2bb4be07e259 admin admin] PATH_INFO: `/v3/projects/9736723f780e42648b72419b409eb2ce` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:51.879013 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ac450-fd80-4874-b659-2bb4be07e259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9736723f780e42648b72419b409eb2ce)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:51.880914 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ac450-fd80-4874-b659-2bb4be07e259 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:51.995642 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-947ac450-fd80-4874-b659-2bb4be07e259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9736723f780e42648b72419b409eb2ce', 'request_id': 'req-947ac450-fd80-4874-b659-2bb4be07e259'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:52.001746 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-947ac450-fd80-4874-b659-2bb4be07e259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9736723f780e42648b72419b409eb2ce', 'request_id': 'req-947ac450-fd80-4874-b659-2bb4be07e259'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:52.007419 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-947ac450-fd80-4874-b659-2bb4be07e259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9736723f780e42648b72419b409eb2ce', 'request_id': 'req-947ac450-fd80-4874-b659-2bb4be07e259'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:52.010347 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:52.098959 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-947ac450-fd80-4874-b659-2bb4be07e259 admin admin] The token cache is being invalidate because project 9736723f780e42648b72419b409eb2ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:46:52.099249 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-947ac450-fd80-4874-b659-2bb4be07e259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:52.099883 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-947ac450-fd80-4874-b659-2bb4be07e259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:52.101796 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1440/2899] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:46:51 2022] DELETE /identity/v3/projects/9736723f780e42648b72419b409eb2ce => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:52.107755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a29464-5846-4ae3-91dc-1e0b440f9a1c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:52.108248 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a29464-5846-4ae3-91dc-1e0b440f9a1c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:52.108368 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a29464-5846-4ae3-91dc-1e0b440f9a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:52.129272 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-68a29464-5846-4ae3-91dc-1e0b440f9a1c None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:52.130527 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-68a29464-5846-4ae3-91dc-1e0b440f9a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:52.156149 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:52.198141 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1460/2900] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:46:52.207389 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa94075-9c1a-4e94-9fcb-ba7d2e6faffb None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:52.207675 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa94075-9c1a-4e94-9fcb-ba7d2e6faffb None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:52.207951 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa94075-9c1a-4e94-9fcb-ba7d2e6faffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:52.229919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-2fa94075-9c1a-4e94-9fcb-ba7d2e6faffb None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:52.231181 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-2fa94075-9c1a-4e94-9fcb-ba7d2e6faffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:52.239442 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1441/2901] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:52.244959 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a29464-5846-4ae3-91dc-1e0b440f9a1c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:52.255688 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a29464-5846-4ae3-91dc-1e0b440f9a1c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:52.261307 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb821e-746c-4d1f-98f3-05b611659bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:52.261977 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb821e-746c-4d1f-98f3-05b611659bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:52.262424 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb821e-746c-4d1f-98f3-05b611659bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:52.262761 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb821e-746c-4d1f-98f3-05b611659bd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:52.263490 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb821e-746c-4d1f-98f3-05b611659bd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:46:52.263818 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb821e-746c-4d1f-98f3-05b611659bd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:52.265723 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb821e-746c-4d1f-98f3-05b611659bd3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:52.278902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1461/2902] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:46:52.283649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa94075-9c1a-4e94-9fcb-ba7d2e6faffb None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:52.294612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa94075-9c1a-4e94-9fcb-ba7d2e6faffb None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:52.299341 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be2de9-c594-4a5e-9cc8-a0e979412c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:52.299937 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be2de9-c594-4a5e-9cc8-a0e979412c6a admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:52.300206 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be2de9-c594-4a5e-9cc8-a0e979412c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:52.300469 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be2de9-c594-4a5e-9cc8-a0e979412c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:52.301100 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be2de9-c594-4a5e-9cc8-a0e979412c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:52.303028 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be2de9-c594-4a5e-9cc8-a0e979412c6a admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:52.402835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1442/2903] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:46:52 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:52.407221 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb821e-746c-4d1f-98f3-05b611659bd3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:52.417487 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb821e-746c-4d1f-98f3-05b611659bd3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:52.475384 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57314a46-abb9-44c1-ad9f-e0112b21ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:52.476038 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57314a46-abb9-44c1-ad9f-e0112b21ce3b admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:52.476316 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57314a46-abb9-44c1-ad9f-e0112b21ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:52.476583 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57314a46-abb9-44c1-ad9f-e0112b21ce3b admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:52.477222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57314a46-abb9-44c1-ad9f-e0112b21ce3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:52.479341 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57314a46-abb9-44c1-ad9f-e0112b21ce3b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:52.592262 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1462/2904] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:46:52 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:52.596123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be2de9-c594-4a5e-9cc8-a0e979412c6a admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:52.607266 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be2de9-c594-4a5e-9cc8-a0e979412c6a admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:52.612160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10208d80-7139-4da4-98d7-a5812f1f07de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:52.612760 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10208d80-7139-4da4-98d7-a5812f1f07de admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:52.613039 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10208d80-7139-4da4-98d7-a5812f1f07de admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:52.613312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10208d80-7139-4da4-98d7-a5812f1f07de admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:52.613953 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10208d80-7139-4da4-98d7-a5812f1f07de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:52.615663 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10208d80-7139-4da4-98d7-a5812f1f07de admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:52.626770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1443/2905] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:52.630889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57314a46-abb9-44c1-ad9f-e0112b21ce3b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:52.642086 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57314a46-abb9-44c1-ad9f-e0112b21ce3b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:52.646765 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1565a-4ba7-4cad-82c6-d822e2d62de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:52.647360 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1565a-4ba7-4cad-82c6-d822e2d62de6 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:52.647633 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1565a-4ba7-4cad-82c6-d822e2d62de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:52.648021 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1565a-4ba7-4cad-82c6-d822e2d62de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:52.648668 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1565a-4ba7-4cad-82c6-d822e2d62de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:52.650286 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1565a-4ba7-4cad-82c6-d822e2d62de6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:52.661056 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1463/2906] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:52.666153 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10208d80-7139-4da4-98d7-a5812f1f07de admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:52.679871 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10208d80-7139-4da4-98d7-a5812f1f07de admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:52.685120 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda2b1a-9084-472f-8938-30cbf6f72217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:52.685779 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2b1a-9084-472f-8938-30cbf6f72217 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:52.686057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2b1a-9084-472f-8938-30cbf6f72217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:52.686365 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2b1a-9084-472f-8938-30cbf6f72217 admin admin] PATH_INFO: `/v3/projects/670c93fa23094f6b8009426397ddb1f7/users/ad9dc3cafd03417083281d96a0a71c94/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:52.702190 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda2b1a-9084-472f-8938-30cbf6f72217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670c93fa23094f6b8009426397ddb1f7, user_id=ad9dc3cafd03417083281d96a0a71c94, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:52.704848 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda2b1a-9084-472f-8938-30cbf6f72217 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:52.788907 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1444/2907] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:52 2022] PUT /identity/v3/projects/670c93fa23094f6b8009426397ddb1f7/users/ad9dc3cafd03417083281d96a0a71c94/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:52.800192 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0b2cd-dcf3-4085-8c79-059dc38cc5d5 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:52.800557 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0b2cd-dcf3-4085-8c79-059dc38cc5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:52.801036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0b2cd-dcf3-4085-8c79-059dc38cc5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:52.831083 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9be0b2cd-dcf3-4085-8c79-059dc38cc5d5 None None] MFA Rules not processed for user `ad9dc3cafd03417083281d96a0a71c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:52.832318 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9be0b2cd-dcf3-4085-8c79-059dc38cc5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:52.903012 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1464/2908] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:52.908067 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda2b1a-9084-472f-8938-30cbf6f72217 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:52.971148 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda2b1a-9084-472f-8938-30cbf6f72217 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:52.975888 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb8125-d225-4f6b-ba7c-0a6b6ae878c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:52.976529 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb8125-d225-4f6b-ba7c-0a6b6ae878c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:52.976803 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb8125-d225-4f6b-ba7c-0a6b6ae878c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:52.977122 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb8125-d225-4f6b-ba7c-0a6b6ae878c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:52.978388 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb8125-d225-4f6b-ba7c-0a6b6ae878c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:52.980476 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb8125-d225-4f6b-ba7c-0a6b6ae878c9 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:53.087448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1445/2909] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:46:52 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:53.091931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0b2cd-dcf3-4085-8c79-059dc38cc5d5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:53.103421 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0b2cd-dcf3-4085-8c79-059dc38cc5d5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:53.122748 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:53.163091 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a2dfb-7c02-4d13-a360-de36199ad597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:53.163617 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a2dfb-7c02-4d13-a360-de36199ad597 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:53.163931 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a2dfb-7c02-4d13-a360-de36199ad597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:53.164355 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a2dfb-7c02-4d13-a360-de36199ad597 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:53.165808 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a2dfb-7c02-4d13-a360-de36199ad597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:53.168062 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a2dfb-7c02-4d13-a360-de36199ad597 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:53.299753 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1465/2910] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:46:53 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:53.303627 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb8125-d225-4f6b-ba7c-0a6b6ae878c9 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:53.315092 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb8125-d225-4f6b-ba7c-0a6b6ae878c9 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:53.323372 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62299d-1b97-4349-a3ff-a72b1fd28e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:53.323991 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62299d-1b97-4349-a3ff-a72b1fd28e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:53.324273 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62299d-1b97-4349-a3ff-a72b1fd28e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:53.324545 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62299d-1b97-4349-a3ff-a72b1fd28e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:53.325196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62299d-1b97-4349-a3ff-a72b1fd28e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:53.326912 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62299d-1b97-4349-a3ff-a72b1fd28e1d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:53.338151 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1446/2911] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:53.342788 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a2dfb-7c02-4d13-a360-de36199ad597 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:53.353720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a2dfb-7c02-4d13-a360-de36199ad597 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:53.360470 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b5d6-187f-47b1-9c02-cef0636f9a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:53.361181 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b5d6-187f-47b1-9c02-cef0636f9a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:53.361474 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b5d6-187f-47b1-9c02-cef0636f9a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:53.361732 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b5d6-187f-47b1-9c02-cef0636f9a3d admin admin] PATH_INFO: `/v3/projects/5cd2ff2ba2d94dcb9d7fccafff42c13e/users/1f7c57c5d2f14b67b49dcb60abf5df83/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:53.377889 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02b5d6-187f-47b1-9c02-cef0636f9a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd2ff2ba2d94dcb9d7fccafff42c13e, user_id=1f7c57c5d2f14b67b49dcb60abf5df83, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:53.380558 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02b5d6-187f-47b1-9c02-cef0636f9a3d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:53.486285 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1466/2912] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:53 2022] PUT /identity/v3/projects/5cd2ff2ba2d94dcb9d7fccafff42c13e/users/1f7c57c5d2f14b67b49dcb60abf5df83/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:53.490495 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62299d-1b97-4349-a3ff-a72b1fd28e1d admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:53.501135 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62299d-1b97-4349-a3ff-a72b1fd28e1d admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:53.564788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483f039-8551-4acb-bdf8-5484948928da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:53.565392 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483f039-8551-4acb-bdf8-5484948928da admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:53.565667 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483f039-8551-4acb-bdf8-5484948928da admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:53.565941 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483f039-8551-4acb-bdf8-5484948928da admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:53.566643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483f039-8551-4acb-bdf8-5484948928da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:53.568223 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483f039-8551-4acb-bdf8-5484948928da admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:53.574353 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:53.579456 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1447/2913] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:53.583650 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b5d6-187f-47b1-9c02-cef0636f9a3d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:53.595569 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b5d6-187f-47b1-9c02-cef0636f9a3d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:53.620155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cda785-89d2-4882-aa18-ba9507bf3c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:53.620155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda785-89d2-4882-aa18-ba9507bf3c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:53.620155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda785-89d2-4882-aa18-ba9507bf3c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:53.620155 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda785-89d2-4882-aa18-ba9507bf3c7e admin admin] PATH_INFO: `/v3/projects/5cd2ff2ba2d94dcb9d7fccafff42c13e/users/1f7c57c5d2f14b67b49dcb60abf5df83/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:53.620730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cda785-89d2-4882-aa18-ba9507bf3c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd2ff2ba2d94dcb9d7fccafff42c13e, user_id=1f7c57c5d2f14b67b49dcb60abf5df83, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:53.620730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cda785-89d2-4882-aa18-ba9507bf3c7e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:53.620730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1467/2914] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:53 2022] PUT /identity/v3/projects/5cd2ff2ba2d94dcb9d7fccafff42c13e/users/1f7c57c5d2f14b67b49dcb60abf5df83/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:53.630802 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d50a5-7721-42f7-ae31-0956bf76bfbf None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:53.631186 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d50a5-7721-42f7-ae31-0956bf76bfbf None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:53.631471 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d50a5-7721-42f7-ae31-0956bf76bfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:53.662516 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-3e9d50a5-7721-42f7-ae31-0956bf76bfbf None None] MFA Rules not processed for user `1f7c57c5d2f14b67b49dcb60abf5df83`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:53.664143 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-3e9d50a5-7721-42f7-ae31-0956bf76bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:53.739723 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1448/2915] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:53.752865 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cda785-89d2-4882-aa18-ba9507bf3c7e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:53.759269 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-71cda785-89d2-4882-aa18-ba9507bf3c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:53.831950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cda785-89d2-4882-aa18-ba9507bf3c7e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:53.836360 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191425b8-4ebe-4d41-b84c-1f273eb893c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:53.836979 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191425b8-4ebe-4d41-b84c-1f273eb893c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:53.837259 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191425b8-4ebe-4d41-b84c-1f273eb893c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:53.837530 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191425b8-4ebe-4d41-b84c-1f273eb893c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:53.847611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191425b8-4ebe-4d41-b84c-1f273eb893c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:53.853830 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191425b8-4ebe-4d41-b84c-1f273eb893c0 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:53.859886 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1468/2916] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:46:54.048562 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d50a5-7721-42f7-ae31-0956bf76bfbf None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:54.061673 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d50a5-7721-42f7-ae31-0956bf76bfbf None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:54.065348 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d2984-b038-451b-a374-8a1213ed36ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:54.065973 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d2984-b038-451b-a374-8a1213ed36ee service cinder] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:54.066301 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d2984-b038-451b-a374-8a1213ed36ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:54.066578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d2984-b038-451b-a374-8a1213ed36ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:54.131983 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d2984-b038-451b-a374-8a1213ed36ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:54.133448 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d2984-b038-451b-a374-8a1213ed36ee service cinder] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:54.144704 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1449/2917] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:46:54.754293 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191425b8-4ebe-4d41-b84c-1f273eb893c0 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:54.818497 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191425b8-4ebe-4d41-b84c-1f273eb893c0 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:54.824250 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:54.824819 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:54.825096 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:54.825365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] PATH_INFO: `/v3/users/ad9dc3cafd03417083281d96a0a71c94` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:54.826532 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9dc3cafd03417083281d96a0a71c94)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:54.828442 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:54.850263 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:55.008357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9dc3cafd03417083281d96a0a71c94'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:55.020338 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9dc3cafd03417083281d96a0a71c94'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:55.021015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9dc3cafd03417083281d96a0a71c94'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:55.021620 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9dc3cafd03417083281d96a0a71c94'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:55.028353 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9dc3cafd03417083281d96a0a71c94'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:55.099504 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1469/2918] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:46:54 2022] DELETE /identity/v3/users/ad9dc3cafd03417083281d96a0a71c94 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:55.104615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c424e-e2ca-42f7-b2ad-c9de6f619739 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:55.105118 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c424e-e2ca-42f7-b2ad-c9de6f619739 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:55.105228 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c424e-e2ca-42f7-b2ad-c9de6f619739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:55.125059 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-352c424e-e2ca-42f7-b2ad-c9de6f619739 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:55.126319 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-352c424e-e2ca-42f7-b2ad-c9de6f619739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:55.188022 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1450/2919] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:55.198397 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:55.200112 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:55.266210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837905d-4b01-49bf-b0d6-9157fec1deeb admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:55.270116 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7544597-26f8-457d-b818-2e1085328ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:55.270755 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7544597-26f8-457d-b818-2e1085328ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:55.271036 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7544597-26f8-457d-b818-2e1085328ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:55.271310 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7544597-26f8-457d-b818-2e1085328ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:55.282455 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7544597-26f8-457d-b818-2e1085328ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:55.283943 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7544597-26f8-457d-b818-2e1085328ab9 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:55.295386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1470/2920] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:46:55.718446 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c424e-e2ca-42f7-b2ad-c9de6f619739 None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:55.721412 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-352c424e-e2ca-42f7-b2ad-c9de6f619739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:55.734291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c424e-e2ca-42f7-b2ad-c9de6f619739 None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:55.739024 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:55.740145 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:55.740813 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:55.741071 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] PATH_INFO: `/v3/projects/670c93fa23094f6b8009426397ddb1f7` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:55.748846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=670c93fa23094f6b8009426397ddb1f7)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:55.748846 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:55.772414 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=100 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:55.870809 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670c93fa23094f6b8009426397ddb1f7', 'request_id': 'req-71650075-f2c0-4445-ada0-57ea34660eca'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:55.877354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670c93fa23094f6b8009426397ddb1f7', 'request_id': 'req-71650075-f2c0-4445-ada0-57ea34660eca'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:55.883705 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670c93fa23094f6b8009426397ddb1f7', 'request_id': 'req-71650075-f2c0-4445-ada0-57ea34660eca'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:55.973464 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] The token cache is being invalidate because project 670c93fa23094f6b8009426397ddb1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:46:55.973694 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:55.974382 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:55.975901 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1451/2921] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:46:55 2022] DELETE /identity/v3/projects/670c93fa23094f6b8009426397ddb1f7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:55.980602 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7544597-26f8-457d-b818-2e1085328ab9 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:55.994276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7544597-26f8-457d-b818-2e1085328ab9 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:56.058547 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d250d-6ee2-4101-a021-ba264d28df84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:56.059174 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d250d-6ee2-4101-a021-ba264d28df84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:56.059452 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d250d-6ee2-4101-a021-ba264d28df84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:56.059719 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d250d-6ee2-4101-a021-ba264d28df84 admin admin] PATH_INFO: `/v3/users/1f7c57c5d2f14b67b49dcb60abf5df83` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:56.060838 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d250d-6ee2-4101-a021-ba264d28df84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7c57c5d2f14b67b49dcb60abf5df83)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:56.062770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d250d-6ee2-4101-a021-ba264d28df84 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:56.258639 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:56.265565 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-583d250d-6ee2-4101-a021-ba264d28df84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7c57c5d2f14b67b49dcb60abf5df83'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:56.277953 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-583d250d-6ee2-4101-a021-ba264d28df84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7c57c5d2f14b67b49dcb60abf5df83'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:56.278805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-583d250d-6ee2-4101-a021-ba264d28df84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7c57c5d2f14b67b49dcb60abf5df83'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:56.279409 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-583d250d-6ee2-4101-a021-ba264d28df84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7c57c5d2f14b67b49dcb60abf5df83'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:56.286376 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-583d250d-6ee2-4101-a021-ba264d28df84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7c57c5d2f14b67b49dcb60abf5df83'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:56.401856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1471/2922] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:46:55 2022] DELETE /identity/v3/users/1f7c57c5d2f14b67b49dcb60abf5df83 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:56.892963 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:56.894524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:56.911239 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71650075-f2c0-4445-ada0-57ea34660eca admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:56.981105 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a2b7b-49ea-4a3c-82df-16aa78a36106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:56.981756 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a2b7b-49ea-4a3c-82df-16aa78a36106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:56.982034 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a2b7b-49ea-4a3c-82df-16aa78a36106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:56.982356 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a2b7b-49ea-4a3c-82df-16aa78a36106 admin admin] PATH_INFO: `/v3/projects/5cd2ff2ba2d94dcb9d7fccafff42c13e` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:56.983577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a2b7b-49ea-4a3c-82df-16aa78a36106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd2ff2ba2d94dcb9d7fccafff42c13e)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:56.985524 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a2b7b-49ea-4a3c-82df-16aa78a36106 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:57.163119 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e34a2b7b-49ea-4a3c-82df-16aa78a36106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd2ff2ba2d94dcb9d7fccafff42c13e', 'request_id': 'req-e34a2b7b-49ea-4a3c-82df-16aa78a36106'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:57.170213 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e34a2b7b-49ea-4a3c-82df-16aa78a36106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd2ff2ba2d94dcb9d7fccafff42c13e', 'request_id': 'req-e34a2b7b-49ea-4a3c-82df-16aa78a36106'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:57.176754 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e34a2b7b-49ea-4a3c-82df-16aa78a36106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd2ff2ba2d94dcb9d7fccafff42c13e', 'request_id': 'req-e34a2b7b-49ea-4a3c-82df-16aa78a36106'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:57.287998 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e34a2b7b-49ea-4a3c-82df-16aa78a36106 admin admin] The token cache is being invalidate because project 5cd2ff2ba2d94dcb9d7fccafff42c13e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:46:57.288287 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e34a2b7b-49ea-4a3c-82df-16aa78a36106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:57.288962 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-e34a2b7b-49ea-4a3c-82df-16aa78a36106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:46:57.291124 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1452/2923] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:46:56 2022] DELETE /identity/v3/projects/5cd2ff2ba2d94dcb9d7fccafff42c13e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:57.297194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0ca8a-9ca7-47c7-aea6-8405aa0b6f40 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:57.298109 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0ca8a-9ca7-47c7-aea6-8405aa0b6f40 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:57.298561 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0ca8a-9ca7-47c7-aea6-8405aa0b6f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:57.320381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d2e0ca8a-9ca7-47c7-aea6-8405aa0b6f40 None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:57.321859 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d2e0ca8a-9ca7-47c7-aea6-8405aa0b6f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:57.389414 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1472/2924] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:57.400519 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbc4d4-bf59-41c7-b102-9e05cbeea42d None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:57.400801 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbc4d4-bf59-41c7-b102-9e05cbeea42d None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:57.401106 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbc4d4-bf59-41c7-b102-9e05cbeea42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:57.426763 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-82dbc4d4-bf59-41c7-b102-9e05cbeea42d None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:57.427929 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-82dbc4d4-bf59-41c7-b102-9e05cbeea42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:57.436764 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1453/2925] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:57.441962 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0ca8a-9ca7-47c7-aea6-8405aa0b6f40 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:57.454857 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0ca8a-9ca7-47c7-aea6-8405aa0b6f40 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:57.459751 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a73cc-c43d-4ce7-8b4b-a69b2fac6949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:57.460481 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a73cc-c43d-4ce7-8b4b-a69b2fac6949 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:57.460758 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a73cc-c43d-4ce7-8b4b-a69b2fac6949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:57.461024 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a73cc-c43d-4ce7-8b4b-a69b2fac6949 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:57.461722 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a73cc-c43d-4ce7-8b4b-a69b2fac6949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:46:57.462020 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a73cc-c43d-4ce7-8b4b-a69b2fac6949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:57.463716 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a73cc-c43d-4ce7-8b4b-a69b2fac6949 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:57.476883 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1473/2926] 10.222.0.81 () {58 vars in 1153 bytes} [Mon Aug 29 20:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:46:57.482461 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbc4d4-bf59-41c7-b102-9e05cbeea42d None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:57.491770 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbc4d4-bf59-41c7-b102-9e05cbeea42d None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:57.497449 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296352d-6b8e-4572-8327-43651353de29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:57.498064 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296352d-6b8e-4572-8327-43651353de29 admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:57.498381 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296352d-6b8e-4572-8327-43651353de29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:57.498651 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296352d-6b8e-4572-8327-43651353de29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:57.499272 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296352d-6b8e-4572-8327-43651353de29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:57.501278 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296352d-6b8e-4572-8327-43651353de29 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:57.604158 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1454/2927] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:46:57 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:57.608825 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a73cc-c43d-4ce7-8b4b-a69b2fac6949 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:57.620220 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a73cc-c43d-4ce7-8b4b-a69b2fac6949 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:57.685752 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4cdfc-29e7-4d3f-bcd2-25feed7cacc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:57.686305 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4cdfc-29e7-4d3f-bcd2-25feed7cacc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:57.686586 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4cdfc-29e7-4d3f-bcd2-25feed7cacc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:57.686856 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4cdfc-29e7-4d3f-bcd2-25feed7cacc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:57.687495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4cdfc-29e7-4d3f-bcd2-25feed7cacc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:57.689460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4cdfc-29e7-4d3f-bcd2-25feed7cacc9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:57.792131 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1474/2928] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:46:57 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:46:57.796265 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296352d-6b8e-4572-8327-43651353de29 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:57.807155 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296352d-6b8e-4572-8327-43651353de29 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:57.811856 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e857bf-ebb9-4058-91cd-8f42e2f9636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:57.812461 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e857bf-ebb9-4058-91cd-8f42e2f9636e admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:57.812741 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e857bf-ebb9-4058-91cd-8f42e2f9636e admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:57.813012 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e857bf-ebb9-4058-91cd-8f42e2f9636e admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:57.813653 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e857bf-ebb9-4058-91cd-8f42e2f9636e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:57.815291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e857bf-ebb9-4058-91cd-8f42e2f9636e admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:57.817649 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:57.826313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1455/2929] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:57.830850 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4cdfc-29e7-4d3f-bcd2-25feed7cacc9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:57.842480 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4cdfc-29e7-4d3f-bcd2-25feed7cacc9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:57.848214 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c2fa2-c3f8-4671-b075-b9cd27024589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:57.849309 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c2fa2-c3f8-4671-b075-b9cd27024589 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:57.849653 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c2fa2-c3f8-4671-b075-b9cd27024589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:57.850160 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c2fa2-c3f8-4671-b075-b9cd27024589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:57.851063 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c2fa2-c3f8-4671-b075-b9cd27024589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:57.853895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c2fa2-c3f8-4671-b075-b9cd27024589 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:57.867031 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1475/2930] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:46:57.876081 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e857bf-ebb9-4058-91cd-8f42e2f9636e admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:57.887796 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e857bf-ebb9-4058-91cd-8f42e2f9636e admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:57.892705 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a1ac6-67e2-43d8-a0c4-e765c58eadd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:57.893690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a1ac6-67e2-43d8-a0c4-e765c58eadd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:57.893690 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a1ac6-67e2-43d8-a0c4-e765c58eadd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:57.894345 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a1ac6-67e2-43d8-a0c4-e765c58eadd5 admin admin] PATH_INFO: `/v3/projects/5ac40673ea76405380fc22e1db20971b/users/6ff1681b73114639985302a69aef7904/roles/6721d4c1040945dd8817af24236acb65` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:57.909621 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a1ac6-67e2-43d8-a0c4-e765c58eadd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac40673ea76405380fc22e1db20971b, user_id=6ff1681b73114639985302a69aef7904, role_id=6721d4c1040945dd8817af24236acb65)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:57.912313 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a1ac6-67e2-43d8-a0c4-e765c58eadd5 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:58.006020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1456/2931] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:46:57 2022] PUT /identity/v3/projects/5ac40673ea76405380fc22e1db20971b/users/6ff1681b73114639985302a69aef7904/roles/6721d4c1040945dd8817af24236acb65 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:46:58.011902 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fd3f8-ab5a-46bb-9615-21bad91501dd None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:58.012347 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fd3f8-ab5a-46bb-9615-21bad91501dd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:58.012625 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fd3f8-ab5a-46bb-9615-21bad91501dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:58.036120 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ac2fd3f8-ab5a-46bb-9615-21bad91501dd None None] MFA Rules not processed for user `5f7e3f63661a405ba93a9ec8bf8d6603`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:46:58.037381 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ac2fd3f8-ab5a-46bb-9615-21bad91501dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:58.058867 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:58.103575 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1476/2932] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:46:58.113619 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a1ac6-67e2-43d8-a0c4-e765c58eadd5 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:46:58.115587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-0b9a1ac6-67e2-43d8-a0c4-e765c58eadd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:46:58.198150 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a1ac6-67e2-43d8-a0c4-e765c58eadd5 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:46:58.202018 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470d99-8c67-4f4b-b1fe-d97627386750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:46:58.202700 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470d99-8c67-4f4b-b1fe-d97627386750 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:46:58.202984 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470d99-8c67-4f4b-b1fe-d97627386750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:46:58.203261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470d99-8c67-4f4b-b1fe-d97627386750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:46:58.215790 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6470d99-8c67-4f4b-b1fe-d97627386750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:46:58.217237 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6470d99-8c67-4f4b-b1fe-d97627386750 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:46:58.229488 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1457/2933] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:47:03.934422 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25393ed-0198-4b64-817d-6197fb94616b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:03.934989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25393ed-0198-4b64-817d-6197fb94616b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:03.934989 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25393ed-0198-4b64-817d-6197fb94616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:03.969306 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a25393ed-0198-4b64-817d-6197fb94616b None None] MFA Rules not processed for user `6ff1681b73114639985302a69aef7904`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:47:03.970611 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a25393ed-0198-4b64-817d-6197fb94616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:47:04.039555 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1477/2934] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:47:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:47:04.044513 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470d99-8c67-4f4b-b1fe-d97627386750 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:47:04.084246 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470d99-8c67-4f4b-b1fe-d97627386750 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:47:04.090684 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7314d-29ba-4d21-b94f-fbe909a5401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:47:04.091031 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7314d-29ba-4d21-b94f-fbe909a5401f admin admin] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:04.091312 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7314d-29ba-4d21-b94f-fbe909a5401f admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:04.091751 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7314d-29ba-4d21-b94f-fbe909a5401f admin admin] PATH_INFO: `/v3/projects` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:04.092292 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7314d-29ba-4d21-b94f-fbe909a5401f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:47:04.094263 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7314d-29ba-4d21-b94f-fbe909a5401f admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:47:04.222603 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1458/2935] 10.222.0.81 () {60 vars in 1153 bytes} [Mon Aug 29 20:47:04 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:47:04.223666 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25393ed-0198-4b64-817d-6197fb94616b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:47:04.236362 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25393ed-0198-4b64-817d-6197fb94616b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:47:04.301188 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a514ee-d853-4d82-a671-ae78c1fb1f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:47:04.301801 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a514ee-d853-4d82-a671-ae78c1fb1f28 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:04.302080 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a514ee-d853-4d82-a671-ae78c1fb1f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:04.302383 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a514ee-d853-4d82-a671-ae78c1fb1f28 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:04.303052 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a514ee-d853-4d82-a671-ae78c1fb1f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:47:04.304950 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a514ee-d853-4d82-a671-ae78c1fb1f28 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:47:04.448613 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1478/2936] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Aug 29 20:47:04 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:47:04.452781 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7314d-29ba-4d21-b94f-fbe909a5401f admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:47:04.465083 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7314d-29ba-4d21-b94f-fbe909a5401f admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:47:04.469800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b82d9-7c86-40e3-bca0-956e89f25c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:47:04.470477 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b82d9-7c86-40e3-bca0-956e89f25c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:04.470779 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b82d9-7c86-40e3-bca0-956e89f25c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:04.471047 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b82d9-7c86-40e3-bca0-956e89f25c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:04.471701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b82d9-7c86-40e3-bca0-956e89f25c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:47:04.473291 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b82d9-7c86-40e3-bca0-956e89f25c1d admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:47:04.484166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1459/2937] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:47:04.488345 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a514ee-d853-4d82-a671-ae78c1fb1f28 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:47:04.499194 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a514ee-d853-4d82-a671-ae78c1fb1f28 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:47:04.504450 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c78fe-7f42-47e5-9a8e-3e4f99d40b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:47:04.505144 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c78fe-7f42-47e5-9a8e-3e4f99d40b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:04.505460 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c78fe-7f42-47e5-9a8e-3e4f99d40b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:04.505662 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c78fe-7f42-47e5-9a8e-3e4f99d40b49 admin admin] PATH_INFO: `/v3/projects/862b0aff5c07454ba495dcd008a575e6/users/16aae73e071f4922beb872117c896bb7/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:04.521720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c78fe-7f42-47e5-9a8e-3e4f99d40b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=862b0aff5c07454ba495dcd008a575e6, user_id=16aae73e071f4922beb872117c896bb7, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:47:04.524386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c78fe-7f42-47e5-9a8e-3e4f99d40b49 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:47:04.653635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1479/2938] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:47:04 2022] PUT /identity/v3/projects/862b0aff5c07454ba495dcd008a575e6/users/16aae73e071f4922beb872117c896bb7/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:47:04.657742 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b82d9-7c86-40e3-bca0-956e89f25c1d admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:47:04.668845 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b82d9-7c86-40e3-bca0-956e89f25c1d admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:47:04.724101 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:47:04.731107 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25abc4c-a9a4-4fc9-b8e0-41e76c5d7768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:47:04.731658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25abc4c-a9a4-4fc9-b8e0-41e76c5d7768 admin admin] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:04.731936 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25abc4c-a9a4-4fc9-b8e0-41e76c5d7768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:04.732227 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25abc4c-a9a4-4fc9-b8e0-41e76c5d7768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:04.732899 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25abc4c-a9a4-4fc9-b8e0-41e76c5d7768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:47:04.734628 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25abc4c-a9a4-4fc9-b8e0-41e76c5d7768 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:47:04.750344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1460/2939] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Aug 29 20:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:47:04.751475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c78fe-7f42-47e5-9a8e-3e4f99d40b49 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:47:04.762361 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c78fe-7f42-47e5-9a8e-3e4f99d40b49 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:47:04.767475 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ee62d-bd36-4670-bb08-03072f5e6b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:47:04.768140 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ee62d-bd36-4670-bb08-03072f5e6b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:04.768420 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ee62d-bd36-4670-bb08-03072f5e6b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:04.768692 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ee62d-bd36-4670-bb08-03072f5e6b39 admin admin] PATH_INFO: `/v3/projects/862b0aff5c07454ba495dcd008a575e6/users/16aae73e071f4922beb872117c896bb7/roles/4ec42dabc0a34ad59b829e8e5212a167` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:04.770917 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ee62d-bd36-4670-bb08-03072f5e6b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=862b0aff5c07454ba495dcd008a575e6, user_id=16aae73e071f4922beb872117c896bb7, role_id=4ec42dabc0a34ad59b829e8e5212a167)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:47:04.773550 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ee62d-bd36-4670-bb08-03072f5e6b39 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:47:04.785264 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1480/2940] 10.222.0.81 () {60 vars in 1483 bytes} [Mon Aug 29 20:47:04 2022] PUT /identity/v3/projects/862b0aff5c07454ba495dcd008a575e6/users/16aae73e071f4922beb872117c896bb7/roles/4ec42dabc0a34ad59b829e8e5212a167 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:47:10.692196 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285dc70-3242-46f6-b704-f2fb861c7e72 None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:10.692735 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285dc70-3242-46f6-b704-f2fb861c7e72 None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:10.693566 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285dc70-3242-46f6-b704-f2fb861c7e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:10.729453 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-9285dc70-3242-46f6-b704-f2fb861c7e72 None None] MFA Rules not processed for user `16aae73e071f4922beb872117c896bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:47:10.731123 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-9285dc70-3242-46f6-b704-f2fb861c7e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:47:10.814831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1461/2941] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:47:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:47:10.836100 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ee62d-bd36-4670-bb08-03072f5e6b39 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:47:10.838495 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1a0ee62d-bd36-4670-bb08-03072f5e6b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:47:10.851222 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:47:10.927805 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ee62d-bd36-4670-bb08-03072f5e6b39 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:47:10.935102 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960a2e8-d6e5-4e33-a6c4-ca22d2fc7cb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:47:10.935734 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a2e8-d6e5-4e33-a6c4-ca22d2fc7cb0 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:10.936012 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a2e8-d6e5-4e33-a6c4-ca22d2fc7cb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:10.936287 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a2e8-d6e5-4e33-a6c4-ca22d2fc7cb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:10.999909 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960a2e8-d6e5-4e33-a6c4-ca22d2fc7cb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:47:11.001520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960a2e8-d6e5-4e33-a6c4-ca22d2fc7cb0 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:47:11.011784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1481/2942] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:47:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:47:13.869894 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8d9a9-8154-45a9-af01-1e7f2f5b7dbf None None] REQUEST_METHOD: `POST` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:13.870537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8d9a9-8154-45a9-af01-1e7f2f5b7dbf None None] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:13.870537 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8d9a9-8154-45a9-af01-1e7f2f5b7dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:13.891838 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.auth.core [None req-a7c8d9a9-8154-45a9-af01-1e7f2f5b7dbf None None] MFA Rules not processed for user `6ff1681b73114639985302a69aef7904`. Rule list: `[]` (Enabled: `True`). {{(pid=81955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:47:13.893053 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a7c8d9a9-8154-45a9-af01-1e7f2f5b7dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:47:13.903881 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1462/2943] 10.222.0.81 () {58 vars in 958 bytes} [Mon Aug 29 20:47:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:47:21.081829 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=53 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:47:23.884577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=40 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:47:30.741673 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960a2e8-d6e5-4e33-a6c4-ca22d2fc7cb0 service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:47:30.745694 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5960a2e8-d6e5-4e33-a6c4-ca22d2fc7cb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:47:30.824379 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960a2e8-d6e5-4e33-a6c4-ca22d2fc7cb0 service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:47:30.828616 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3b93f-d516-430b-aaa2-48539b5ddea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e128651197d840bd87220d8f5b246688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:47:30.829303 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3b93f-d516-430b-aaa2-48539b5ddea4 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:30.829580 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3b93f-d516-430b-aaa2-48539b5ddea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:30.829848 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3b93f-d516-430b-aaa2-48539b5ddea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:30.831731 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-07a3b93f-d516-430b-aaa2-48539b5ddea4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:47:30.846210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3b93f-d516-430b-aaa2-48539b5ddea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:47:30.849510 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3b93f-d516-430b-aaa2-48539b5ddea4 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:47:30.858906 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1482/2944] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:47:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:47:31.927558 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8d9a9-8154-45a9-af01-1e7f2f5b7dbf None None] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:47:31.929235 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a7c8d9a9-8154-45a9-af01-1e7f2f5b7dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:47:31.992066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8d9a9-8154-45a9-af01-1e7f2f5b7dbf None None] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:47:31.995679 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a5ef7-a11f-42d0-8541-28f56eb337c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:47:31.996283 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a5ef7-a11f-42d0-8541-28f56eb337c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:31.996559 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a5ef7-a11f-42d0-8541-28f56eb337c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:31.996835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a5ef7-a11f-42d0-8541-28f56eb337c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:31.998782 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-e30a5ef7-a11f-42d0-8541-28f56eb337c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:47:32.018807 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a5ef7-a11f-42d0-8541-28f56eb337c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:47:32.021222 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a5ef7-a11f-42d0-8541-28f56eb337c7 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:47:32.034835 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1463/2945] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:47:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:47:39.740238 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3b93f-d516-430b-aaa2-48539b5ddea4 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:47:39.751756 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3b93f-d516-430b-aaa2-48539b5ddea4 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:47:39.755870 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128155dd-8047-4142-a3f1-fb9888700d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:47:39.756827 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128155dd-8047-4142-a3f1-fb9888700d28 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:39.757365 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128155dd-8047-4142-a3f1-fb9888700d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:39.757839 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128155dd-8047-4142-a3f1-fb9888700d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:39.760220 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-128155dd-8047-4142-a3f1-fb9888700d28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:47:39.775635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128155dd-8047-4142-a3f1-fb9888700d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:47:39.777491 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128155dd-8047-4142-a3f1-fb9888700d28 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:47:39.788834 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1483/2946] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:47:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:47:40.680056 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a5ef7-a11f-42d0-8541-28f56eb337c7 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:47:40.692192 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a5ef7-a11f-42d0-8541-28f56eb337c7 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:47:40.697913 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cf011-9adc-4722-844b-27e9a648fc93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:47:40.698639 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cf011-9adc-4722-844b-27e9a648fc93 service nova] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:40.699005 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cf011-9adc-4722-844b-27e9a648fc93 service nova] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:40.699342 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cf011-9adc-4722-844b-27e9a648fc93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:40.701344 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a52cf011-9adc-4722-844b-27e9a648fc93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:47:40.714945 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cf011-9adc-4722-844b-27e9a648fc93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:47:40.716523 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cf011-9adc-4722-844b-27e9a648fc93 service nova] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:47:40.727920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1464/2947] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:47:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:47:49.731784 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128155dd-8047-4142-a3f1-fb9888700d28 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:47:49.741216 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128155dd-8047-4142-a3f1-fb9888700d28 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:47:49.745178 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94667041-6778-4a4c-88ee-117b5f96c473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:47:49.745770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94667041-6778-4a4c-88ee-117b5f96c473 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:47:49.746045 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94667041-6778-4a4c-88ee-117b5f96c473 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:47:49.746357 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94667041-6778-4a4c-88ee-117b5f96c473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:47:49.756915 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94667041-6778-4a4c-88ee-117b5f96c473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:47:49.758396 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94667041-6778-4a4c-88ee-117b5f96c473 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:47:49.770739 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1484/2948] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:47:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:47:50.723109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=32 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:47:59.765443 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=47 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:50:04.108201 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cf011-9adc-4722-844b-27e9a648fc93 service nova] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:50:04.109708 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-a52cf011-9adc-4722-844b-27e9a648fc93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:50:04.219578 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cf011-9adc-4722-844b-27e9a648fc93 service nova] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:50:04.225020 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa751b-2a81-4c75-aa5e-5d5b7e89acdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:50:04.225643 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa751b-2a81-4c75-aa5e-5d5b7e89acdc service placement] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:50:04.225919 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa751b-2a81-4c75-aa5e-5d5b7e89acdc service placement] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:50:04.226194 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa751b-2a81-4c75-aa5e-5d5b7e89acdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:50:04.228257 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-59aa751b-2a81-4c75-aa5e-5d5b7e89acdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:50:04.241066 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa751b-2a81-4c75-aa5e-5d5b7e89acdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:50:04.242681 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa751b-2a81-4c75-aa5e-5d5b7e89acdc service placement] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:50:04.253615 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1465/2949] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:50:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:50:05.419698 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94667041-6778-4a4c-88ee-117b5f96c473 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:50:05.428770 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94667041-6778-4a4c-88ee-117b5f96c473 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:50:05.432798 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b08aa7-f220-4ccf-917d-011bc9132f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:50:05.433407 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b08aa7-f220-4ccf-917d-011bc9132f5c service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:50:05.433683 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b08aa7-f220-4ccf-917d-011bc9132f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:50:05.433966 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b08aa7-f220-4ccf-917d-011bc9132f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:50:05.436111 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-54b08aa7-f220-4ccf-917d-011bc9132f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:50:05.447895 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b08aa7-f220-4ccf-917d-011bc9132f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:50:05.449333 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b08aa7-f220-4ccf-917d-011bc9132f5c service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:50:05.459156 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1485/2950] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:50:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:50:06.119948 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa751b-2a81-4c75-aa5e-5d5b7e89acdc service placement] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:50:06.130323 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa751b-2a81-4c75-aa5e-5d5b7e89acdc service placement] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:50:06.134433 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35f19e-364f-478a-b11f-b83bc2fea821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:50:06.135109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35f19e-364f-478a-b11f-b83bc2fea821 service neutron] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:50:06.135423 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35f19e-364f-478a-b11f-b83bc2fea821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:50:06.135631 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35f19e-364f-478a-b11f-b83bc2fea821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:50:06.138162 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-0d35f19e-364f-478a-b11f-b83bc2fea821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:50:06.148977 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35f19e-364f-478a-b11f-b83bc2fea821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:50:06.150525 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35f19e-364f-478a-b11f-b83bc2fea821 service neutron] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:50:06.159966 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1466/2951] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:50:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:50:06.257745 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b08aa7-f220-4ccf-917d-011bc9132f5c service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:50:06.267635 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b08aa7-f220-4ccf-917d-011bc9132f5c service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:50:06.271398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e51125-c595-4108-8c23-96fb325ad8d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241e34a86aba4c3a92ed9d469e6a205e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:50:06.272001 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e51125-c595-4108-8c23-96fb325ad8d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:50:06.272276 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e51125-c595-4108-8c23-96fb325ad8d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:50:06.272540 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e51125-c595-4108-8c23-96fb325ad8d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:50:06.274284 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b5e51125-c595-4108-8c23-96fb325ad8d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:50:06.317201 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e51125-c595-4108-8c23-96fb325ad8d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:50:06.318720 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e51125-c595-4108-8c23-96fb325ad8d3 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:50:06.346587 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1486/2952] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:50:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:50:06.411842 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35f19e-364f-478a-b11f-b83bc2fea821 service neutron] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:50:06.413327 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-0d35f19e-364f-478a-b11f-b83bc2fea821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:50:06.428422 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35f19e-364f-478a-b11f-b83bc2fea821 service neutron] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:50:06.433689 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a8675-4493-40cd-bd0e-265f2f8b0187 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:50:06.434417 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a8675-4493-40cd-bd0e-265f2f8b0187 service placement] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:50:06.434701 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a8675-4493-40cd-bd0e-265f2f8b0187 service placement] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:50:06.435166 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a8675-4493-40cd-bd0e-265f2f8b0187 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:50:06.436911 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-f85a8675-4493-40cd-bd0e-265f2f8b0187 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:50:06.449168 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a8675-4493-40cd-bd0e-265f2f8b0187 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:50:06.451995 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a8675-4493-40cd-bd0e-265f2f8b0187 service placement] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:50:06.462533 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1467/2953] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:50:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:50:07.615152 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e51125-c595-4108-8c23-96fb325ad8d3 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:50:07.616568 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b5e51125-c595-4108-8c23-96fb325ad8d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:50:07.630851 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e51125-c595-4108-8c23-96fb325ad8d3 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:50:07.636484 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dffca5-ec37-4e02-8d67-d6334193bfce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30946d3b3f0f4a81b2ae5aa6e84f3920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:50:07.637164 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dffca5-ec37-4e02-8d67-d6334193bfce service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:50:07.637496 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dffca5-ec37-4e02-8d67-d6334193bfce service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:50:07.637771 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dffca5-ec37-4e02-8d67-d6334193bfce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:50:07.639880 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-17dffca5-ec37-4e02-8d67-d6334193bfce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:50:07.653394 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dffca5-ec37-4e02-8d67-d6334193bfce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:50:07.655038 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dffca5-ec37-4e02-8d67-d6334193bfce service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:50:07.666817 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1487/2954] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:50:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:50:16.458049 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=53 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:50:17.661459 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=30 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:51:45.209057 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a8675-4493-40cd-bd0e-265f2f8b0187 service placement] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:51:45.218637 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a8675-4493-40cd-bd0e-265f2f8b0187 service placement] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:51:45.224443 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedba6f7-7e2c-4a5c-ad40-b4fc4f0461b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:51:45.225109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedba6f7-7e2c-4a5c-ad40-b4fc4f0461b9 service placement] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:51:45.225561 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedba6f7-7e2c-4a5c-ad40-b4fc4f0461b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:51:45.225831 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedba6f7-7e2c-4a5c-ad40-b4fc4f0461b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:51:45.227657 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-eedba6f7-7e2c-4a5c-ad40-b4fc4f0461b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:51:45.240788 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedba6f7-7e2c-4a5c-ad40-b4fc4f0461b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:51:45.242506 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedba6f7-7e2c-4a5c-ad40-b4fc4f0461b9 service placement] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:51:45.254343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1468/2955] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:51:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:51:49.041332 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dffca5-ec37-4e02-8d67-d6334193bfce service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:51:49.054871 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dffca5-ec37-4e02-8d67-d6334193bfce service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:51:49.061534 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38913b65-e6d3-49b4-bbe8-f561366ce497 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:51:49.062153 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38913b65-e6d3-49b4-bbe8-f561366ce497 service placement] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:51:49.062520 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38913b65-e6d3-49b4-bbe8-f561366ce497 service placement] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:51:49.062730 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38913b65-e6d3-49b4-bbe8-f561366ce497 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:51:49.064441 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-38913b65-e6d3-49b4-bbe8-f561366ce497 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:51:49.077210 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38913b65-e6d3-49b4-bbe8-f561366ce497 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:51:49.078911 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38913b65-e6d3-49b4-bbe8-f561366ce497 service placement] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:51:49.089840 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1488/2956] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:51:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:51:49.181658 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedba6f7-7e2c-4a5c-ad40-b4fc4f0461b9 service placement] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:51:49.248703 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedba6f7-7e2c-4a5c-ad40-b4fc4f0461b9 service placement] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:51:49.253251 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:51:49.253880 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:51:49.254160 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:51:49.254538 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] PATH_INFO: `/v3/users/6ff1681b73114639985302a69aef7904` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:51:49.255672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ff1681b73114639985302a69aef7904)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:51:49.257577 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:51:49.459523 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ff1681b73114639985302a69aef7904'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:49.467317 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ff1681b73114639985302a69aef7904'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:49.468002 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ff1681b73114639985302a69aef7904'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:49.557137 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ff1681b73114639985302a69aef7904'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:49.570343 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ff1681b73114639985302a69aef7904'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:49.576354 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1469/2957] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:51:49 2022] DELETE /identity/v3/users/6ff1681b73114639985302a69aef7904 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:51:49.840932 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38913b65-e6d3-49b4-bbe8-f561366ce497 service placement] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:51:49.858015 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38913b65-e6d3-49b4-bbe8-f561366ce497 service placement] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:51:49.938328 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:51:49.938980 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:51:49.939260 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:51:49.939537 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] PATH_INFO: `/v3/projects/5ac40673ea76405380fc22e1db20971b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:51:49.940824 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac40673ea76405380fc22e1db20971b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:51:49.942787 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:51:50.050472 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac40673ea76405380fc22e1db20971b', 'request_id': 'req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:50.056684 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac40673ea76405380fc22e1db20971b', 'request_id': 'req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:50.157129 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac40673ea76405380fc22e1db20971b', 'request_id': 'req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:50.168282 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] The token cache is being invalidate because project 5ac40673ea76405380fc22e1db20971b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:51:50.172982 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:50.172982 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:50.172982 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1489/2958] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:51:49 2022] DELETE /identity/v3/projects/5ac40673ea76405380fc22e1db20971b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:51:50.175437 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:51:50.176829 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:51:50.191528 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d59bc-0c4f-4194-9cac-7ab347a2c2d3 admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:51:50.250630 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:51:50.251261 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:51:50.251544 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:51:50.251821 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] PATH_INFO: `/v3/users/16aae73e071f4922beb872117c896bb7` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:51:50.252967 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] RBAC: Authorizing `identity:delete_user(user_id=16aae73e071f4922beb872117c896bb7)` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:51:50.254930 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:51:50.260374 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:51:50.451761 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16aae73e071f4922beb872117c896bb7'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:50.461063 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16aae73e071f4922beb872117c896bb7'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:50.461800 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16aae73e071f4922beb872117c896bb7'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:50.591385 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16aae73e071f4922beb872117c896bb7'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:50.604612 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.notifications [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16aae73e071f4922beb872117c896bb7'} {{(pid=81955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:50.611587 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1470/2959] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Aug 29 20:51:50 2022] DELETE /identity/v3/users/16aae73e071f4922beb872117c896bb7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:51:50.896551 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:51:50.898028 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:51:50.913191 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8647e-be54-48c8-9cb3-97e69fbb1b0f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:51:50.973212 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30d628-2286-4645-8375-991f2ce67455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7e3f63661a405ba93a9ec8bf8d6603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f67ec719bc34531ae1e710c78054427', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:51:50.973764 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30d628-2286-4645-8375-991f2ce67455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:51:50.974046 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30d628-2286-4645-8375-991f2ce67455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:51:50.974366 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30d628-2286-4645-8375-991f2ce67455 admin admin] PATH_INFO: `/v3/projects/862b0aff5c07454ba495dcd008a575e6` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:51:50.975560 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30d628-2286-4645-8375-991f2ce67455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=862b0aff5c07454ba495dcd008a575e6)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:51:50.977386 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30d628-2286-4645-8375-991f2ce67455 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:51:51.000604 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:51:51.109637 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4e30d628-2286-4645-8375-991f2ce67455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '862b0aff5c07454ba495dcd008a575e6', 'request_id': 'req-4e30d628-2286-4645-8375-991f2ce67455'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:51.116367 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4e30d628-2286-4645-8375-991f2ce67455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '862b0aff5c07454ba495dcd008a575e6', 'request_id': 'req-4e30d628-2286-4645-8375-991f2ce67455'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:51.186736 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4e30d628-2286-4645-8375-991f2ce67455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '862b0aff5c07454ba495dcd008a575e6', 'request_id': 'req-4e30d628-2286-4645-8375-991f2ce67455'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:51.198458 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4e30d628-2286-4645-8375-991f2ce67455 admin admin] The token cache is being invalidate because project 862b0aff5c07454ba495dcd008a575e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:51:51.198749 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4e30d628-2286-4645-8375-991f2ce67455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:51.199398 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4e30d628-2286-4645-8375-991f2ce67455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:51:51.201517 dv-cinder-852009-5-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1490/2960] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Aug 29 20:51:50 2022] DELETE /identity/v3/projects/862b0aff5c07454ba495dcd008a575e6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:52:00.607900 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:52:01.265677 dv-cinder-852009-5-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:55:06.109176 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] Authenticating user token {{(pid=81955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:55:06.110672 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:55:06.182255 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2165f-c0e8-4d9d-ac53-8665b00049de admin admin] Validating token access rules against request {{(pid=81955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:55:06.243045 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cd1d0-aab1-4070-97d9-fbf9d13d94e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884b748550d546b7a0bb2bc5b0c614d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e86d23a023e4db497277d055b604ebe', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:55:06.243656 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cd1d0-aab1-4070-97d9-fbf9d13d94e2 service placement] REQUEST_METHOD: `GET` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:55:06.243935 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cd1d0-aab1-4070-97d9-fbf9d13d94e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:55:06.244202 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cd1d0-aab1-4070-97d9-fbf9d13d94e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:55:06.245920 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.fernet_utils [None req-c68cd1d0-aab1-4070-97d9-fbf9d13d94e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:55:06.257633 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cd1d0-aab1-4070-97d9-fbf9d13d94e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:55:06.259275 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cd1d0-aab1-4070-97d9-fbf9d13d94e2 service placement] RBAC: Authorization granted {{(pid=81955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:55:06.269366 dv-cinder-852009-5-smb devstack@keystone.service[81955]: [pid: 81955|app: 0|req: 1471/2961] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Aug 29 20:55:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:55:16.265109 dv-cinder-852009-5-smb devstack@keystone.service[81955]: DEBUG dbcounter [-] [81955] Writing DB stats keystone:SELECT=58 {{(pid=81955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}